Image processing method, electronic equipment and system

Abstract

The invention provides an image processing method, electronic equipment and a system, and relates to the technical field of terminals. In the application, the first device processes the input first image according to the image processing capability of the second device to obtain the second image adaptive to the image processing capability of the second device, so that the second device can improve the processing and display effects of the second image. The method comprises the following steps: a first device receives first information sent by a second device, wherein the first information is used for indicating the image processing capability of the second device; the first device processes an input first image through a first image processing algorithm according to the first information under the condition that the image processing capacity of the second device meets a first condition, and a second image is obtained. The first device sends second information to the second device, the second information carries the second image and image processing information corresponding to the second image, and the second information is used for indicating the second device to process the second image according to the image processing information.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of terminal technology, and in particular to an image processing method, electronic device, and system. Background Art

[0002] With the development of terminal technology, televisions, with their large display screens and high resolutions, have been widely used in users' daily lives to meet their audio-visual experience needs. Generally, a television is connected to a set-top box, which, after acquiring and processing the original image, can send the processed image to the television for display.

[0003] The resolution of the image processed by the set-top box must be the same as the display resolution of the TV in order to achieve normal display on the TV. Therefore, when the set-top box determines that the resolution of the original image is different from the display resolution of the TV, it needs to perform image scaling on the original image so that the resolution of the processed output image is the same as the display resolution of the TV. Afterwards, after the TV obtains the processed image output by the set-top box, it will enhance the image quality to improve the display effect.

[0004] In the above process, if the resolution of the original image is smaller than the display resolution of the TV, the set-top box needs to enlarge the original image, and the resolution of the output image is a false resolution. The TV enhances the image quality of the false resolution image output by the set-top box, but cannot obtain a good display effect, affecting the user's viewing experience. Summary of the invention

[0005] In order to solve the above technical problems, the embodiments of the present application provide an image processing method, electronic device and system. In the technical solution provided by the embodiments of the present application, the first device processes the input first image according to the image processing capability of the second device, obtains the second image, and sends the second image to the second device. The second device receives an image adapted to the image processing capability of the second device, which can ensure the processing and display effect of the second device on the received second image.

[0006] In order to achieve the above technical objectives, this application provides the following technical solutions:

[0007] In a first aspect, an image processing method is provided, which is applied to a first device. The method includes: receiving first information sent by a second device, the first information being used to indicate the image processing capability of the second device. According to the first information, when the image processing capability of the second device meets a first condition, the input first image is processed by a first image processing algorithm to obtain a second image. Second information is sent to the second device, the second information carrying the second image and image processing information corresponding to the second image, and the second information is used to instruct the second device to process the second image according to the image processing information.

[0008] In this way, the first device can process and send an image corresponding to the image processing capability of the second device to the second device according to the image processing capability of the second device. At the same time, the image processing information of the image processed by the first device is sent to the second device, instructing the second device to process the second image according to the image processing information. The image processing effect of the second device is guaranteed.

[0009] According to the first aspect, or any implementation of the first aspect above, before sending the second information to the second device, the method also includes: based on the first information, when the image processing capability of the second device does not meet the first condition, processing the first image by a second image processing algorithm to obtain the second image.

[0010] In this way, the first device adapts different image processing algorithms to process the image according to the image processing capability of the second device, so that the processed second image sent to the second device is more adapted to the image processing capability of the second device.

[0011] According to the first aspect, or any implementation of the first aspect above, the first image processing algorithm is an algorithm for changing the first pixel value of the first image, or an algorithm for not changing the first pixel value. The second image processing algorithm is an algorithm for changing the first pixel value.

[0012] In this way, the second image without changing the first pixel value can be restored to the first image by the second device. The second device can process the second image without changing the first pixel value by restoring the second image to the first image. Moreover, when the image processing capability of the second device meets the first condition, the second device can also process the second image with the first pixel value changed well. Therefore, the first device uses an algorithm that changes the first pixel value of the first image, or an algorithm that does not change the first pixel value to process the image. The second image with the first pixel value changed or not changed is sent to the second device, so that the second device can process the received second image well. When the image processing capability of the second device does not meet the first condition, the second image with the first pixel value changed will have a smoother display effect than the second image with the first pixel value not changed. Therefore, the first device uses an algorithm that changes the first pixel value to process the image, so that the image sent to the second device has a smoother display effect.

[0013] According to the first aspect, or any implementation of the first aspect above, the image processing capability includes whether the second device supports true and false resolution adaptation, and the first condition includes supporting true and false resolution adaptation.

[0014] In this way, the first device processes the image using an algorithm that changes the first pixel value or an algorithm that does not change the first pixel value according to the second device's ability to support true and false resolution adaptation, and can obtain and send to the second device a second image that matches the second device's true and false resolution adaptation capability. And by simultaneously sending image processing information to the second device, instructing the second device to process the second image according to the image processing information, the second device further ensures the processing effect of the received second image.

[0015] According to the first aspect, or any implementation of the first aspect above, the image processing information includes a first resolution of the first image and algorithm information of an image processing algorithm used to process the first image.

[0016] In this way, the first device sends image processing information including the first resolution of the first image and algorithm information of the image processing algorithm used to process the first image to the second device, to instruct the second device to process the second image. The second device processes the second image according to the first resolution of the first image and the algorithm information of the image processing algorithm used to process the first image, which can solve the problem that the second device cannot effectively process the second image with a false resolution.

[0017] In a second aspect, an image processing method is provided, which is applied to a second device. The method includes: sending first information to a first device, where the first information is used to indicate the image processing capability of the second device. Receiving second information sent by the first device, where the second information carries a second image and image processing information corresponding to the second image, where the second image is an image obtained by the first device after processing the input first image according to the first information. According to the image processing information, the second image is enhanced to obtain a third image. The third image is displayed.

[0018] In this way, the second device sends the first information indicating the image processing capability of the second device to the first device, and receives the second image and image processing information processed according to the first information sent by the first device. Because the second image matches the image processing capability of the second device, the second device performs image quality enhancement processing and displays the second image according to the image processing information sent by the first device, which can ensure the effect of image quality enhancement processing and display.

[0019] According to the second aspect, or any implementation of the second aspect above, the image processing information includes a first resolution of the first image and algorithm information of an image processing algorithm used to process the first image, and the image processing algorithm includes an algorithm that changes a first pixel value of the first image, or an algorithm that does not change the first pixel value.

[0020] In this way, the image processing algorithm includes an algorithm that changes the first pixel value of the first image, or an algorithm that does not change the first pixel value. The second device can know whether the pixel value of the second image has changed compared to the pixel value of the first image based on the algorithm information of the image processing algorithm used for the first image. The second device can perform image quality enhancement processing on the second image based on the change in the pixel value of the second image compared to the pixel value of the first image.

[0021] According to the second aspect, or any implementation of the second aspect above, according to the image processing information, the second image is enhanced to obtain a third image, including: when the first resolution is greater than or equal to the second resolution of the second image, the second image is enhanced to obtain the third image according to the second resolution. When the first resolution is less than the second resolution, the second image is enhanced to obtain the third image according to the algorithm information.

[0022] In this way, the second device can determine whether the first device has scaled the first image, and whether the processing performed is enlargement or reduction, based on the size relationship between the second resolution and the first resolution. If the first device has not processed the first image or has reduced it, then the resolution of the second image is true, and the second resolution is directly used to enhance the image quality of the second image, and the problem of poor image quality enhancement will not occur. If the first device enlarges the first image to obtain the second image, and the resolution of the second image is false, the second device can enhance the image quality of the second image based on the algorithm information, which can avoid the problem of poor image quality enhancement effect on the second image with false resolution.

[0023] According to the second aspect, or any implementation of the second aspect above, according to the algorithm information, the second image is enhanced to obtain a third image, including: when the algorithm information indicates that the image processing algorithm is an algorithm that does not change the first pixel value, the second image is enhanced according to the second resolution to obtain the third image. When the algorithm information indicates that the image processing algorithm is an algorithm that changes the first pixel value, the second image is enhanced according to the first resolution, the second resolution, and the algorithm type of the image processing algorithm to obtain the third image.

[0024] In this way, the second device determines whether the resolution of the second image can be restored according to whether the image processing algorithm used by the first device is an algorithm that does not change the original pixel value. If the image processing algorithm used by the first device is an algorithm that does not change the original pixel value, the second device can restore the resolution of the received image to the original resolution. The second device uses the first resolution to enhance the image quality of the restored image, which can avoid the problem of poor image quality enhancement effect caused by the second image not matching the default image quality processing parameters of the second device due to the false resolution of the second image. If the image processing algorithm used by the first device is an algorithm that changes the original pixel value, the second device cannot restore the resolution of the second image to the first resolution. For the second image with a false resolution, the image quality of the second image is enhanced based on the second resolution in combination with the first resolution and the image processing algorithm. The problem of poor effect caused by directly enhancing the image quality according to the second resolution is avoided.

[0025] According to the second aspect, or any implementation of the second aspect above, according to the image processing information, the second image is enhanced to obtain a third image, including: when the first resolution is equal to the second resolution of the second image, the second image is enhanced to obtain the third image according to the second resolution. When the first resolution is not equal to the second resolution of the second image, the second image is enhanced to obtain the third image according to the algorithm information.

[0026] In this way, when the second resolution of the second image does not change compared to the first resolution of the first image, the resolution of the second image is the true resolution. By directly enhancing the image quality of the second image based on the resolution of the second image, there will be no poor image quality enhancement effect, and the image quality enhancement effect can be guaranteed. When the second resolution of the second image changes compared to the first resolution of the first image, the second resolution of the second image may be a false resolution or a true resolution. Therefore, the second device performs image quality enhancement processing on the second image based on the algorithm information, and the image quality enhancement effect can also be guaranteed.

[0027] According to the second aspect, or any implementation of the second aspect above, according to the algorithm information, the second image is enhanced to obtain a third image, including: when the algorithm information indicates that the image processing algorithm is an algorithm that changes the first pixel value, according to the first resolution, the second resolution, and the algorithm type of the image processing algorithm, the second image is enhanced to obtain the third image. When the algorithm information indicates that the image processing algorithm is an algorithm that does not change the first pixel value, according to the size of the first resolution and the second resolution, the second image is enhanced to obtain the third image.

[0028] In this way, when the algorithm information indicates that the image processing algorithm is an algorithm that changes the first pixel value, the second pixel value of the second image changes compared to the first pixel value of the first image. Therefore, the second device performs image quality enhancement processing on the second image according to the first resolution, the second resolution, and the algorithm type of the image processing algorithm, and the image quality enhancement effect can be guaranteed. When the algorithm information indicates that the image processing algorithm is an algorithm that does not change the first pixel value, the second pixel value of the second image does not change compared to the first pixel value of the first image, and the image quality enhancement processing of the second image is performed according to the size of the first resolution and the second resolution, and the image quality enhancement effect will not be poor.

[0029] According to the second aspect, or any implementation of the second aspect above, according to the size of the first resolution and the second resolution, the second image is enhanced to obtain a third image, including: when the first resolution is greater than the second resolution, the second image is enhanced according to the second resolution to obtain the third image. When the second resolution is greater than the first resolution, after restoring the second resolution of the second image to the first resolution, the second image is enhanced to obtain the third image.

[0030] In this way, if the first resolution is greater than the second resolution, it means that the first device obtains the second image by reducing the first image. Then the second device directly enhances the second image according to the resolution of the second image, that is, the second resolution, and there will be no problem of poor image quality enhancement due to the false image resolution. If the second resolution is greater than the first resolution, it means that the first device obtains the second image by enlarging the first image. The resolution of the second image is a false resolution. If the false resolution image is directly enhanced, the image enhancement effect is poor. Based on the algorithm information indicating that the image processing algorithm is an algorithm that does not change the first pixel value, the resolution of the second image can be restored to the first resolution. After the second device restores the second resolution of the second image to the first resolution, it performs image quality enhancement on the second image, which is to enhance the true resolution image, and will not produce poor image quality enhancement effect.

[0031] In a third aspect, a first device is provided. The first device includes: a processor and a memory, the memory is coupled to the processor, the memory is used to store computer program code, the computer program code includes computer instructions, when the processor reads the computer instructions from the memory, the first device executes: receiving first information sent by a second device, the first information is used to indicate the image processing capability of the second device. According to the first information, when the image processing capability of the second device meets the first condition, the input first image is processed by a first image processing algorithm to obtain a second image. Second information is sent to the second device, the second information carries the second image and image processing information corresponding to the second image, and the second information is used to instruct the second device to process the second image according to the image processing information.

[0032] According to the third aspect, before sending the second information to the second device, when the processor reads the computer instructions from the memory, it also enables the first device to execute: based on the first information, when the image processing capability of the second device does not meet the first condition, process the first image through a second image processing algorithm to obtain the second image.

[0033] According to the third aspect, or any implementation of the third aspect above, the first image processing algorithm is an algorithm for changing the first pixel value of the first image, or an algorithm for not changing the first pixel value. The second image processing algorithm is an algorithm for changing the first pixel value.

[0034] According to the third aspect, or any implementation of the third aspect above, the image processing capability includes whether the second device supports true and false resolution adaptation, and the first condition includes supporting true and false resolution adaptation.

[0035] According to the third aspect, or any implementation of the third aspect above, the image processing information includes a first resolution of the first image and algorithm information of an image processing algorithm used to process the first image.

[0036] In a fourth aspect, a second device is provided. The second device includes: a processor, a memory, and a display screen, the memory and the display screen are coupled to the processor, the memory is used to store computer program code, the computer program code includes computer instructions, when the processor reads the computer instructions from the memory, the second device executes: sending first information to the first device, the first information is used to indicate the image processing capability of the second device. Receive the second information sent by the first device, the second information carries a second image and image processing information corresponding to the second image, the second image is the image obtained after the first device processes the input first image according to the first information. According to the image processing information, the second image is enhanced to obtain a third image. Display the third image.

[0037] According to a fourth aspect, the image processing information includes a first resolution of the first image and algorithm information of an image processing algorithm used to process the first image, the image processing algorithm including an algorithm that changes a first pixel value of the first image, or an algorithm that does not change the first pixel value.

[0038] According to the fourth aspect, or any implementation of the fourth aspect, according to the image processing information, the second image is enhanced to obtain a third image, including: when the first resolution is greater than or equal to the second resolution of the second image, the second image is enhanced to obtain the third image according to the second resolution. When the first resolution is less than the second resolution, the second image is enhanced to obtain the third image according to the algorithm information.

[0039] According to the fourth aspect, or any implementation of the fourth aspect above, according to the algorithm information, the second image is enhanced to obtain a third image, including: when the algorithm information indicates that the image processing algorithm is an algorithm that does not change the first pixel value, the second image is enhanced according to the second resolution to obtain the third image. When the algorithm information indicates that the image processing algorithm is an algorithm that changes the first pixel value, the second image is enhanced according to the first resolution, the second resolution, and the algorithm type of the image processing algorithm to obtain the third image.

[0040] According to the fourth aspect, or any implementation of the fourth aspect above, according to the image processing information, the second image is enhanced to obtain a third image, including: when the first resolution is equal to the second resolution of the second image, the second image is enhanced to obtain the third image according to the second resolution. When the first resolution is not equal to the second resolution of the second image, the second image is enhanced to obtain the third image according to the algorithm information.

[0041] According to the fourth aspect, or any implementation of the fourth aspect above, according to the algorithm information, the second image is enhanced to obtain a third image, including: when the algorithm information indicates that the image processing algorithm is an algorithm that changes the first pixel value, according to the first resolution, the second resolution, and the algorithm type of the image processing algorithm, the second image is enhanced to obtain the third image. When the algorithm information indicates that the image processing algorithm is an algorithm that does not change the first pixel value, according to the size of the first resolution and the second resolution, the second image is enhanced to obtain the third image.

[0042] According to the fourth aspect, or any implementation of the fourth aspect, the second image is enhanced according to the first resolution and the second resolution to obtain a third image, including: when the first resolution is greater than the second resolution, the second image is enhanced according to the second resolution to obtain the third image. When the second resolution is greater than the first resolution, the second image is restored to the first resolution, and the second image is enhanced to obtain the third image.

[0043] According to the fourth aspect, or any implementation of the fourth aspect, the image processing capability includes whether the second device supports true and false resolution adaptation.

[0044] In this way, because the image processing capability includes whether the second device supports true and false resolution adaptation, the first information sent by the second device to the first device is used to indicate the image processing capability of the second device, and thus the first information indicates the true and false resolution adaptation capability of the second device. The second device sends the first information to the first device, so that the first device can process the image according to the true and false resolution adaptation capability of the second device, and obtain and send to the second device an image that matches the true and false resolution adaptation capability of the second device.

[0045] In a fifth aspect, an image processing system is provided, which includes a first device and a second device. The second device is used to send first information to the first device, and the first information is used to indicate the image processing capability of the second device. The first device is used to: receive the first information sent by the second device. According to the first information, when the image processing capability of the second device meets the first condition, the input first image is processed by a first image processing algorithm to obtain a second image. Second information is sent to the second device, and the second information carries the second image and image processing information corresponding to the second image. The second device is also used to: receive the second information sent by the first device. According to the image processing information, the second image is enhanced to obtain a third image. The third image is displayed.

[0046] According to the fifth aspect, the first device is further used to: based on the first information, when the image processing capability of the second device does not meet the first condition, process the first image by a second image processing algorithm to obtain the second image.

[0047] According to the fifth aspect, or any implementation of the fifth aspect above, the image processing information includes a first resolution of the first image and algorithm information of an image processing algorithm used to process the first image, and the image processing algorithm includes an algorithm that changes a first pixel value of the first image, or an algorithm that does not change the first pixel value.

[0048] According to the fifth aspect, or any implementation of the fifth aspect above, the second device is further used to: when the first resolution is equal to the second resolution of the second image, perform image quality enhancement processing on the second image according to the second resolution to obtain a third image. When the first resolution is not equal to the second resolution of the second image, perform image quality enhancement processing on the second image according to the algorithm information to obtain a third image.

[0049] In a sixth aspect, an electronic device is provided, which has the function of implementing the data synchronization method in the first aspect and any possible implementation thereof. Alternatively, the electronic device has the function of implementing the data synchronization method in the second aspect and any possible implementation thereof. The function can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions.

[0050] In a seventh aspect, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program (also referred to as an instruction or code), and when the computer program is executed by an electronic device, the electronic device executes the method of the first aspect or any one of the implementations of the first aspect. Alternatively, the electronic device executes the method of the second aspect or any one of the implementations of the second aspect.

[0051] In an eighth aspect, a computer program product is provided, which, when executed on an electronic device, enables the electronic device to execute the method in the first aspect or any one of the implementations of the first aspect. Alternatively, enables the electronic device to execute the method in the second aspect or any one of the implementations of the second aspect.

[0052] In a ninth aspect, a circuit system is provided, the circuit system comprising a processing circuit, the processing circuit being configured to execute the method of the first aspect or any one of the embodiments of the first aspect. Alternatively, the processing circuit being configured to execute the method of the second aspect or any one of the embodiments of the second aspect.

[0053] In a tenth aspect, a chip system is provided, comprising at least one processor and at least one interface circuit, wherein the at least one interface circuit is used to perform a transceiver function and send an instruction to the at least one processor, and when the at least one processor executes the instruction, the at least one processor executes the method of the first aspect or any one of the embodiments of the first aspect. Alternatively, the at least one processor executes the method of the second aspect or any one of the embodiments of the second aspect.

[0054] The technical effects of the aforementioned aspects can be referenced to each other and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0055] Figure 1A schematic diagram of an image processing scenario provided in an embodiment of the present application;

[0056] Figure 2 A schematic diagram of a communication system to which the image processing method provided in an embodiment of the present application is applied;

[0057] Figure 3 A schematic diagram of the hardware structure of the second device provided in an embodiment of the present application;

[0058] Figure 4 Schematic diagram of the image processing method provided in the embodiment of the present application Figure 1 ;

[0059] Figure 5A A schematic diagram of the interaction between a set-top box and a television provided in an embodiment of the present application;

[0060] Figure 5B A schematic diagram of a scenario in which a set-top box and a television transmit an image provided in an embodiment of the present application;

[0061] Figure 6 A schematic diagram of a flow chart of an image processing method on a set-top box side provided in an embodiment of the present application;

[0062] Figure 7 Schematic diagram of the process of the image processing method on the TV side provided in the embodiment of the present application Figure 1 ;

[0063] Figure 8 Schematic diagram of the process of the image processing method on the TV side provided in the embodiment of the present application Figure 2 ;

[0064] Fig. 9 Schematic diagram of the image processing method provided in the embodiment of the present application Figure 2 ;

[0065] Fig.10 A schematic diagram of the structure of a first device provided in an embodiment of the present application;

[0066] Fig.11 A schematic diagram of the structure of the second device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0067] The technical solutions in the embodiments of the present application are described below in conjunction with the accompanying drawings in the embodiments of the present application. Wherein, in the description of the embodiments of the present application, the terms used in the following embodiments are only for the purpose of describing specific embodiments, and are not intended to be used as limitations on the present application. As used in the specification and the appended claims of the present application, the singular expressions "one", "a kind of", "above", "the" and "this" are intended to include expressions such as "one or more", unless there is a clear indication to the contrary in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one or more (including two).

[0068] References to "one embodiment" or "some embodiments" etc. described in this specification mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Thus, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways. The term "connection" includes direct connection and indirect connection, unless otherwise specified. "First" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated.

[0069] In the embodiments of the present application, the words "exemplarily" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplarily" or "for example" is intended to present related concepts in a specific way.

[0070] In some scenarios, after the set-top box establishes a communication connection with the TV, it can obtain the display resolution of the TV and use the resolution as the resolution of subsequent set-top box output images to ensure that the subsequent TV can display the image normally after receiving the output image sent by the set-top box.

[0071] For example, Figure 1As shown, the set-top box and the television establish a communication connection via a high definition multimedia interface (HDMI). It should be understood that when the set-top box and the television are other devices, the two devices may also be connected via a display port (DP) or other high-speed video interfaces, or may also be connected via wireless communication technology, which is not limited in the present embodiment.

[0072] Some examples include Figure 1 As shown, after the set-top box establishes a connection with the TV, it can obtain the display resolution of the TV and determine the resolution as the output resolution. Then, after obtaining the original image, the set-top box determines whether the original image resolution is the same as the output resolution. If they are the same, the set-top box directly outputs the original image to the TV ( Figure 1 If they are not the same, the set-top box needs to process the original image through the processing module, convert the resolution of the original image into the output resolution, and then send the output image to the TV (such as Figure 1 shown).

[0073] Some examples include Figure 1 As shown, after the TV receives the image transmitted by the set-top box, it is necessary to perform image quality enhancement processing on the image to achieve a better display effect. Exemplarily, after receiving the image sent by the set-top box, the TV performs image quality enhancement processing on the image through a processing module. For example, the TV performs image quality enhancement processing on the image in terms of clarity, contrast, noise reduction intensity, color, etc. In some examples, the resolution of the image output by the set-top box received by the TV is equal to the resolution of the original image, and the resolution of the output image is the true resolution. If the resolution of the set-top box output image received by the TV is greater than the resolution of the original image, the resolution of the output image is the false resolution.

[0074] If the TV enhances the image quality of the output image based on the false resolution, the final image often has poor display effects, such as blurry visual effects due to poor clarity, or gray and dim images due to poor contrast.

[0075] For example, the resolution of an image refers to the number of pixels contained in a certain area of ​​the image, for example, the resolution of 1080P is 1920*1080 pixels, and the resolution of 4k is 3840*2160 pixels. It can be seen that the number of pixels contained in a certain area of ​​an image with a 4K resolution is greater than the number of pixels contained in the same area of ​​an image with a 1080P resolution.

[0076] In some examples, the set-top box does not need to enlarge or reduce the original image, such as Figure 1In the scenario shown, after the set-top box establishes a communication connection with the TV, the display resolution of the TV is 4K. The resolution of the original image obtained by the set-top box is also 4K. Then, the set-top box determines that the original image does not need to be processed, and the set-top box sends the original image to the TV, and the resolution of the image is the true resolution.

[0077] After the TV receives the true resolution image sent by the set-top box, it can enhance the image quality of the true resolution image to obtain a good image quality enhancement effect. However, if the image sent by the set-top box received by the TV is a false resolution image, the TV directly enhances the false resolution image, which cannot obtain a good enhancement effect.

[0078] In other examples, the display resolution of the TV is 4K. The set-top box obtains the original image and determines that the resolution of the original image is 1080P. Then, the set-top box determines that the original image needs to be processed to convert the resolution of the original image to 4K. In some examples, if the resolution of an image with an original resolution of 1080P is converted to 4K resolution, the set-top box needs to add pixels that do not exist in the original image itself, so the enlarged 4K resolution image is called a fake 4K image. Afterwards, the set-top box sends the fake 4K resolution image to the TV.

[0079] Accordingly, after receiving the output image sent by the set-top box, the TV performs image quality enhancement processing on the output image. In some examples, the TV processes the image using corresponding image quality processing parameters based on the resolution of the output image. For example, the TV determines that the resolution of the received image is 4K, and can use the image quality processing parameters corresponding to the 4K resolution image to process the image. However, since the current TV acquires a fake 4K image, the TV uses the image quality processing parameters corresponding to the true 4K resolution image to process the image, and there will be a mismatch between the TV's image quality processing parameters and the image that needs to be enhanced, which ultimately leads to poor image quality enhancement.

[0080] Therefore, the problem that the TV cannot effectively enhance the image quality of the fake resolution image and the display effect is poor is solved. The embodiment of the present application provides an image processing method, in which a first device (such as a set-top box) determines a corresponding processing method for the original image according to the image processing capability of a second device (such as a TV) and uses the processing method to process the original image. In this way, after receiving the image output by the first device, the second device can enhance the image quality according to its own image processing capability, the processing method of the first device, the original resolution and the output image resolution, thereby effectively improving the display effect.

[0081] Figure 2 A schematic diagram of a communication system to which the image processing method provided in the embodiment of the present application is applied. Figure 2As shown, the communication system includes a first device 110 and a second device 120 .

[0082] Optionally, the first device 110 may be a set-top box, a set-top box with a screen, a smart middle screen, a split TV (box end), a mobile phone, a smart speaker, or other device capable of outputting a video signal (the video signal includes an image frame, an audio frame, etc.). The present application does not limit the specific type of the electronic device 110.

[0083] Optionally, the second device 120 can be a terminal display device such as a TV, a split TV (TV end), a smart screen, a display, a tablet computer, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), an artificial intelligence (AI) device, a mobile phone, a wearable device, a vehicle-mounted terminal, etc.

[0084] In some embodiments, a wired communication connection or a wireless communication connection is established between the first device 110 and the second device 120. The manner of establishing the wired communication connection includes but is not limited to at least one of the following: HDMI connection, DP connection, universal serial bus (USB) interface connection or other video interface connection.

[0085] Optionally, the wireless communication technology for establishing the wireless communication connection includes but is not limited to at least one of the following: wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT) (for example, traditional Bluetooth or bluetooth low energy (BLE) Bluetooth), ultra wide band (UWB), near field communication (NFC), Zigbee, frequency modulation (FM), infrared (IR), etc.

[0086] Optionally, the first device 110 and the second device 120 may also establish a communication connection through a third-party device in the local area network, such as a router, a gateway, a smart device controller, a server, etc.

[0087] Optionally, the first device 110 and the second device 120 in the embodiment of the present application may be implemented by different devices, and the different devices may have the same, similar or somewhat different hardware structures, such as Figure 3 The hardware structure shown.

[0088] For example, the second device 120 has Figure 3 Take the hardware structure shown in the figure as an example. Figure 3 The hardware structure shown is described.

[0089] like Figure 3 As shown, the second device 120 may include a processor 1110, a memory 1121, a universal serial bus (USB) interface 1130, a power management module 1141, an antenna, a wireless communication module 1160, an audio module 1270, a sensor module 1280, a button 1190, an indicator 1192, a camera 1193, a display 1194, and a high-speed video interface 1195.

[0090] It is understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the second device 120. In other embodiments of the present application, the second device 120 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0091] The processor 1110 may include one or more processing units, for example, the processor 1110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0092] In some embodiments, the processor 1110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0093] The power management module 1141 supplies power to the processor 1110 , the memory 1121 , the display screen 1194 , the camera 1193 , and the wireless communication module 1160 . In some other embodiments, the power management module 1141 may also be disposed in the processor 1110 .

[0094] The wireless communication function of the second device 120 can be implemented through an antenna, a wireless communication module 1160, etc.

[0095] The antenna is used to transmit and receive electromagnetic wave signals. Each antenna in the second device 120 can be used to cover a single or multiple communication frequency bands.

[0096] The wireless communication module 1160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., applied on the second device 120. The wireless communication module 1160 can be one or more devices integrating at least one communication processing module. The wireless communication module 1160 receives electromagnetic waves via an antenna, modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 1110. The wireless communication module 1160 can also receive the signal to be sent from the processor 1110, modulate the frequency, amplify it, and convert it into electromagnetic waves for radiation through the antenna.

[0097] In some embodiments, the antenna of the second device 120 is coupled to the wireless communication module 1160 so that the second device 120 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS) and / or satellite-based augmentation systems (SBAS).

[0098] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the second device 120 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0099] The video codec is used to compress or decompress digital video. The second device 120 may support one or more video codecs. Thus, the second device 120 may play or record videos in multiple coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0100] The memory 1121 can be used to store computer executable program codes, and the executable program codes include instructions. The memory 1121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the second device 120 (such as audio data, a phone book, etc.), etc. In addition, the memory 1121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 1110 executes various functional applications and data processing of the second device 120 by running instructions stored in the memory 1121 and / or instructions stored in a memory provided in the processor.

[0101] The second device 120 can implement audio functions, such as music playback, through the audio module 1170 and the application processor.

[0102] The second device 120 implements the display function through a GPU, a display screen 1194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 1194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 1110 may include one or more GPUs that execute program instructions to generate or change display information.

[0103] The key 1190 includes a power key, etc. The key 1190 may be a mechanical key or a touch key. The second device 120 may receive key input and generate key signal input related to user settings and function control of the second device 120.

[0104] Indicator 1192 may be an indicator light and may be used to indicate messages, notifications, and the like.

[0105] Camera 1193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in standard RGB, YUV and other formats.

[0106] The display screen 1194 is used to display images, videos, etc. The display screen 1194 includes a display panel. The display panel can be manufactured using a liquid crystal display (LCD), such as an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Mini-LED, Micro-LED, Micro-oled, quantum dot light-emitting diodes (QLED), etc.

[0107] The high-speed video interface 1195 is used to output the video signal to an external device, or collect the video signal collected externally. In order to present a high-quality video with good clarity, different types of video interfaces can be used, such as HDMI, DP, or other high-speed video interfaces.

[0108] The following uses the first device 110 as a set-top box and the second device 120 as a television as an example to describe in detail the image processing method provided in the embodiment of the present application.

[0109] Figure 4 The following is a flow chart of an image processing method provided in an embodiment of the present application. It should be noted that the method is not based on Figure 4 The specific order below is for limitation, and it should be understood that in other embodiments, the order of some steps in the method can be interchanged according to actual needs, or some steps can be omitted or deleted. The method comprises the following steps:

[0110] S401: A set-top box and a television establish a communication connection.

[0111] In some embodiments, the set-top box establishes a communication connection with the television via a wired connection or a wireless connection.

[0112] Exemplarily, the set-top box and the television are connected via a wired communication via an HDMI interface.

[0113] S402: The set-top box obtains device information of the television.

[0114] In some embodiments, the device information of the TV includes the capabilities of the TV. For example, the device information of the TV includes information indicating whether the TV supports true and false resolution adaptation. Among them, supporting true and false resolution adaptation means that the TV can perform different image quality enhancement processing on the image according to the true or false resolution of the received image. For example, the TV supports true and false resolution adaptation. After acquiring the image, it can determine whether to restore the resolution of the image and / or generate different image quality processing parameters according to the true or false resolution of the image, and enhance the image quality. Not supporting true and false resolution adaptation means that the TV does not make corresponding adjustments to the image processing due to the true or false resolution of the image. That is, the TV cannot perform different image quality enhancement processing on the image according to the true or false resolution of the image. For example, when the TV does not support true and false resolution adaptation, after acquiring the image, the TV performs image quality enhancement processing on the image according to the image quality processing parameters corresponding to the current resolution of the image. Among them, the current resolution of the image is a true resolution or a false resolution.

[0115] In some examples, the device information of the TV includes the extended display identification data (EDID) of the TV. After obtaining the EDID of the TV, the set-top box parses the EDID and obtains the true and false resolution adaptation flag included therein, thereby determining whether the TV supports true and false resolution adaptation according to the true and false resolution adaptation flag.

[0116] For example, when the true and false resolution adaptation flag is 1, it indicates that the TV supports true and false resolution adaptation. When the true and false resolution adaptation flag is 0, it indicates that the TV does not support true and false resolution adaptation. For another example, when the true and false resolution adaptation flag is 0, it indicates that the TV supports true and false resolution adaptation. When the true and false resolution adaptation flag is 1, it indicates that the TV does not support true and false resolution adaptation.

[0117] In some examples, after parsing the EDID of the TV, the set-top box can also obtain other TV device information, such as the resolution of the TV, etc. Among them, the TV can support multiple resolutions, such as 1080P, 4K, etc. In response to user operations or default settings, the TV can use one of the resolutions, so the TV resolution included in the TV device information obtained by the set-top box can be the resolution currently being used by the TV.

[0118] In some embodiments, the embodiments of the present application do not limit the execution order of S401 and S402. The set-top box can first obtain some device information of the TV, such as the device name, device communication address, etc. The set-top box establishes a communication connection with the TV based on the partial device information. Afterwards, based on the communication connection, the set-top box obtains the EDID of the TV (i.e., first executes S402, then executes S401). Or while the set-top box and the TV establish a communication connection, the set-top box obtains the device information of the TV (i.e., executes S401 and S402 at the same time). Or, after the set-top box establishes a communication connection with the TV, it requests the TV to obtain the device information of the TV (i.e., first executes S401, then executes S402).

[0119] S403: The set-top box processes the original image according to the device information of the television.

[0120] In some embodiments, the set-top box downloads the original image from the server in response to the user operation. Alternatively, the set-top box downloads the original video from the server in response to the user operation and obtains a frame image in the original video, and the frame image is the original image. It should be understood that the set-top box can also obtain the original image in other ways. For example, the set-top box receives the original image (or original video) input by the user through other devices, such as the set-top box receives the original video input by the user through a USB flash drive.

[0121] In some embodiments, after the set-top box obtains the device information of the TV, it can process the original image according to the device information. In some examples, the set-top box can determine the resolution that the TV is using according to the device information of the TV. Because the resolution of the input image (i.e., the output image of the set-top box) obtained by the TV is equal to the resolution that the TV is using, the TV can display the picture normally. Therefore, the resolution that the TV is using is the target resolution of the output image of the set-top box. And the set-top box can obtain the resolution of the original image. Therefore, the set-top box determines whether it is necessary to process the original image by judging whether the resolution of the original image is the same as the target resolution of the output image. It should be understood that the set-top box processes or does not process the original image to indicate whether to change or not change the resolution of the original image. In actual application scenarios, the set-top box can also perform other processing on the original image. For specific processing content and processing method, the embodiment of the present application will not be repeated.

[0122] In some examples, the set-top box determines that the resolution of the original image is the same as the target resolution of the output image and determines that the original image does not need to be processed.

[0123] In other examples, the set-top box determines that the resolution of the original image is different from the target resolution of the output image, and determines that the original image needs to be processed.

[0124] In some embodiments, the set-top box determines the scaling algorithm used to process the original image according to whether the television supports true and false resolution adaptation.

[0125] In some examples, the set-top box processes the original image through a scaling algorithm.

[0126] Optionally, the scaling algorithm includes a scaling algorithm that does not change the pixel values ​​of the original image and a scaling algorithm that changes the pixel values ​​of the original image.

[0127] Among them, the scaling algorithm that does not change the pixel value of the original image includes, for example, increasing or decreasing the resolution of the image by copying, dropping pixels, etc., so as to achieve image enlargement and reduction. If the image enlarged by such an algorithm needs to be restored later, the pixel points added by copying can be discarded to achieve image restoration. Algorithms that do not change the original pixel value are also called low-end algorithms.

[0128] Scaling algorithms that change the pixel values ​​of the original image include, for example, bilinear interpolation algorithms and polyphase filtering algorithms. Images enlarged by such algorithms cannot be restored by discarding pixels. Algorithms that change the original pixel values ​​are more complex than algorithms that do not change the original pixel values, and the output images using such algorithms are also smoother. Algorithms that change the original pixel values ​​are also called high-end algorithms.

[0129] In order to better understand the principle of the scaling algorithm that does not change the pixel values ​​of the original image, the process of processing the image using the scaling algorithm that does not change the pixel values ​​of the original image is introduced as follows.

[0130] For example, Figure 5A As shown in (a), the resolution of the original image is 2*2. The set-top box determines that the target resolution is 4*4 based on the device information of the TV obtained. Then, after obtaining the original image, the set-top box determines that the original image needs to be enlarged from 2*2 to 4*4. In some examples, the set-top box processes the original image using a scaling algorithm that does not change the pixel value of the original image, and copies each pixel of the original image in at least one of the horizontal, vertical, and diagonal directions to increase the resolution of the image. Figure 5A As shown in (b), by replicating the pixels, the resolution of the output image is Figure 5A 4*4 as shown in (b).

[0131] Or, if Figure 5AAs shown in (b), the original image resolution is 4*4. The set-top box determines the target resolution is 2*2 based on the acquired TV device information. Then, after acquiring the original image, the set-top box determines that the original image needs to be reduced from 4*4 to 2*2. In some examples, the set-top box processes the original image using a scaling algorithm that does not change the pixel value of the original image, and drops each pixel of the original image in at least one of the horizontal, vertical, and diagonal directions to reduce the resolution of the image. Figure 5A As shown in (b), by discarding the pixels, the resolution of the output image is Figure 5A 2*2 shown in (a).

[0132] For example, if the set-top box needs to process the image, Figure 6 As shown, S403 may include the following steps S4031-S4033.

[0133] S4031. The set-top box determines whether the TV supports true and false resolution adaptation based on the device information of the TV. If so, execute S4032; if not, execute S4033.

[0134] S4032: If the judgment result is not supported, the set-top box processes the original image using an algorithm that changes the original pixel value.

[0135] S4033. If the judgment result is support, the set-top box uses an algorithm that changes the original pixel value or an algorithm that does not change the original pixel value to process the original image. In some embodiments, the set-top box can process the original image by an algorithm that changes the original pixel value, or it can also process the original image by an algorithm that does not change the original pixel value, wherein the algorithm that changes the original pixel value can make the output image smoother than the algorithm that does not change the original pixel value. In addition, when the TV has the ability to adapt to true and false resolutions, the TV can distinguish the true and false situation of the resolution of the acquired image, so as to process the image using corresponding image quality processing parameters. When the TV does not have the ability to adapt to true and false resolutions, the TV will not distinguish the true and false situation of the resolution of the acquired image, but directly uses corresponding image quality processing parameters to process the image according to the resolution of the image.

[0136] In some examples, as shown in S4032, when the set-top box determines that the TV does not have the ability to adapt the true and false resolutions, the set-top box may only focus on the display effect of the output image. Then, the set-top box may use an algorithm that changes the original pixel value to process the original image and convert the resolution of the original image into the resolution used by the TV. In this way, the set-top box can output a smoother image.

[0137] Alternatively, when the set-top box determines that the TV has the ability to adapt the true and false resolutions, it can also use an algorithm that does not change the original pixel values ​​to process the original image and convert the resolution of the original image into the resolution used by the TV. In some examples, such as Figure 5A and Figure 5B According to the example of the algorithm principle that does not change the original pixel value, the set-top box can enlarge or reduce the resolution of the image by simply copying or dropping pixels. Correspondingly, after the TV receives an image processed by an algorithm that does not change the original pixel value, if the TV has the ability to adapt to true and false resolutions, it can determine whether the resolution of the current image is a true resolution or a false resolution. In the case of a false resolution, the image can also be simply restored by changing the pixels. For example, the false resolution of the image obtained by the TV is Figure 5A The 4*4 shown in (b) can be restored to the following resolution by dropping pixels. Figure 5A The 2*2 resolution image shown in (a).

[0138] For example, in order to more vividly illustrate the principle that the set-top box and the TV use an algorithm that does not change the original pixel value to enlarge and restore the image. Figure 5B In the scenario of a set-top box and a TV transmitting images, the set-top box uses an algorithm that does not change the original pixel value to enlarge the image, and the TV restores the received enlarged image to the resolution of the original image. The set-top box determines that the target resolution is 4*4 based on the device information of the TV, and the TV supports true and false resolution adaptation. The resolution of the original image is 2*2, and the target resolution is greater than the resolution of the original image. The set-top box uses an algorithm that does not change the original pixel value, such as copying pixels, to enlarge the original image's 2*2 resolution to the target resolution of 4*4, and sends the enlarged image to the TV. After receiving the image with the target resolution of 4*4, the TV can restore the resolution of the target resolution of 4*4 to the resolution of the original image of 2*2 by discarding pixels.

[0139] In this way, the TV can subsequently enhance the image quality of the 2*2 resolution image restored to the original image, avoiding the situation where the image quality enhancement effect of the enlarged false resolution image is poor.

[0140] Optionally, if the TV supports true and false resolution adaptation, the set-top box can determine whether to use an algorithm that changes the original pixel value based on whether the original resolution and the output resolution are integer multiples. If the original resolution and the output resolution are integer multiples, the resolution of the image can be changed by copying an algorithm that does not change the original pixel value. If the original resolution and the output resolution are not integer multiples, the resolution of the image cannot be changed by copying an algorithm that does not change the original pixel value. Therefore, if the original resolution and the output resolution are integer multiples, you can consider using an algorithm that does not change the original pixel value to process the image to reduce the amount of calculation. If the original resolution and the output resolution are not integer multiples, it is not convenient to use an algorithm that does not change the original pixel value to change the resolution of the image. You can consider using an algorithm that changes the original pixel value to process the image.

[0141] In this way, the set-top box can adaptively choose whether to scale the original image and the type of scaling algorithm according to the resolution used by the TV and whether the TV has the ability to adapt to the true and false resolutions. While meeting the image output requirements, it improves the display effect of the output image and better meets the TV's subsequent image processing needs.

[0142] In some embodiments, step S403 may also be that the set-top box determines whether the image needs to be reduced according to the output resolution and the original resolution of the image. The set-top box determines the type of scaling algorithm and processes the original image according to whether the image needs to be reduced and the device information sent by the television. Optionally, step S403 may also include the following steps:

[0143] S501: The set-top box determines whether to reduce the image according to the output resolution and the original resolution of the image.

[0144] In some examples, the set-top box determines whether to downscale the image based on the output resolution and the original resolution of the image. If the output resolution is less than the original resolution, the image needs to be downscaled. If the output resolution is equal to the original resolution, the image is not processed. If the output resolution is greater than the original resolution, the image is not downscaled but upscaled.

[0145] S502: The set-top box determines the type of scaling algorithm based on whether the image needs to be scaled down, and processes the original image.

[0146] In some examples, if the set-top box needs to reduce the image, because there is no false resolution in the reduced output image, the reduced image will not have the problem of poor TV image quality enhancement due to the false resolution. Therefore, if the set-top box needs to reduce the image, it is determined that the type of scaling algorithm used by the set-top box is a scaling algorithm that changes the original pixel value so that the reduced image is smoother. Optionally, in the above case, the set-top box can also use a scaling algorithm that does not change the original pixel value to make the image processing and transmission process of the set-top box and the TV less computationally demanding, and the embodiments of the present application are not limited to this.

[0147] In some examples, if the set-top box does not need to reduce the image but enlarge it, the set-top box determines whether the TV supports true and false resolution adaptation according to the device information of the TV, determines the type of scaling algorithm, and processes the original image. The method shown in steps S4031-S4033 is executed.

[0148] In this way, the set-top box directly uses an algorithm that changes the original pixel value to process the original image in a zoomed-out scenario, and determines the type of zoom algorithm to use for the original image based on the TV's true and false resolution adaptation capabilities in an enlarged scenario, saving system computing resources.

[0149] In some scenarios, such as S403 above, the set-top box processes the acquired original image in a variety of ways to output an image, and the resolution of the output image is the same as the resolution used by the television. Figure 4 As shown, the process of the television acquiring and displaying an image is introduced as follows through S404 and S405.

[0150] S404: The set-top box outputs the image and image information to the television.

[0151] The output image is an image obtained after the set-top box processes the original image according to the resolution of the original image and the resolution used by the television. Alternatively, the output image is an image obtained after the set-top box determines that the original image does not need to be processed.

[0152] In some embodiments, after acquiring the output image, the set-top box sends the output image and image information of the output image to the television. The set-top box sends the image to the television at a certain frame rate, so the output image can also be called frame data. The image information can also be called an information frame packet.

[0153] Optionally, the image information includes information for instructing the television to process and output the image according to the image information. For example, the image information includes the original resolution of the original image and the type of scaling algorithm used by the set-top box in processing the image.

[0154] S405: The television performs image quality enhancement processing on the output image according to the image information and then displays the image.

[0155] In some embodiments, the television receives the output image sent by the set-top box and performs image quality enhancement processing on the output image according to the image quality processing parameters. Afterwards, the television can display the output image after the image quality enhancement processing.

[0156] In this way, the set-top box determines the processing operation for the original image according to the image processing capability of the TV indicated in the device information of the TV. The TV performs image quality enhancement processing on the image sent by the set-top box according to the image information sent by the set-top box, and obtains and displays the image after image quality enhancement processing. This can avoid the situation where the TV has a poor image quality enhancement effect on the false resolution image.

[0157] The following Figure 7 This paper introduces the method of enhancing the image quality of the output image of the television. Figure 7 A flowchart of a method for enhancing the image quality of an output image provided by a television in an embodiment of the present application. Figure 7 As shown, the method includes the following steps.

[0158] S4051. The television determines the original image resolution according to the image information sent by the set-top box.

[0159] In some embodiments, the image information sent by the set-top box includes the original resolution of the image and the processing operation performed by the set-top box on the image. The television analyzes the image information sent by the set-top box to obtain the original resolution of the image.

[0160] S4052: The television determines the relationship between the original resolution and the output resolution of the image.

[0161] The output resolution is used to indicate the resolution of the output image, which is equal to the resolution being used by the TV.

[0162] In some embodiments, the TV can determine whether the set-top box processes the image and the processing method based on the size relationship between the original resolution and the output resolution of the image. For example, if the original resolution is less than the output resolution, the TV can determine that the set-top box has enlarged the image, and the image received by the TV is a false resolution image. If the original resolution is equal to the output resolution, the TV can determine that the set-top box has not processed the image, and the output image is a true resolution image. If the original resolution is greater than the output resolution, the TV can determine that the set-top box has reduced the image, and the image received by the TV is a true resolution image.

[0163] S4053: If the judgment result is that the original resolution is greater than or equal to the output resolution, the television enhances the image quality of the output image according to the output resolution.

[0164] In some embodiments, the TV determines that the original resolution is greater than or equal to the output resolution, and can determine that the resolution of the current output image is the true resolution, so the TV enhances the image received by the TV according to the resolution currently being used by the TV. In addition, in this case, the problem of poor image quality enhancement due to the false resolution of the image will not occur.

[0165] S4054: If the original resolution is smaller than the output resolution, the television obtains the type of scaling algorithm used by the set-top box for the image based on the image information sent by the set-top box.

[0166] In some embodiments, if the original resolution is smaller than the output resolution, it means that the set-top box has enlarged the original image, and the set-top box output image received by the TV is a false resolution image. If the image quality is enhanced directly according to the output resolution, the image quality enhancement effect will be poor.

[0167] Therefore, in the embodiment of the present application, the set-top box determines whether the resolution of the image can be restored to the original resolution according to the type of scaling algorithm used when the image is enlarged by the set-top box. If the set-top box uses an algorithm that does not change the original pixel value when enlarging the image, the television can restore the image. If the set-top box uses an algorithm that changes the original pixel value when enlarging the image, the television cannot restore the image.

[0168] S4055. The television restores the resolution of the image sent by the set-top box, and after obtaining the image with the original resolution, enhances the image quality of the image with the original resolution obtained after the resolution restoration according to the original resolution.

[0169] In some examples, if the set-top box uses a scaling algorithm that does not change the original pixel value, the TV can restore the image to the original resolution, and then enhance the image quality sent by the set-top box according to the original resolution.

[0170] For example, Figure 5A As shown in (b), the false resolution of the image obtained by the TV is 4*4. The TV can restore the 4*4 resolution image to the following by dropping pixels: Figure 5A The 2*2 resolution image shown in (a) in the figure. Afterwards, the TV can perform image quality enhancement processing based on the 2*2 resolution image.

[0171] In this way, after the TV restores the received image to an image with the original resolution, the resolution of the image is true, so the TV enhances the image quality of the true resolution image without the problem of poor image quality enhancement effect.

[0172] S4056: The television enhances the image quality of the image sent by the set-top box according to the original resolution, the output resolution, and the type of scaling algorithm.

[0173] In other examples, if the set-top box uses a scaling algorithm that changes the original pixel values, the TV cannot directly restore the resolution of the current image back to the original resolution. Therefore, the TV enhances the image quality of the output image sent by the set-top box according to the original resolution, output resolution and scaling algorithm type corresponding to the output image.

[0174] In the embodiment of the present application, when enhancing the image quality, in the case where the image quality processing parameters that match the output resolution are directly used and the image quality enhancement effect is poor, the image quality processing parameters are determined based on the output resolution in combination with the original resolution and the type of scaling algorithm, and the image quality is enhanced using the image quality processing parameters, which can avoid the problem of poor image quality enhancement effect.

[0175] Through steps S4051-S4056 of the embodiment of the present application, the TV first determines whether the resolution of the output image is true according to whether the set-top box processes the image by reducing or enlarging the image. For an image with a true resolution, the TV directly processes the image according to the default image quality enhancement parameters corresponding to the current resolution of the image.

[0176] Secondly, for false resolution images, the TV determines the image quality enhancement processing method according to whether the scaling algorithm type used by the set-top box is an algorithm that does not change the original pixel value. The TV determines whether the resolution of the received image can be restored according to whether the scaling algorithm type used by the set-top box is an algorithm that does not change the original pixel value. If the scaling algorithm type used by the set-top box is an algorithm that does not change the original pixel value, the TV can restore the resolution of the received image to the original resolution. If the scaling algorithm type used by the set-top box is an algorithm that changes the original pixel value, the TV cannot restore the resolution of the received image to the original resolution.

[0177] If the resolution of the image can be restored by the TV, the TV uses the original resolution of the image to enhance the image quality after restoration, which can avoid the problem of mismatch between the image and the image quality processing parameters due to the false image resolution, and thus the poor image quality enhancement effect. If the resolution of the image cannot be restored by the TV, for the false resolution image, the TV enhances the image quality sent by the set-top box according to the original resolution, output resolution and scaling algorithm type. This can avoid the problem of poor image quality enhancement effect.

[0178] In some scenarios, the TV may first determine whether the set-top box has scaled the image based on the original resolution in the image information sent by the set-top box. Second, determine whether the set-top box uses a scaling algorithm that changes the original pixel value. Third, determine whether the image has been scaled down by the set-top box. For example, Figure 8 As shown, Figure 8A flowchart of another method for enhancing the image quality of a received image by a television provided in an embodiment of the present application. The method for enhancing the image quality of a received image by a television provided in an embodiment of the present application may include the following steps.

[0179] S801. The television determines whether the original resolution 1 of the image is the same as the output image resolution 2 according to the output image and the image information. If so, execute step S806; if not, execute step S802.

[0180] In some embodiments, the image information includes the original resolution corresponding to the output image. Then, after receiving the image information, the TV can obtain the original resolution 1 included therein. And the TV can obtain the resolution 2 of the output image, which is the resolution used by the TV. Afterwards, the TV can determine whether the original resolution 1 is the same as the resolution 2. Based on whether the resolutions are the same, the TV determines whether to directly enhance the image quality according to the current resolution (i.e., resolution 2). Or further enhance the image quality according to the image information sent by the set-top box and the current resolution of the image.

[0181] S802: The TV determines, based on the image information, whether the scaling algorithm used by the set-top box is an algorithm that changes the original pixel value. If so, execute step S803; if not, execute step S804.

[0182] In some embodiments, the image information transmitted by the set-top box to the television includes the type of scaling algorithm. Therefore, the television can determine whether the scaling algorithm used by the set-top box is an algorithm that changes the original pixel value based on the type of scaling algorithm in the image information.

[0183] In some embodiments, if the TV determines that the original resolution 1 of the image is different from the processed resolution 2, it means that the set-top box has scaled the image, and the image received by the TV may be a false resolution image. If the TV directly enhances the image quality of the received image, it may produce a poor effect. Therefore, it is necessary to determine whether the set-top box uses an algorithm that changes the original pixel value, and then determine whether the TV can restore the received image to an image with a real resolution for image quality enhancement.

[0184] In some examples, if the set-top box uses a scaling algorithm that does not change the original pixel value, the TV can restore the received image to the original image and then perform image quality enhancement. That is, execute the following step S804. If the set-top box uses a scaling algorithm that changes the original pixel value, the TV cannot restore the current image to the original image and needs to perform other image quality enhancement methods. That is, execute the following step S803.

[0185] The TV can determine whether it can restore the resolution of the received image to the original resolution based on the type of scaling algorithm used by the set-top box. For example, the set-top box enlarges the image by a copying algorithm that does not change the original pixel value, which is to enlarge the image by copying the pixels. When the image quality is subsequently enhanced, the TV discards the extra pixels, and the problem of false resolution of the image is solved. The TV then enhances the image quality of the restored true resolution image according to its original resolution, which can avoid the problem of poor image quality enhancement. If the scaling algorithm used by the set-top box is an algorithm that changes the original pixel value, the TV cannot restore the received image by discarding pixels. Therefore, the TV further determines whether the scaling algorithm used by the set-top box is an algorithm that changes the original pixel value, in order to determine the subsequent method of enhancing the image quality, which can avoid the problem of poor image quality enhancement.

[0186] S803: The television obtains image quality processing parameters according to the original image resolution, the type of scaling algorithm, and the resolution of the output image in the image information.

[0187] In some embodiments, if the TV determines that the type of scaling algorithm used by the set-top box is an algorithm that changes the original pixel value, then the output resolution of the image received by the TV may be a false resolution. If the TV enhances the image quality based on the output resolution, the problem of poor image quality enhancement effect described in the embodiments of the present application will occur. Therefore, the TV determines the image quality processing parameters for the image based on the original resolution of the image, the type of scaling algorithm, and the resolution of the output image, and subsequently enhances the image quality based on the image quality processing parameters, which can avoid the problem of poor image quality enhancement effect.

[0188] Exemplarily, if the judgment result is that the set-top box uses an algorithm to change the original pixel value, and enlarges the image with an original resolution of 1080P, the resolution of the output image is 4K. At this time, the output image is a fake 4K image. If the TV enhances the image quality of the fake 4K image processed by the set-top box based on the image quality processing parameters for processing true 4K images, the image quality enhancement effect will be poor due to the mismatch between the image quality processing parameters and the actual image quality. In the embodiment of the present application, the TV determines the image quality processing parameters that match the actual situation of the output image based on the original resolution of the image 1080P, the specific type of scaling algorithm used, and the resolution of the output image 4K, and can effectively enhance the image quality of the output image.

[0189] Optionally, the ratio between the original resolution and the output resolution of the image can affect the determination of the image quality processing parameters. The type of scaling algorithm can affect the determination of the image quality processing parameters. The TV matches different image quality processing parameters to two images with the same original resolution and processed resolution but different scaling algorithms, such as two images that are enlarged using a bilinear difference algorithm or a multi-phase filtering algorithm. This enables the TV to match different image quality processing parameters to images processed by different algorithms, thus avoiding the problem of poor image quality enhancement.

[0190] Optionally, the application does not limit the ability of the three parameters, namely, original resolution, scaling algorithm type, and output resolution, to influence the determination of image quality processing parameters, or the method for calculating the image quality processing parameters. The ability of the above three parameters to influence the determination of image quality processing parameters, or the method for calculating the image quality processing parameters, can be set before the TV leaves the factory, or can be set manually after leaving the factory, and can be fixed or adjustable, and the application does not limit this.

[0191] S804: The TV determines whether the set-top box has reduced the image. If so, execute step S806; if not, execute step S805.

[0192] In some embodiments, if the TV determines that the type of scaling algorithm used by the set-top box is not an algorithm that changes the original pixel value, it means that the type of scaling algorithm used by the set-top box is an algorithm that does not change the original pixel value. For the algorithm that does not change the original pixel value, the TV can restore the output image. Therefore, the TV further determines whether the set-top box has reduced the image and determines whether the output image needs to be restored.

[0193] Optionally, based on the enlargement or reduction processing of the original image by the set-top box, the television uses different methods to enhance the image quality of the received output image. If the original image is reduced, then the output image has no redundant pixels, that is, the resolution of the output image is the true resolution, and no restoration processing is required. That is, the following step S806 is executed. If the original image is not reduced, but enlarged, that is, the resolution of the output image is the false resolution, and restoration processing is required. That is, the following step 805 is executed.

[0194] S805: The television discards redundant pixels in the image, so that the resolution 2 of the output image is reduced back to the original resolution 1 of the image.

[0195] In some embodiments, the TV determines that the original resolution 1 is less than the resolution 2 of the output image, so the TV can determine that the set-top box has enlarged the original image. In addition, based on the image information, the TV determines that the set-top box processes the original image using an algorithm that does not change the original pixel value. Therefore, the resolution of the output image can be restored.

[0196] Optionally, the TV supports true and false resolution adaptation, can identify false resolution, and restore the false resolution to match the appropriate image quality processing parameters. In some examples, the algorithm used by the set-top box that does not change the original pixel value is to increase the resolution of the original image by copying pixels, so the TV can restore the resolution of the output image by discarding redundant pixels in the output image.

[0197] S806: The television obtains image quality processing parameters according to the current resolution of the image.

[0198] In some embodiments, the TV can obtain the current resolution corresponding to the output image through the above S801, or S804, or S805, and can obtain the corresponding image quality processing parameters based on the current resolution.

[0199] In some examples, based on S801, when the TV determines that the original resolution 1 corresponding to the output image is the same as the resolution 2 of the output image, it can determine that the current resolution corresponding to the output image is the original resolution (or the resolution 2 of the output image), and the set-top box does not perform scaling processing on the image. Therefore, the TV can match the corresponding image quality processing parameters according to resolution 1 or resolution 2.

[0200] In some examples, based on S804, if the judgment result is that the set-top box has reduced the image, then the current resolution of the image is not a false resolution. At this time, the current resolution of the image is equal to the output resolution of the set-top box to the TV and the resolution currently used by the TV. Therefore, the TV can directly enhance the image quality according to the current resolution of the image. Therefore, the TV determines the image quality processing parameters according to the current resolution of the image.

[0201] For example, a 4K image received by the TV from the set-top box is obtained by downscaling the original 8K image using an algorithm that does not change the pixel value. Then the TV directly determines the image quality processing parameters according to the current 4K resolution of the 4K image.

[0202] In some examples, based on S805 , after restoring the resolution of the output image to the original resolution 1 , the TV obtains the image quality processing parameter based on the restored original resolution 1 .

[0203] S807: The television enhances the image quality of the output image according to the image quality processing parameter.

[0204] In some embodiments, after acquiring the image quality processing parameters, the TV may enhance the image quality of the output image according to the image quality processing parameters. For example, the TV performs image quality enhancement processing on the image in terms of clarity, contrast, noise reduction intensity, color, etc.

[0205] In this way, the TV determines whether the output image is an image after scaling processing by the set-top box based on the image information, and thus adaptively determines the corresponding image quality processing parameters for the image after scaling processing according to the type of scaling processing algorithm. Compared with the prior art, which can only use the image quality processing parameters corresponding to the resolution used by the TV to increase the image quality of the output image, resulting in poor image quality enhancement effect. The embodiment of the present application realizes a more flexible image quality enhancement processing process by adaptively adjusting the image quality processing parameters, thereby obtaining a better image quality enhancement effect.

[0206] Fig. 9 The following is a schematic diagram of an interactive process of an image processing method provided in an embodiment of the present application. Fig. 9 The specific order below is for limitation, and it should be understood that in other embodiments, the order of some steps in the method can be interchanged according to actual needs, or some steps can be omitted or deleted. The method comprises the following steps:

[0207] S901. A second device sends first information to a first device, where the first information is used to indicate an image processing capability of the second device.

[0208] In some embodiments, a first device and a second device establish a communication connection. During the process of establishing the communication connection, device information may be exchanged between the first device and the second device, and the device information may include information indicating device capabilities. For example, the second device sends first information to the first device to inform the first device of the current device capabilities of the second device, such as image processing capabilities.

[0209] In this way, because the first information indicates the image processing capability of the second device, the second device sends the first information to the first device so that the first device can combine the image processing capability of the second device when processing the image to obtain an image that matches the image processing capability of the second device.

[0210] In some embodiments, the image processing capability includes whether the second device supports true and false resolution adaptation. Supporting true and false resolution adaptation means that the second device can perform different image quality enhancement processing on the image according to whether the resolution of the received image is true or false.

[0211] In this way, because the image processing capability includes whether the second device supports true and false resolution adaptation, the first information sent by the second device to the first device is used to indicate the image processing capability of the second device, and thus the first information indicates the true and false resolution adaptation capability of the second device. The second device sends the first information to the first device, so that the first device can process the image according to the true and false resolution adaptation capability of the second device, and obtain and send to the second device an image that matches the true and false resolution adaptation capability of the second device.

[0212] S902: The first device processes the input first image by using a first image processing algorithm according to the first information and when the image processing capability of the second device meets the first condition, to obtain a second image.

[0213] Among them, the first condition includes supporting true and false resolution adaptation. The first image processing algorithm is an algorithm that changes the first pixel value of the first image, or an algorithm that does not change the first pixel value. The first image is the original image acquired by the first device. The input first image can be a network input, or a storage medium input such as a user USB, or an image stored locally on the first device, and the embodiment of the present application does not limit this.

[0214] Exemplarily, when the first device determines, based on the first information, that the second device supports true and false resolution adaptation, the first device processes the input first image by using an algorithm that changes a first pixel value of the first image, or an algorithm that does not change the first pixel value.

[0215] In some embodiments, the first device processes the first image to obtain the second image using a second image processing algorithm based on the first information when the image processing capability of the second device does not meet the first condition. The second image processing algorithm is an algorithm for changing the first pixel value.

[0216] Exemplarily, when the first device determines, based on the first information, that the second device does not support true and false resolution adaptation, the first device processes the input first image by using an algorithm that changes a first pixel value of the first image.

[0217] In this way, the first device adapts different image processing algorithms to process the image according to the image processing capability of the second device, so that the processed second image sent to the second device is more adapted to the image processing capability of the second device.

[0218] Among them, because the second image without changing the first pixel value can be restored to the first image by the second device. The second device can process the second image without changing the first pixel value by restoring the second image to the first image. And when the image processing capability of the second device meets the first condition, the second device can also process the second image with the first pixel value changed well. Therefore, the first device uses an algorithm that changes the first pixel value of the first image, or an algorithm that does not change the first pixel value to process the image. Sending the second image with the first pixel value changed or not changed to the second device allows the second device to process the received second image well.

[0219] Furthermore, because the second image with the first pixel value changed has a smoother display effect when displayed than the second image with the first pixel value not changed, when the image processing capability of the second device does not meet the first condition, the first device uses the algorithm for changing the first pixel value to process the image, so that the image sent to the second device has a smoother display effect.

[0220] Therefore, the first device processes the image using an algorithm that changes the first pixel value or an algorithm that does not change the first pixel value based on the second device's ability to support true and false resolution adaptation, and can obtain and send to the second device a second image that matches the true and false resolution adaptation capability of the second device, so that the second device can effectively process the second image.

[0221] S903: The first device sends second information to the second device, where the second information carries a second image and image processing information corresponding to the second image.

[0222] In some embodiments, the first device processes the input first image based on the image processing capability of the second device, and after acquiring the second image, the first device may send the second image to the second device. Optionally, in order to enable the second device to know the processing content of the first image by the first device, the first device may also send image processing information corresponding to the second image to the second device.

[0223] Correspondingly, the second device receives the second image and the image processing information corresponding to the second image sent by the first device.

[0224] S904: The second device performs image quality enhancement processing on the second image according to the image processing information to obtain a third image.

[0225] The image processing information includes the first resolution of the first image and algorithm information of the image processing algorithm used to process the first image. The algorithm information includes, for example, an algorithm for changing the first pixel value of the first image, or an algorithm for not changing the first pixel value. The first image is an original image acquired by the first device, the first resolution is the resolution of the original image, and the first pixel value is the pixel value of the original image.

[0226] The second image is an image sent by the first device to the second device. The third image is an image obtained by the second device performing image quality enhancement processing on the second image.

[0227] Exemplarily, the first device acquires image 1 (such as the first image), wherein image 1 is the original image acquired by the first device, the resolution of image 1 is resolution 1 (such as the first resolution), and the pixel value of image 1 is pixel value 1 (such as the first pixel value). The first device determines that the target resolution required by the second device is resolution 2 (such as the second resolution), and the first device sends image 2 (such as the second image) to the second device, the resolution of image 2 is resolution 2, and the pixel value of image 2 is pixel value 2 (such as the second pixel value). The second device performs image quality enhancement processing on image 2 to acquire image 3 (such as the third image).

[0228] In some embodiments, when the first resolution is greater than or equal to the second resolution of the second image, the second image is enhanced according to the second resolution to obtain a third image. The second resolution is the resolution of the second image sent by the first device to the second device.

[0229] Exemplarily, if the second device determines that the first resolution is greater than or equal to the second resolution, then the resolution of the second image is the true resolution. Therefore, the second device enhances the image quality of the second image according to the resolution currently being used by the second device, and the problem of poor image quality enhancement due to the false resolution of the image does not occur.

[0230] In some embodiments, when the first resolution is smaller than the second resolution, the second device performs image quality enhancement processing on the second image according to the algorithm information to obtain a third image.

[0231] Exemplarily, when the algorithm information indicates that the image processing algorithm is an algorithm that does not change the first pixel value, the second device can restore the second image to the first resolution and perform image quality enhancement processing on the second image restored to the first resolution according to the first resolution.

[0232] In this way, after the second device restores the received second image to an image of the first resolution, the resolution of the second image is true, so the second device enhances the image quality of the second image restored to the true resolution, and the problem of poor image quality enhancement effect will not occur.

[0233] Exemplarily, when the algorithm information indicates that the image processing algorithm is an algorithm for changing the first pixel value, the second device cannot restore the image. The second device performs image quality enhancement processing on the second image according to the first resolution, the second resolution, and the algorithm type of the image processing algorithm to obtain a third image.

[0234] In this way, when the algorithm information indicates that the image processing algorithm is an algorithm for changing the first pixel value, the resolution of the second image is false. The second device performs image quality enhancement processing on the second image according to the algorithm information, thereby avoiding the problem of poor image quality enhancement effect on the second image with false resolution.

[0235] In this way, for the second image with a false resolution, the second device uses different methods to enhance the image quality of the second image according to whether the image processing algorithm used by the first device is an algorithm that does not change the original pixel value, thereby avoiding the problem of poor effect caused by directly enhancing the image quality according to the second resolution.

[0236] In some embodiments, the second device may learn whether the resolution pixel value of the second image has changed compared to the pixel value resolution of the first image based on the first resolution of the first image in the image processing information. The second device may perform image quality enhancement processing on the second image based on the change in the pixel value resolution of the second image compared to the pixel value resolution of the first image.

[0237] In some embodiments, when the first resolution is equal to the second resolution of the second image, the second device performs image quality enhancement processing on the second image according to the second resolution to obtain a third image. When the first resolution is not equal to the second resolution of the second image, the second device performs image quality enhancement processing on the second image according to the algorithm information to obtain a third image.

[0238] When the second resolution of the second image does not change compared to the first resolution of the first image, the resolution of the second image is the true resolution. Therefore, the second device directly enhances the image quality of the second image according to the resolution of the second image, and the image quality enhancement effect will not be poor, and the image quality enhancement effect can be guaranteed. When the second resolution of the second image changes compared to the first resolution of the first image, the second resolution of the second image may be a false resolution or a true resolution. Therefore, the second device performs image quality enhancement processing on the second image according to the algorithm information, and the image quality enhancement effect can also be guaranteed when the resolution of the second image is false.

[0239] In some embodiments, when the algorithm information indicates that the image processing algorithm is an algorithm that changes the first pixel value, the second device performs image quality enhancement processing on the second image according to the first resolution, the second resolution, and the algorithm type of the image processing algorithm to obtain a third image. When the algorithm information indicates that the image processing algorithm is an algorithm that does not change the first pixel value, the image quality enhancement processing is performed on the second image according to the size of the first resolution and the second resolution to obtain a third image.

[0240] In this way, if the algorithm information indicates that the image processing algorithm is an algorithm that changes the first pixel value, the second pixel value of the second image changes compared to the first pixel value of the first image. The second pixel value is the pixel value of the second image sent by the first device to the second device. Therefore, the second device performs image quality enhancement processing on the second image according to the first resolution, the second resolution, and the algorithm type of the image processing algorithm, and the image quality enhancement effect can be guaranteed. If the algorithm information indicates that the image processing algorithm is an algorithm that does not change the first pixel value, the second pixel value of the second image does not change compared to the first pixel value of the first image. According to the size of the first resolution and the second resolution, the second device can know whether the first device has enlarged or reduced the first image, and then use different methods to enhance the image quality of the second image, and there will be no poor image quality enhancement effect.

[0241] In some embodiments, when the first resolution is greater than the second resolution, the second device performs image quality enhancement processing on the second image according to the second resolution to obtain a third image. When the first resolution is greater than the second resolution, it means that the first device has reduced the first image, so there are no extra pixels in the second image, and the second resolution of the second image is not a false resolution. At this time, the current second resolution of the second image is equal to the resolution currently used by the second device, so the second device can directly enhance the image quality according to the second resolution of the second image, and there is no need to restore the second image.

[0242] For example, a 4K second image received by the second device from the first device is obtained by the first device downscaling the first image with a first resolution of 8K using an algorithm that does not change the pixel value. The second device currently uses a 4K resolution, so the second device directly performs image quality enhancement processing on the second image according to the current 4K resolution of the second image with 4K resolution, and the image quality enhancement effect will not be poor.

[0243] In some embodiments, when the second resolution is greater than the first resolution, the second device restores the second resolution of the second image to the first resolution, and then performs image quality enhancement processing on the second image to obtain a third image.

[0244] In some embodiments, if the first device does not reduce the size of the first image but instead enlarges the first image, the resolution of the second image is a false resolution, and the second device needs to restore the second image.

[0245] Exemplarily, the algorithm adopted by the first device without changing the original pixel value is to increase the first resolution of the first image to the second resolution by duplicating the pixel points to obtain the second image. Correspondingly, the second device can restore the second resolution of the second image to the first resolution by discarding the redundant pixel points in the second image. For example, the first device adopts an algorithm without changing the original pixel value to increase the pixel points of the first image with a first resolution of 4K to obtain the second image with a second resolution of 8K. Correspondingly, the second device can restore the resolution of the second image with a resolution of 8K to the first resolution of 4K by discarding the redundant pixel points in the second image.

[0246] In this way, when the algorithm information indicates that the image processing algorithm is an algorithm that does not change the first pixel value, if the first resolution is greater than the second resolution, the second device directly enhances the image quality of the second image according to the second resolution, and the problem of poor image quality enhancement effect will not occur. If the first resolution is less than the second resolution, the second device restores the second resolution of the second image to the first resolution, and then performs image quality enhancement processing on the second image restored to the first resolution, which is to enhance the image quality of the true resolution image, and the problem of poor image quality enhancement effect will not occur.

[0247] S905: The second device displays the third image.

[0248] In some embodiments, after performing image quality enhancement processing on the second image according to the image processing information, the second device may display the third image with enhanced image quality.

[0249] In this way, the two devices interact with each other through information, so that the first device can adapt the resolution of the input image to the output image based on the image processing capability of the second device, and the second device can enhance the quality of the output image according to the image processing algorithm used by the first device in processing the image, thereby avoiding the situation where the second device has poor image quality enhancement effect on the false resolution image.

[0250] Furthermore, the first device may also execute the steps and functions executed by the set-top box in the above embodiments, and the second device may also execute the steps and functions executed by the television in the above embodiments, thereby realizing the image processing method provided by the above embodiments.

[0251] Combination of the above Figure 4-Figure 9 The image processing method provided by the embodiment of the present application is described in detail. Fig.10 and Fig.11 The first device and the second device provided in the embodiments of the present application are described in detail.

[0252] In one possible design, Fig.10 This is a schematic diagram of the structure of the first device provided in the embodiment of the present application. Fig.10 As shown, the first device 1000 may include: a transceiver unit 1001 and a processing unit 1002. The first device 1000 may be used to implement the functions of the set-top box involved in the above method embodiment.

[0253] Optionally, the transceiver unit 1001 is used to support the first device 1000 to execute Figure 4 S402 and S404 in; and / or, supporting the first device 1000 to execute Fig. 9 S901 and S903 in.

[0254] Optionally, the processing unit 1002 is used to support the first device 1000 to execute Figure 4 S403 in; and / or, supporting the first device 1000 to execute Figure 6 S4031-S4033 in; and / or, supporting the first device 1000 to execute Fig. 9 S902 in the.

[0255] Among them, the transceiver unit may include a receiving unit and a sending unit, which may be implemented by a transceiver or a transceiver-related circuit component, and may be a transceiver or a transceiver module. The operations and / or functions of each unit in the first device 1000 are respectively to implement the corresponding process of the data synchronization method in the above method embodiment. All relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional unit, and for the sake of brevity, they will not be repeated here.

[0256] Optionally, Fig.10 The first device 1000 shown may also include a storage unit ( Fig.10 (not shown), the storage unit stores a program or instruction. When the transceiver unit 1001 and the processing unit 1002 execute the program or instruction, Fig.10 The first device 1000 shown can execute the image processing method in the above method embodiment.

[0257] Fig.10 The technical effects of the first device 1000 shown can refer to the technical effects of the image processing method in the above method embodiment, which will not be repeated here.

[0258] In addition to being in the form of the first device 1000, the technical solution provided in the present application may also be a functional unit or chip in the first device, or a device used in conjunction with the first device.

[0259] In one possible design, Fig.11 This is a schematic diagram of the structure of the second device provided in the embodiment of the present application. Fig.11 As shown, the second device 1100 may include: a transceiver unit 1101, a processing unit 1102, and a display unit 1103. The second device 1100 may be used to implement the functions of the second device involved in the above method embodiment.

[0260] Optionally, the transceiver unit 1101 is used to support the second device 1100 to execute Figure 4 S402 and S404 in; and / or, supporting the second device 1100 to execute Fig. 9 S901 and S903 in.

[0261] Optionally, the processing unit 1102 is configured to support the second device 1100 to execute Figure 4 S405 in; and / or, supporting the second device 1100 to execute Figure 7 S4051-S4056 in; and / or, supporting the second device 1100 to execute Figure 8 S801-S807 in; and / or, supporting the second device 1100 to execute Fig. 9 S904 in.

[0262] Optionally, the display unit 1103 is used to support the first device 1100 to display interface content. And / or, support the second device 1100 to execute Figure 4 S405 in; and / or, supporting the second device 1100 to execute Fig. 9 S905 in;

[0263] Among them, the transceiver unit may include a receiving unit and a sending unit, which may be implemented by a transceiver or a transceiver-related circuit component, and may be a transceiver or a transceiver module. The operations and / or functions of each unit in the second device 1100 are respectively to implement the corresponding process of the data synchronization method in the above method embodiment. All relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional unit, and for the sake of brevity, they will not be repeated here.

[0264] Optionally, Fig.11 The second device 1100 shown may also include a storage unit ( Fig.11 (not shown), the storage unit stores a program or instruction. When the transceiver unit 1101 and the processing unit 1102 execute the program or instruction, Fig.11 The second device 1100 shown can execute the data synchronization method in the above method embodiment.

[0265] Fig.11The technical effect of the second device 1100 shown can refer to the technical effect of the data synchronization method in the above method embodiment, which will not be repeated here. In addition to the form of the second device 1100, the technical solution provided by this application can also be a functional unit or chip in the second device, or a device used in conjunction with the second device.

[0266] An embodiment of the present application also provides a chip system, including: a processor, the processor is coupled to a memory, the memory is used to store programs or instructions, when the program or instructions are executed by the processor, the chip system implements the method in any of the above method embodiments.

[0267] Optionally, the processor in the chip system may be one or more. The processor may be implemented by hardware or by software. When implemented by hardware, the processor may be a logic circuit, an integrated circuit, etc. When implemented by software, the processor may be a general-purpose processor implemented by reading software code stored in a memory.

[0268] Optionally, the memory in the chip system may also be one or more. The memory may be integrated with the processor or may be separately arranged with the processor, which is not limited in the embodiments of the present application. Exemplarily, the memory may be a non-transient processor, such as a read-only memory ROM, which may be integrated with the processor on the same chip or may be arranged on different chips respectively. The embodiments of the present application do not specifically limit the type of memory and the arrangement of the memory and the processor.

[0269] Exemplarily, the chip system can be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a microcontroller unit (MCU), a programmable logic device (PLD) or other integrated chips.

[0270] It should be understood that each step in the above method embodiment can be completed by an integrated logic circuit of hardware in a processor or by instructions in the form of software. The method steps disclosed in the embodiments of the present application can be directly embodied as being executed by a hardware processor, or by a combination of hardware and software modules in a processor.

[0271] An embodiment of the present application also provides a computer-readable storage medium, in which a computer program is stored. When the computer program runs on a computer, the computer executes the above-mentioned related steps to implement the data synchronization method in the above-mentioned embodiment.

[0272] An embodiment of the present application also provides a computer program product. When the computer program product is run on a computer, the computer is enabled to execute the above-mentioned related steps to implement the data synchronization method in the above-mentioned embodiment.

[0273] In addition, an embodiment of the present application further provides a device. The device may be a component or a module, and the device may include one or more processors and a memory connected to each other. The memory is used to store a computer program. When the computer program is executed by one or more processors, the device performs the data synchronization method in the above-mentioned method embodiments.

[0274] Among them, the device, computer-readable storage medium, computer program product or chip provided in the embodiments of the present application are used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0275] The steps of the method or algorithm described in conjunction with the disclosure of the embodiments of the present application can be implemented in hardware or by executing software instructions by a processor. The software instructions can be composed of corresponding software modules, and the software modules can be stored in random access memory (RAM), flash memory, read only memory (ROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disks, mobile hard disks, CD-ROMs or any other form of storage medium known in the art. An exemplary storage medium is coupled to a processor so that the processor can read information from the storage medium and can write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an application specific integrated circuit (ASIC).

[0276] Through the description of the above implementation methods, those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above functional modules is used as an example. In practical applications, the above functions can be assigned to different functional modules as needed; that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device and unit described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0277] In the several embodiments provided in the present application, it should be understood that the disclosed method can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation; for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of modules or units, which can be electrical, mechanical or other forms.

[0278] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0279] Computer-readable storage media include, but are not limited to, any of the following: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and other media that can store program codes.

[0280] The above are only specific implementations of the present application, but the protection scope of the present application is not limited thereto, and any changes or substitutions within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. An image processing method, characterized in that: Applied to a first device, the method includes: receiving first information sent by a second device, where the first information is used to indicate an image processing capability of the second device; According to the first information, when the image processing capability of the second device meets the first condition, the input first image is processed by a first image processing algorithm to obtain a second image; Sending second information to the second device, where the second information carries the second image and image processing information corresponding to the second image, and the second information is used to instruct the second device to process the second image according to the image processing information.

2. The method according to claim 1, characterized in that Before sending the second information to the second device, the method further includes: According to the first information, when the image processing capability of the second device does not meet the first condition, the first image is processed by a second image processing algorithm to obtain a second image.

3. The method according to claim 2, characterized in that The first image processing algorithm is an algorithm that changes a first pixel value of the first image, or an algorithm that does not change the first pixel value; the second image processing algorithm is an algorithm that changes the first pixel value.

4. The method according to any one of claims 1 to 3, characterized in that: The image processing capability includes whether the second device supports true and false resolution adaptation, and the first condition includes supporting true and false resolution adaptation.

5. The method according to any one of claims 1 to 4, characterized in that: The image processing information includes a first resolution of the first image and algorithm information of an image processing algorithm used to process the first image.

6. An image processing method, characterized in that: Applied to the second device, the method includes: Sending first information to the first device, where the first information is used to indicate an image processing capability of the second device; receiving second information sent by the first device, where the second information carries a second image and image processing information corresponding to the second image, and the second image is an image obtained by the first device after processing the input first image according to the first information; Performing image quality enhancement processing on the second image according to the image processing information to obtain a third image; The third image is displayed.

7. The method according to claim 6, characterized in that The image processing information includes a first resolution of the first image and algorithm information of an image processing algorithm used to process the first image, and the image processing algorithm includes an algorithm for changing a first pixel value of the first image, or an algorithm for not changing the first pixel value.

8. The method according to claim 7, characterized in that The step of performing image quality enhancement processing on the second image according to the image processing information to obtain a third image includes: When the first resolution is greater than or equal to the second resolution of the second image, performing image quality enhancement processing on the second image according to the second resolution to obtain a third image; When the first resolution is smaller than the second resolution, the second image is enhanced according to the algorithm information to obtain a third image.

9. The method according to claim 8, characterized in that The step of performing image quality enhancement processing on the second image according to the algorithm information to obtain a third image includes: When the algorithm information indicates that the image processing algorithm is an algorithm that does not change the first pixel value, performing image quality enhancement processing on the second image according to the second resolution to obtain a third image; When the algorithm information indicates that the image processing algorithm is an algorithm for changing the first pixel value, the second image is enhanced according to the first resolution, the second resolution, and the algorithm type of the image processing algorithm to obtain a third image.

10. The method according to claim 7, characterized in that The step of performing image quality enhancement processing on the second image according to the image processing information to obtain a third image includes: When the first resolution is equal to the second resolution of the second image, performing image quality enhancement processing on the second image according to the second resolution to obtain a third image; When the first resolution is not equal to the second resolution of the second image, the second image is enhanced according to the algorithm information to obtain a third image.

11. The method according to claim 10, characterized in that The step of performing image quality enhancement processing on the second image according to the algorithm information to obtain a third image includes: When the algorithm information indicates that the image processing algorithm is an algorithm for changing the first pixel value, performing image quality enhancement processing on the second image according to the first resolution, the second resolution, and the algorithm type of the image processing algorithm to acquire a third image; When the algorithm information indicates that the image processing algorithm is an algorithm that does not change the first pixel value, the second image is enhanced according to the first resolution and the second resolution to obtain a third image.

12. The method according to claim 11, characterized in that The step of performing image quality enhancement processing on the second image according to the first resolution and the second resolution to obtain a third image includes: When the first resolution is greater than the second resolution, performing image quality enhancement processing on the second image according to the second resolution to obtain a third image; When the second resolution is greater than the first resolution, after restoring the second resolution of the second image to the first resolution, image quality enhancement processing is performed on the second image to obtain a third image.

13. The method according to any one of claims 6 to 12, characterized in that: The image processing capability includes whether the second device supports true and false resolution adaptation.

14. An image processing system, characterized in that: The system includes a first device and a second device; The second device is used to send first information to the first device, where the first information is used to indicate an image processing capability of the second device; The first device is used for: receiving first information sent by a second device; According to the first information, when the image processing capability of the second device meets the first condition, the input first image is processed by a first image processing algorithm to obtain a second image; Sending second information to the second device, where the second information carries the second image and image processing information corresponding to the second image; The second device is further used for: receiving second information sent by the first device; Performing image quality enhancement processing on the second image according to the image processing information to obtain a third image; The third image is displayed.

15. The system according to claim 14, characterized in that The first device is further used for: According to the first information, when the image processing capability of the second device does not meet the first condition, the first image is processed by a second image processing algorithm to obtain a second image.

16. The system according to claim 14 or 15, characterized in that The image processing information includes a first resolution of the first image and algorithm information of an image processing algorithm used to process the first image, and the image processing algorithm includes an algorithm for changing a first pixel value of the first image, or an algorithm for not changing the first pixel value.

17. The system according to claim 16, characterized in that The second device is further used for: When the first resolution is equal to the second resolution of the second image, performing image quality enhancement processing on the second image according to the second resolution to obtain a third image; When the first resolution is not equal to the second resolution of the second image, the second image is enhanced according to the algorithm information to obtain a third image.

18. An electronic device, characterized in that: include: A processor, a memory and a display screen, wherein the memory and the display screen are coupled to the processor, the memory is used to store computer program codes, and the computer program codes include computer instructions. When the processor reads the computer instructions from the memory, the electronic device executes the method as described in any one of claims 1 to 5; or, the electronic device executes the method as described in any one of claims 6 to 13.

19. A computer-readable storage medium, characterized in that: The computer-readable storage medium comprises a computer program, and when the computer program is executed on an electronic device, the electronic device is enabled to execute the method according to any one of claims 1 to 13.

20. A computer program product, characterized in that When the computer program product is executed on a computer, the computer is caused to execute the method according to any one of claims 1 to 13.

Images