Image optimization methods, apparatus, devices and storage media

Abstract

This specification provides an image optimization method, apparatus, device, and computer storage medium. The method includes: responding to an image acquisition request through a camera processing system, acquiring image source data captured by the camera; performing sharpness processing on the image source data according to a requested resolution set in the image acquisition request to obtain first image data; transmitting the first image data to a display terminal specified in the image acquisition request; the display terminal receiving the first image data sent by the camera processing system; the display terminal decoding the first image data to obtain decoded second image data; the display terminal confirming the sharpness adjustment parameters of the second image data according to the requested resolution; the display terminal processing the second image data using the sharpness adjustment parameters to obtain third image data; and rendering and displaying the third image data, so that the requested resolution is displayed more clearly on a larger screen with a higher resolution, thereby improving the image display effect of the display terminal.

Description

Technical Field

[0001] This invention relates to the field of image processing technology, and in particular to image optimization methods, apparatus, devices, and computer storage media. Background Technology

[0002] With the development of intelligent technology and network communication, people can watch live broadcasts, participate in online meetings, and learn online. At the same time, high-definition displays have emerged to provide a clearer video viewing experience.

[0003] However, when the network signal is poor or the image quality captured by the camera is low, the resolution of the image transmitted to the high-definition display is often lower than the resolution of the screen itself. In this case, the low-resolution image is usually processed so that it can be displayed on screens of different resolutions, such as stretching the low-resolution image to the screen resolution. However, this method is prone to image distortion, which greatly reduces the display effect on the screen. For example, when a 1080p resolution video or image output by the camera is displayed on a 4K screen, there will be a problem with the clarity. Summary of the Invention

[0004] The main purpose of this specification is to provide an image optimization method, apparatus, device, and storage medium, aimed at improving image display clarity. The technical solution is as follows:

[0005] Firstly, embodiments of this specification provide an image optimization method applied to a display device, comprising:

[0006] Receive first image data sent by the camera processing system. The first image data is obtained by the camera processing system performing sharpness processing on the image source data captured by the camera according to the requested resolution set by the display terminal.

[0007] The first image data is decoded to obtain the decoded second image data;

[0008] The sharpness adjustment parameters of the second image data are determined based on the requested resolution, wherein the requested resolution is lower than the screen resolution of the display device;

[0009] The second image data is processed using sharpness adjustment parameters to obtain the third image data, which is then rendered and displayed.

[0010] Secondly, embodiments of this specification provide an image optimization method applied to a camera processing system, comprising:

[0011] In response to an image acquisition request, retrieve the image source data captured by the camera;

[0012] The image source data is processed for sharpness based on the requested resolution set in the image acquisition request to obtain the first image data;

[0013] The first image data is transmitted to the display end specified in the image acquisition request, so that the display end can perform sharpness processing on the first image data according to the sharpness adjustment parameters corresponding to the requested resolution.

[0014] Thirdly, embodiments of this specification provide an image optimization apparatus, comprising:

[0015] The receiving module is used to receive the first image data sent by the camera processing system. The first image data is obtained by the camera processing system performing sharpness processing on the image source data captured by the camera according to the requested resolution set by the display end.

[0016] The decoding module is used to decode the first image data to obtain the decoded second image data;

[0017] The parameter confirmation module is used to confirm the sharpness adjustment parameters of the second image data according to the requested resolution, wherein the requested resolution is lower than the screen resolution of the display end;

[0018] The first sharpness processing module is used to process the second image data using sharpness adjustment parameters to obtain the third image data, and then render and display the third image data.

[0019] Fourthly, embodiments of this specification provide an image optimization apparatus, comprising:

[0020] The image acquisition module is used to acquire image source data captured by the camera in response to an image acquisition request;

[0021] The second sharpness processing module is used to perform sharpness processing on the image source data according to the requested resolution set in the image acquisition request, so as to obtain the first image data;

[0022] The transmission module is used to transmit the first image data to the display end specified by the image acquisition request, so that the display end can perform sharpness processing on the first image data according to the sharpness adjustment parameters corresponding to the requested resolution.

[0023] Fifthly, embodiments of this specification provide an electronic device, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program, when executed by the processor, implements the steps of the method described above.

[0024] Sixthly, embodiments of this specification provide a computer storage medium storing a computer program, which, when executed by a processor, implements the steps of the method described above.

[0025] In the embodiments of this specification, the camera processing system responds to an image acquisition request by acquiring image source data captured by the camera. The camera processing system performs sharpness processing on the image source data according to the requested resolution set in the image acquisition request to obtain first image data. The first image data is then transmitted to the display terminal specified in the image acquisition request. The display terminal receives the first image data sent by the camera processing system, decodes the first image data to obtain decoded second image data, confirms the sharpness adjustment parameters of the second image data according to the requested resolution, processes the second image data using the sharpness adjustment parameters to obtain third image data, and renders and displays the third image data. By using different sharpness optimization parameters for images of different resolutions on both the display terminal side and the camera processing system side, personalized optimization processing of image quality is achieved, making low-resolution images appear clearer on screens with higher resolutions. Attached Figure Description

[0026] To more clearly illustrate the technical solutions in the embodiments or prior art of this specification, the drawings used in the description of the embodiments or prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this specification. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0027] Figure 1 This is a schematic diagram of the application environment of an image optimization method provided in the embodiments of this specification;

[0028] Figure 2 This is a flowchart illustrating an image optimization method provided in the embodiments of this specification;

[0029] Figure 3 This is a schematic diagram illustrating an example of an image optimization method provided in the embodiments of this specification;

[0030] Figure 4 This is a schematic diagram illustrating an example of an image optimization method provided in the embodiments of this specification;

[0031] Figure 5 This is a flowchart illustrating an image optimization method provided in the embodiments of this specification;

[0032] Figure 6 This is a schematic diagram of the structure of an image optimization device provided in the embodiments of this specification;

[0033] Figure 7 This is a schematic diagram of the structure of an image optimization device provided in the embodiments of this specification;

[0034] Figure 8 This is a schematic diagram of the structure of an image optimization device provided in the embodiments of this specification;

[0035] Figure 9 This is a schematic diagram of the structure of an electronic device provided in the embodiments of this specification. Detailed Implementation

[0036] The technical solutions in the embodiments of this specification will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this specification, and not all embodiments. Based on the embodiments in this specification, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this specification.

[0037] Please see Figure 1 This diagram illustrates the application environment of an image optimization method provided in an embodiment of this specification. The application environment of the image optimization method in one embodiment of this application includes an interactive flat panel 1. The interactive flat panel 1 can be composed of two or more physical entities, or it can be composed of a single physical entity. From a hardware perspective, the hardware referred to by the interactive flat panel 1 is essentially a computer device with equivalent capabilities to a personal computer. It is a hardware device with the necessary components revealed by the von Neumann architecture, such as a central processing unit (including an arithmetic logic unit and a control unit), memory, input devices, and output devices. The computer program is stored in the memory, and the central processing unit calls the computer program stored in the memory to run it, executes the instructions in the computer program, and interacts with the input / output devices to complete specific functions. The interactive flat panel 1 is equipped with a display screen, and the display screen has a display area 2 for displaying image data. The image data can be pictures or videos, and there is no specific limitation.

[0038] For ease of understanding, the interactive whiteboard 1 is used as an example application environment in this embodiment. The interactive whiteboard 1 is an integrated device that uses touch technology to control the content displayed on it and achieve human-computer interaction. It integrates one or more functions such as a projector, electronic whiteboard, screen, speakers, television, and video conferencing terminal. Typically, the interactive whiteboard is equipped with at least one operating system, including but not limited to Android, Linux, and Windows. In one embodiment, the interactive whiteboard 1 can install at least one application based on the operating system. In this embodiment, a whiteboard application with video conferencing capabilities is used as an example. The whiteboard application can be a built-in application of the operating system or an application downloaded from a third-party device or server. Optionally, in addition to video conferencing capabilities, the whiteboard application can also have writing and screen projection functions. The interactive whiteboard can conduct online meetings with remote terminal devices via the server through the whiteboard application. On one side of the interactive whiteboard, the user connects an external signal source to display the content of the signal source on the interactive whiteboard and operates the interactive whiteboard to share the desktop screen of the external signal source with the remote terminal device. Optionally, the interactive whiteboard can also acquire other types of image data through the whiteboard application, such as surveillance video data, classroom teaching videos, etc. In practical applications, there are no restrictions on the type of image data.

[0039] To capture meeting images, the interactive whiteboard 1 can be equipped with a built-in or external camera to record the interior of the meeting room and transmit the raw image signals captured by the camera to the camera processing system. Optionally, the camera can also have an audio recording function to capture sound information from the meeting room. It is understood that in practical applications, the camera may not be located in the same space as the interactive whiteboard; any camera can be used to capture image data outside the space where the interactive whiteboard is located, and the image processing system will then process the images before transmitting them to the interactive whiteboard.

[0040] In related technologies, multiple resolutions (clarity selection) are typically offered when playing videos, such as 1080P, 720P, and 480P, allowing users to switch video resolutions according to different meeting scenarios, network conditions, and viewing needs, thus meeting diverse display requirements. In an exemplary application scenario, if a 4K camera is turned on during a meeting and 1080P resolution is selected in the whiteboard application, the application requests a video stream from the camera. At this point, a camera processing system, such as an ISP (Image Signal Processor), processes and optimizes the raw image signal captured from the camera before outputting the video at the requested resolution. The display end decodes and renders the received video stream data and displays it on the screen. It is understandable that to provide users with clearer video, the highest supported video recording resolution of the camera can reach 4K to capture more video details from the source. Simultaneously, to provide a better display effect, the display screen can be a large screen supporting 4K resolution. When network signal is poor, or when a user requests video with a resolution lower than 4K, the camera processing system processes the black-and-white RAW format image output from the camera's image sensor using ISP parameters corresponding to 4K resolution. The image is then compressed (e.g., using a Raster Graphics Acceleration Unit) to 1080P resolution before being output to the display. The display then directly decodes and renders the received 1080P video stream data on a large 4K screen. This processing method for displaying low-resolution video on a high-resolution screen is equivalent to stretching the 1080P image, resulting in poor display clarity. This is especially noticeable on large interactive flat panels, where blurring and distortion are more pronounced when displaying low-resolution video. Therefore, improving the clarity of low-resolution video displayed on larger resolution screens and enhancing the user experience is a pressing issue.

[0041] To address the aforementioned issues, this application proposes an image optimization method. Based on the user's requested resolution, sharpness optimization can be performed twice, at both the display end and the ISP (camera processing system). The camera processing system performs a first sharpness optimization on the acquired image source data to obtain first image data. Upon receiving this first image data, the display end can confirm its resolution (requested resolution) and provide a corresponding set of sharpness adjustment parameters for decoding and rendering. This adapts the video stream or image to the current display end's screen resolution, ensuring that the requested resolution (e.g., 1080p) is displayed more clearly on a larger screen with a higher resolution (e.g., 4K). Unlike related technologies where the camera processing system performs uniform optimization for all resolutions (e.g., if the camera captures at 4K resolution, only one set of ISP parameters is used, failing to meet the high-definition sharpness requirements of other resolutions), this application's optimization method adapts to different resolutions for customized sharpness processing, thereby improving the display effect of images at various resolutions on large screens.

[0042] The image optimization method provided in this specification will be described in detail below with reference to specific embodiments.

[0043] Please see Figure 2 This is a flowchart illustrating an image optimization method provided in an embodiment of this specification. Figure 2 As shown in the embodiments of this application, the specific process of the image optimization method is explained from both the display end side and the camera processing system side. The method may include the following steps S101-S104.

[0044] S101, the camera processing system responds to the image acquisition request and acquires the image source data captured by the camera;

[0045] In one embodiment, when the camera processing system receives an image acquisition request from the display terminal, it can acquire the image source data captured by the camera. Specifically, the image acquisition request can be triggered by the user in the whiteboard application of the interactive flat panel, for example, when the user clicks the confirmation button for image reception functions such as start shooting, start meeting, or start receiving. It should be noted that the image acquisition request can also be triggered by an application in the terminal device, that is, the terminal device controls the camera processing system and the display terminal. The camera processing system is mainly used for image acquisition, the display terminal device is mainly used for image display, and the terminal device is used to request image data from the camera and can transmit the image data to the display terminal; or the terminal device controls the camera to output image data of a specific resolution to the display terminal.

[0046] Optionally, the image acquisition request may also include the requested camera identifier, thereby activating the corresponding camera to acquire image source data, or identifying the image source data to be displayed on the screen from multiple operating cameras. For example, if there are multiple cameras with different shooting angles, one or more cameras can be identified to acquire their acquired image source data. Multiple image source data can be processed using the same camera processing system, or they can be processed separately using different camera processing systems.

[0047] S102, the camera processing system performs sharpness processing on the image source data according to the requested resolution set in the image acquisition request to obtain the first image data;

[0048] In one embodiment, when the user enables the image receiving function, the application can automatically set the requested resolution and generate an image acquisition request based on network conditions, display processor processing capabilities, and application scenarios (e.g., scenarios requiring high definition or high smoothness). Optionally, the application can provide a resolution selection control for the user to set the requested resolution, with the upper limit being the highest video recording / image capture resolution supported by the camera.

[0049] Specifically, the camera processing system may include an ISP module. The image sensor of the camera outputs a black-and-white raw image. The ISP module adds color, sharpens details, and enhances the image to obtain the first image data. In related technologies, camera processing systems perform uniform optimization for all resolutions. For example, if the camera's capture resolution is 4K, then 4K optimization parameters are used, resulting in only one set of ISP parameters, which cannot meet the high-definition requirements of other resolutions. In this embodiment, the ISP module performs sharpness processing based on the requested resolution, using a sharpness enhancement algorithm or parameters corresponding to that resolution, to obtain the first image data with the requested resolution after sharpness processing. This sharpness processing, using a sharpness enhancement algorithm or parameters corresponding to the requested resolution, is essentially performing an IQ (image quality) parameter adjustment. It is understood that different resolutions require different IQ parameters; for example, lower resolution images require higher sharpening levels. Therefore, different IQ parameters (or ISP parameters) can be set for different resolutions to maximize image quality.

[0050] S103, the first image data is transmitted to the display end specified in the image acquisition request, so that the display end can perform clarity processing on the first image data according to the clarity adjustment parameters corresponding to the requested resolution;

[0051] In one embodiment, after the camera processing system outputs first image data, it transmits it to the display end indicated by the image acquisition request. It is understood that the image acquisition request may include a receiving device identifier to confirm which device the camera processing system needs to transmit the first image data to. For example, the first image data can be directly transmitted to the display end. Alternatively, the first image data can be transmitted to a terminal device, and then the terminal device transmits the first image data to the display end.

[0052] S104, the display terminal receives the first image data sent by the camera processing system. The first image data is obtained by the camera processing system performing sharpness processing on the image source data captured by the camera according to the requested resolution set by the display terminal.

[0053] In one embodiment, the display receives first image data sent by the camera processing system. The display and the camera can be connected via methods such as HDMI, USB, or Ethernet cable.

[0054] S105, the display terminal decodes the first image data to obtain the decoded second image data;

[0055] In one embodiment, the first image data is usually not a real image, but rather binary data that has been encoded for easy transmission. Therefore, the first image data needs to be decoded to obtain the second image data.

[0056] S106, the display terminal confirms the sharpness adjustment parameters of the second image data according to the requested resolution, wherein the requested resolution is lower than the screen resolution of the display terminal;

[0057] In one embodiment, the display end acquires sharpness calibration parameters corresponding to the requested resolution for the second image data, in order to perform sharpness processing on the second image data. It is understood that screens typically have a set of image resolution parameters for parsing image stream data; for example, a 4K screen has a set of parameters. Regardless of the resolution of the received image data, it will be displayed using the 4K screen's display parameters, which can lead to incompatibility and mismatch between the image data and the screen, resulting in an unclear image seen by the user. In this embodiment, however, the sharpness calibration parameters corresponding to the requested resolution of the first image data can be determined, and these parameters are used to adjust the first image data. The sharpness calibration parameters are used to adjust image quality influencing factors, including sharpness, signal-to-noise ratio, color, and dynamic range. Key indicators affecting image sharpness typically include sharpness, noise, and gamma. Gamma represents the distortion of the input signal by the display's output image. Therefore, in some feasible implementations, the sharpness calibration parameters mainly include parameters for adjusting sharpness, noise, and gamma.

[0058] It should be noted that this embodiment primarily focuses on the process of displaying a low-resolution image on a high-resolution screen, therefore requiring a resolution lower than the display device's screen resolution. It is understood that when displaying a high-resolution image on a low-resolution screen, the image processing method provided in this embodiment can also be used according to actual needs, that is, mapping the sharpness adjustment parameters one-to-one with the resolution.

[0059] S107, the display end uses the sharpness adjustment parameters to process the second image data to obtain the third image data, and then renders and displays the third image data.

[0060] In one embodiment, the display end processes the second image data using sharpness adjustment parameters to obtain the third image data, and then renders the third image data to obtain the final displayed image information.

[0061] For details, see Figure 3 , Figure 3 This specification provides an example illustration of an image optimization method, such as... Figure 3 As shown in the embodiments of this specification, the image optimization method can be implemented in the following way: when the camera processing system receives an image acquisition request sent by the display terminal, the camera can send image source data to the camera processing system. The camera processing system processes the image source data according to the requested resolution in the image acquisition request to generate first image data, transmits the first image data to the display terminal, decodes the first image data, obtains the sharpness adjustment parameters according to the requested resolution, uses the sharpness adjustment parameters to perform sharpness enhancement processing on the second image data, and renders and displays the second image data.

[0062] For details, please see [link / reference]. Figure 4 , Figure 4 This specification provides an example illustration of an image optimization method, such as... Figure 4 As shown in the embodiments of this specification, the image optimization method can be implemented in the following way: when the camera processing system receives an image acquisition request sent by the application (terminal device), the camera processing system acquires image source data from the camera, processes the image source data according to the requested resolution in the image acquisition request to generate first image data, transmits the first image data to the application, and the application transmits the first image data to the display end. The display end decodes the first image data, obtains the sharpness adjustment parameters according to the requested resolution, uses the sharpness adjustment parameters to perform sharpness enhancement processing on the second image data, and renders and displays the second image data.

[0063] In the embodiments of this specification, the camera processing system responds to an image acquisition request by acquiring image source data captured by the camera. The camera processing system performs sharpness processing on the image source data according to the requested resolution set in the image acquisition request to obtain first image data. The first image data is then transmitted to the display terminal specified in the image acquisition request. The display terminal receives the first image data sent by the camera processing system, decodes the first image data to obtain decoded second image data, confirms the sharpness adjustment parameters of the second image data according to the requested resolution, processes the second image data using the sharpness adjustment parameters to obtain third image data, and renders and displays the third image data. By performing specialized processing on image data of different requested resolutions—that is, by using a sharpness processing method corresponding to the requested resolution in both the camera processing system and the display terminal—the requested resolution is displayed more clearly on a larger screen with a higher resolution, thus improving the image display effect of the display terminal.

[0064] Please see Figure 5 This is a flowchart illustrating an image optimization method provided in an embodiment of this specification. Figure 5 As shown in the embodiments of this application, the specific process of the image optimization method is described from the display end side. The method may include the following steps S201-S205.

[0065] S201, Send an image acquisition request to the camera processing system to obtain the first image data after the camera processing system has processed the resolution, wherein the image acquisition request includes a requested resolution;

[0066] In one embodiment, the display end can generate an image acquisition request and send it to the camera processing system.

[0067] Optionally, before the display sends the image acquisition request to the camera processing system, it may further include: confirming the requested resolution in response to a resolution selection operation in the display application; and generating an image acquisition request based on the requested resolution. Specifically, the display may include an application with a resolution selection control, which confirms the requested resolution in response to user interaction with the resolution selection control.

[0068] S202, decode the first image data to obtain the decoded second image data;

[0069] S203, Obtain the resolution calibration parameter database corresponding to the screen resolution of the display terminal. The resolution calibration parameter database stores the correspondence between resolution calibration parameters and resolution.

[0070] Understandably, when adjusting the image resolution to match the screen resolution, the calibration parameters used will change due to the alteration of both the image and screen resolutions. For example, the calibration parameters used to display 1080P on a 4K screen are different from those used to display 1080P on a 2K screen. Therefore, based on different screen resolutions, a corresponding resolution calibration parameter database can be obtained, enabling accurate resolution enhancement. For instance, for a 4K screen, a resolution calibration parameter database corresponding to 4K screens can be obtained; for a 2K screen, a database corresponding to 2K screens can be obtained. The resolution calibration parameter database stores the correspondence between resolution calibration parameters and resolutions. For example, the 4K resolution calibration parameter database might store the resolution calibration parameter PQ (picture quality) parameter 1 for 1080P, and the resolution calibration parameter PQ parameter 2 for 720P.

[0071] S204, retrieve the sharpness adjustment parameters corresponding to the requested resolution from the sharpness adjustment parameter database, and confirm them as the sharpness adjustment parameters of the second image data;

[0072] Specifically, the resolution calibration parameter database can be stored on the display device, in the cloud, or on other terminal devices; there are no specific limitations. Based on the requested resolution, the display device can retrieve the corresponding resolution calibration parameters from the resolution calibration parameter database.

[0073] In one embodiment, based on the same concept described above, when the image source data acquired by the camera is processed for sharpness according to the image quality processing parameters to obtain the first image data, the following steps S301-S302 may be included:

[0074] S301, based on the preset resolution and sharpness parameter mapping relationship, confirm the image quality processing parameters corresponding to the requested resolution;

[0075] S302, the image source data acquired by the camera is processed for clarity according to the image quality processing parameters to obtain the first image data.

[0076] Specifically, the camera processing system can store a mapping relationship between resolution and sharpness parameters. These sharpness parameters, also known as image quality (IQ) parameters, are used to process the image signal output from the sensor (i.e., the image source data) to improve image quality. Based on the pre-stored mapping relationship, the image quality parameters corresponding to the requested resolution can be determined. Then, the image source data acquired by the camera is processed according to these parameters to obtain the first image data.

[0077] Optionally, the image source data acquired by the camera is processed to obtain first image data by image quality processing parameters, including: compressing the acquisition resolution of the image source data to a requested resolution to obtain third image data; and processing the third image data to obtain first image data by image quality processing parameters. In one feasible implementation, the camera processing system may first compress (scale) the image source data to obtain third image data, and then process the third image data to obtain sharpness based on image quality processing parameters.

[0078] S205 uses sharpness adjustment parameters to process the second image data to obtain the third image data, and then renders and displays the third image data.

[0079] Specifically, the second image data is processed according to the sharpness calibration parameters confirmed from the sharpness calibration parameter database to obtain the third image data, and the third image data is rendered and displayed.

[0080] In the embodiments of this specification, an image acquisition request is sent from the display terminal to the camera processing system to obtain first image data after sharpness processing by the camera processing system. The first image data is decoded to obtain decoded second image data. A sharpness calibration parameter database corresponding to the screen resolution of the display terminal is obtained. Sharpness calibration parameters corresponding to the requested resolution are obtained from the sharpness calibration parameter database and confirmed as the sharpness calibration parameters for the second image data. The second image data is processed using the sharpness calibration parameters to obtain third image data, which is then rendered and displayed. By obtaining sharpness calibration parameters for the requested resolution from a pre-constructed sharpness calibration parameter database, adaptive sharpness processing is performed on the image to improve the sharpness processing effect and display a clearer image on the screen of the display terminal.

[0081] The following will be combined with the appendix Figure 6-8 This specification provides a detailed description of the image optimization apparatus provided in the embodiments. It should be noted that the appendix... Figure 6-8 The image optimization device in this specification is used to perform the functions described herein. Figures 2-5 The methods shown in the embodiments are illustrated for ease of explanation, showing only the parts related to the embodiments of this specification. For specific technical details not disclosed, please refer to this specification. Figures 2-5 The example shown.

[0082] Please see Figure 6This diagram illustrates the structure of an image optimization apparatus provided in an exemplary embodiment of this specification. The image optimization apparatus can be implemented as all or part of a device through software, hardware, or a combination of both. The device 1 includes a receiving module 11, a decoding module 12, a parameter confirmation module 13, and a first sharpness processing module 14.

[0083] The receiving module 11 is used to receive the first image data sent by the camera processing system. The first image data is obtained by the camera processing system performing clarity processing on the image source data captured by the camera according to the requested resolution set by the display terminal.

[0084] Decoding module 12 is used to decode the first image data to obtain the decoded second image data;

[0085] The parameter confirmation module 13 is used to confirm the sharpness adjustment parameters of the second image data according to the requested resolution, wherein the requested resolution is lower than the screen resolution of the display end;

[0086] The first sharpness processing module 14 is used to process the second image data using sharpness adjustment parameters to obtain the third image data, and to render and display the third image data.

[0087] Optional, please see Figure 7 This is a schematic diagram of the structure of an image optimization apparatus provided in an exemplary embodiment of this specification. Figure 7 As shown, the image optimization device also includes a sending module 15, which is used to send an image acquisition request to the camera processing system to obtain the first image data after the camera processing system has processed the image resolution, wherein the image acquisition request includes a requested resolution.

[0088] Optionally, the sending module 15 is specifically used to confirm the requested resolution in response to a resolution selection operation in the display application;

[0089] Generate an image retrieval request based on the requested resolution.

[0090] Optionally, the parameter confirmation module 13 is specifically used to obtain a resolution calibration parameter database corresponding to the screen resolution of the display terminal. The resolution calibration parameter database stores the correspondence between resolution calibration parameters and resolution.

[0091] Retrieve the sharpness calibration parameters corresponding to the requested resolution from the sharpness calibration parameter database, and confirm them as the sharpness calibration parameters for the second image data.

[0092] Please see Figure 8This diagram illustrates the structure of an image optimization apparatus provided in an exemplary embodiment of this specification. The image optimization apparatus can be implemented as all or part of a device through software, hardware, or a combination of both. The device 2 includes an image acquisition module 21, a second sharpness processing module 22, and a transmission module 23.

[0093] Image acquisition module 21 is used to acquire image source data captured by the camera in response to an image acquisition request;

[0094] The second sharpness processing module 22 is used to perform sharpness processing on the image source data according to the requested resolution set in the image acquisition request, so as to obtain the first image data.

[0095] The transmission module 23 is used to transmit the first image data to the display end specified by the image acquisition request, so that the display end can perform sharpness processing on the first image data according to the sharpness adjustment parameters corresponding to the requested resolution.

[0096] Optionally, the second sharpness processing module 22 is specifically used to determine the image quality processing parameters corresponding to the requested resolution based on a preset resolution-sharpness parameter mapping relationship;

[0097] The image source data acquired by the camera is processed to improve its sharpness based on the image quality processing parameters, resulting in the first image data.

[0098] Optionally, the second resolution processing module 22 is specifically used to compress the acquisition resolution of the image source data to the requested resolution to obtain the third image data;

[0099] The sharpness of the third image data is processed according to the image quality processing parameters to obtain the first image data.

[0100] It should be noted that the image optimization apparatus provided in the above embodiments is only illustrated by the division of the above functional modules when executing the image optimization method. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the image optimization apparatus and the image optimization method embodiments provided in the above embodiments belong to the same concept, and the implementation process can be found in the method embodiments, which will not be repeated here.

[0101] The embodiment numbers in this specification are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments. In some cases, the actions or steps described in the claims can be performed in a different order than that shown in the embodiments and still achieve the desired result. Furthermore, the processes depicted in the drawings do not necessarily require a specific or sequential order to achieve the desired result. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0102] This specification also provides a computer storage medium storing a computer program, which, when executed by a processor, implements the above-described functionality. Figures 2-5 The image optimization method of the illustrated embodiment can be found in the following document for a detailed execution process. Figures 2-5 The specific details of the illustrated embodiments will not be elaborated here.

[0103] Please refer to Figure 9 This diagram illustrates the structure of an electronic device provided in an exemplary embodiment of this specification. The electronic device in this specification may include one or more components such as a processor 110, a memory 120, an input device 130, an output device 140, and a bus 150. The processor 110, memory 120, input device 130, and output device 140 may be connected via the bus 150.

[0104] Processor 110 may include one or more processing cores. Processor 110 connects to various parts of the electronic device using various interfaces and lines, and executes various functions of terminal 100 and processes data by running or executing instructions, programs, code sets, or instruction sets stored in memory 120, and by calling data stored in memory 120. Optionally, processor 110 may be implemented using at least one hardware form of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), or Programmable Logic Array (PLA). Processor 110 may integrate one or more of the following: Central Processing Unit (CPU), Graphics Processing Unit (GPU), and modem. The CPU primarily handles the operating system, user page, and applications; the GPU is responsible for rendering and drawing the displayed content; and the modem handles wireless communication. It is understood that the modem may also not be integrated into processor 110 and may be implemented separately using a communication chip.

[0105] The memory 120 may include random access memory (RAM) or read-only memory (ROM). Optionally, the memory 120 may include non-transitory computer-readable storage medium. The memory 120 may be used to store instructions, programs, code, code sets, or instruction sets. The memory 120 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as touch function, sound playback function, image playback function, etc.), instructions for implementing the various method embodiments described above, etc. The operating system may be the Android system, including systems deeply developed based on the Android system, the iOS system developed by Apple Inc., including systems deeply developed based on the iOS system, or other systems.

[0106] The memory 120 can be divided into operating system space and user space. The operating system runs in the operating system space, while native and third-party applications run in user space. To ensure that different third-party applications can achieve good running performance, the operating system allocates corresponding system resources for each application. However, different application scenarios within the same third-party application have different requirements for system resources. For example, in local resource loading scenarios, third-party applications have high requirements for disk read speed; in animation rendering scenarios, third-party applications have high requirements for GPU performance. Since the operating system and third-party applications are independent of each other, the operating system often cannot promptly perceive the current application scenario of a third-party application, resulting in the operating system's inability to adapt system resources accordingly.

[0107] In order for the operating system to distinguish the specific application scenarios of third-party applications, it is necessary to establish data communication between the third-party applications and the operating system. This would allow the operating system to obtain the current scenario information of the third-party applications at any time, and then perform targeted system resource adaptation based on the current scenario.

[0108] The input device 130 is used to receive input instructions or data, and includes, but is not limited to, a keyboard, mouse, camera, microphone, or touch device. The output device 140 is used to output instructions or data, and includes, but is not limited to, a display device and a speaker. In one example, the input device 130 and the output device 140 can be combined, and the input device 130 and the output device 140 can be a touch display screen.

[0109] The touch display screen can be designed as a full-screen, curved screen, or irregularly shaped screen. It can also be designed as a combination of a full-screen and a curved screen, or a combination of an irregularly shaped screen and a curved screen; however, this specification does not limit the specific design of the embodiments described herein.

[0110] In addition, those skilled in the art will understand that the structure of the electronic device shown in the above figures does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements. For example, the electronic device may also include radio frequency circuits, input units, sensors, audio circuits, WiFi modules, power supplies, Bluetooth modules, etc., which will not be described in detail here.

[0111] exist Figure 9 In the illustrated electronic device, the processor 110 can be used to call computer applications stored in the memory 120 and specifically perform the following operations:

[0112] Receive first image data sent by the camera processing system. The first image data is obtained by the camera processing system performing sharpness processing on the image source data captured by the camera according to the requested resolution set by the display terminal.

[0113] The first image data is decoded to obtain the decoded second image data;

[0114] The sharpness adjustment parameters of the second image data are determined based on the requested resolution, wherein the requested resolution is lower than the screen resolution of the display device;

[0115] The second image data is processed using sharpness adjustment parameters to obtain the third image data, which is then rendered and displayed.

[0116] In one embodiment, the processor 110 also performs the following operations:

[0117] An image acquisition request is sent to the camera processing system to obtain the first image data after the camera processing system has processed the image resolution. The image acquisition request includes the requested resolution.

[0118] In one embodiment, the processor 110 also performs the following operations:

[0119] In response to a resolution selection action in the display application, confirm the requested resolution;

[0120] Generate an image retrieval request based on the requested resolution.

[0121] In one embodiment, the processor 110 also performs the following operations:

[0122] In response to an image acquisition request, retrieve the image source data captured by the camera;

[0123] The image source data is processed for sharpness based on the requested resolution set in the image acquisition request to obtain the first image data;

[0124] The first image data is transmitted to the display end specified in the image acquisition request, so that the display end can perform sharpness processing on the first image data according to the sharpness adjustment parameters corresponding to the requested resolution.

[0125] In one embodiment, when the processor 110 performs sharpness processing on the image source data according to the requested resolution set in the image acquisition request to obtain the first image data, it specifically performs the following operations:

[0126] Based on the preset mapping relationship between resolution and sharpness parameters, confirm the image quality processing parameters corresponding to the requested resolution;

[0127] The image source data acquired by the camera is processed to improve its sharpness based on the image quality processing parameters, resulting in the first image data.

[0128] In one embodiment, when the processor 110 performs sharpness processing on the image source data acquired by the camera according to the image quality processing parameters to obtain the first image data, it specifically performs the following operations:

[0129] The image source data is compressed to the requested resolution to obtain the third image data;

[0130] The sharpness of the third image data is processed according to the image quality processing parameters to obtain the first image data.

[0131] In the embodiments of this specification, the camera processing system responds to an image acquisition request by acquiring image source data captured by the camera. The camera processing system performs sharpness processing on the image source data according to the requested resolution set in the image acquisition request to obtain first image data. The first image data is then transmitted to the display terminal specified in the image acquisition request. The display terminal receives the first image data sent by the camera processing system, decodes the first image data to obtain decoded second image data, confirms the sharpness adjustment parameters of the second image data according to the requested resolution, processes the second image data using the sharpness adjustment parameters to obtain third image data, and renders and displays the third image data. By performing specialized processing on image data of different requested resolutions—that is, by using a sharpness processing method corresponding to the requested resolution in both the camera processing system and the display terminal—the requested resolution is displayed more clearly on a larger screen with a higher resolution, thus improving the image display effect of the display terminal.

[0132] Furthermore, the display terminal sends an image acquisition request to the camera processing system to obtain the first image data after sharpness processing by the camera processing system. The first image data is decoded to obtain the decoded second image data. A sharpness calibration parameter database corresponding to the display terminal's screen resolution is retrieved. The sharpness calibration parameters corresponding to the requested resolution are obtained from the sharpness calibration parameter database and confirmed as the sharpness calibration parameters for the second image data. These sharpness calibration parameters are then used to process the second image data to obtain the third image data, which is then rendered and displayed. By obtaining sharpness calibration parameters for the requested resolution from a pre-built sharpness calibration parameter database, adaptive sharpness processing is performed on the image to improve the sharpness processing effect and display a clearer image on the display terminal's screen.

[0133] Additionally, embodiments of this specification provide a computer program product, which includes a computer program that, when executed by a processor of an electronic device, enables the processor to at least perform the functions described above. Figures 2 to 5 The image optimization method provided in the illustrated embodiment.

[0134] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The aforementioned program can be stored in a computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. The aforementioned storage medium can be a magnetic disk, optical disk, read-only memory (ROM), or random access memory (RAM), etc.

[0135] The above-disclosed embodiments are merely preferred embodiments of this specification and should not be construed as limiting the scope of this specification. Therefore, any equivalent variations made in accordance with the claims of this specification shall still fall within the scope of this specification.

Claims

1. An image optimization method, characterized in that, Applications to display devices include: Receive first image data sent by the camera processing system, wherein the first image data is obtained by the camera processing system performing sharpness processing on the image source data captured by the camera according to the requested resolution set by the display terminal; The first image data is decoded to obtain the decoded second image data; Obtain a resolution calibration parameter database corresponding to the screen resolution of the display terminal, wherein the resolution calibration parameter database stores the correspondence between resolution calibration parameters and resolution; Retrieve the resolution adjustment parameters corresponding to the requested resolution from the resolution adjustment parameter database, and confirm them as the resolution adjustment parameters of the second image data, wherein the requested resolution is lower than the screen resolution of the display terminal; The second image data is processed using the aforementioned sharpness adjustment parameters to obtain third image data, which is then rendered and displayed.

2. The method as described in claim 1, characterized in that, The method further includes: An image acquisition request is sent to the camera processing system to obtain first image data after the camera processing system has processed the image for resolution, wherein the image acquisition request includes a requested resolution.

3. The method as described in claim 2, characterized in that, The method further includes: In response to a resolution selection operation in the display application, the requested resolution is confirmed; An image acquisition request is generated based on the requested resolution.

4. An image optimization method, characterized in that, Applications in camera processing systems include: In response to an image acquisition request, retrieve the image source data captured by the camera; The image source data is processed for sharpness according to the requested resolution set in the image acquisition request to obtain the first image data; The first image data is transmitted to the display end specified in the image acquisition request, so that the display end can perform sharpness processing on the first image data according to the sharpness adjustment parameters corresponding to the requested resolution; the sharpness adjustment parameters are sharpness adjustment parameters corresponding to the requested resolution obtained from the sharpness adjustment parameter database corresponding to the screen resolution of the display end; the sharpness adjustment parameter database stores the correspondence between sharpness adjustment parameters and resolutions.

5. The method as described in claim 4, characterized in that, The step of performing sharpness processing on the image source data according to the requested resolution set in the image acquisition request to obtain the first image data includes: Based on the preset mapping relationship between resolution and sharpness parameters, the image quality processing parameters corresponding to the requested resolution are determined; The image source data acquired by the camera is processed for sharpness based on the image quality processing parameters to obtain the first image data.

6. The method as described in claim 5, characterized in that, The step of performing sharpness processing on the image source data acquired by the camera according to the image quality processing parameters to obtain the first image data includes: The acquisition resolution of the image source data is compressed to the requested resolution to obtain the third image data; The third image data is processed for sharpness based on the image quality processing parameters to obtain the first image data.

7. An image optimization device, characterized in that, The device includes: The receiving module is used to receive first image data sent by the camera processing system. The first image data is obtained by the camera processing system performing sharpness processing on the image source data captured by the camera according to the requested resolution set by the display terminal. A decoding module is used to decode the first image data to obtain the decoded second image data; The parameter confirmation module is used to obtain a resolution calibration parameter database corresponding to the screen resolution of the display terminal. The resolution calibration parameter database stores the correspondence between resolution calibration parameters and resolution. The module obtains the resolution calibration parameters corresponding to the requested resolution from the resolution calibration parameter database and confirms them as the resolution calibration parameters of the second image data, wherein the requested resolution is lower than the screen resolution of the display terminal. The first sharpness processing module is used to process the second image data using the sharpness adjustment parameters to obtain the third image data, and to render and display the third image data.

8. An image optimization device, characterized in that, The device includes: The image acquisition module is used to acquire image source data captured by the camera in response to an image acquisition request; The second sharpness processing module is used to perform sharpness processing on the image source data according to the requested resolution set in the image acquisition request, so as to obtain the first image data; The transmission module is used to transmit the first image data to the display end specified by the image acquisition request, so that the display end can perform sharpness processing on the first image data according to the sharpness adjustment parameters corresponding to the requested resolution; the sharpness adjustment parameters are sharpness adjustment parameters corresponding to the requested resolution obtained from the sharpness adjustment parameter database corresponding to the screen resolution of the display end; the sharpness adjustment parameter database stores the correspondence between sharpness adjustment parameters and resolutions.

9. An electronic device, characterized in that, include: Processor and memory; The memory stores a computer program adapted to be loaded by the processor and to execute the steps of the method as described in any one of claims 1 to 6.

10. A computer storage medium, characterized in that, The computer storage medium stores a computer program that, when executed by a processor, implements the steps of the method as described in any one of claims 1 to 6.

Images