Image optimization method and device, equipment and storage medium

Abstract

The embodiment of the invention provides an image optimization method, device and equipment and a computer storage medium, and the method comprises the steps: responding to an image obtaining request through a camera processing system, obtaining image source data collected by a camera, carrying out the definition processing of the image source data according to a request resolution set in the image obtaining request, and obtaining the image source data; the method comprises the following steps: receiving an image acquisition request from a camera processing system to obtain first image data, transmitting the first image data to a display end specified by the image acquisition request, receiving the first image data sent by the camera processing system by the display end, decoding the first image data by the display end to obtain decoded second image data, and sending the decoded second image data to the display end. The display end confirms the definition adjustment parameter of the second image data according to the request resolution, the display end processes the second image data by adopting the definition adjustment parameter to obtain the third image data, and the third image data is rendered and displayed, so that the request resolution is displayed more clearly on a higher-resolution large screen of the display end; and the image display effect of the display end is improved.

Description

Technical Field

[0001] The present invention relates to the field of image processing technology, and in particular to an image optimization method, device, equipment and computer storage medium. Background Art

[0002] With the development of intelligent technology and network communication, people can watch live broadcasts, participate in online meetings and learn online. At the same time, in order to provide a clearer video viewing experience, high-definition display screens have also emerged.

[0003] However, when the network signal is poor or the image quality captured by the camera is low, the image resolution transmitted to the high-definition display is often lower than the resolution of the screen itself. At this time, the low-resolution image is usually processed so that the low-resolution image can be displayed on screens of different resolutions, such as stretching the low-resolution image to the screen resolution. However, this method is prone to image distortion, which greatly reduces the image display effect on the screen. For example, when the 1080p resolution video or image output by the camera is displayed on a 4k screen, there will be poor clarity. Summary of the invention

[0004] The main purpose of this specification is to provide an image optimization method, device, equipment and storage medium, aiming to improve the image display clarity. The technical solution is as follows:

[0005] In a first aspect, an embodiment of the present specification provides an image optimization method, which is applied to a display terminal and includes:

[0006] Receiving first image data sent by a camera processing system, where the first image data is obtained by the camera processing system performing definition processing on image source data collected by the camera according to a requested resolution set by the display terminal;

[0007] Decoding the first image data to obtain decoded second image data;

[0008] Determining a definition adjustment parameter of the second image data according to a requested resolution, wherein the requested resolution is lower than a screen resolution of the display end;

[0009] The second image data is processed using the clarity adjustment parameter to obtain third image data, and the third image data is rendered and displayed.

[0010] In a second aspect, an embodiment of this specification provides an image optimization method, which is applied to a camera processing system, including:

[0011] In response to the image acquisition request, acquiring image source data collected by the camera;

[0012] Performing definition processing on the image source data according to the requested resolution set in the image acquisition request to obtain first image data;

[0013] The first image data is transmitted to a display end specified by the image acquisition request, so that the display end performs definition processing on the first image data according to a definition adjustment parameter corresponding to the requested resolution.

[0014] In a third aspect, the embodiments of this specification provide an image optimization device, including:

[0015] A receiving module, used for receiving first image data sent by a camera processing system, wherein the first image data is obtained by the camera processing system performing definition processing on image source data collected by the camera according to a requested resolution set by the display terminal;

[0016] A decoding module, used for decoding the first image data to obtain decoded second image data;

[0017] A parameter confirmation module, used to confirm the clarity adjustment parameters of the second image data according to the requested resolution, wherein the requested resolution is lower than the screen resolution of the display end;

[0018] The first definition processing module is used to process the second image data using the definition adjustment parameters to obtain the third image data, and render and display the third image data.

[0019] In a fourth aspect, an embodiment of the present specification provides an image optimization device, including:

[0020] An image acquisition module, used to obtain image source data acquired by a camera in response to an image acquisition request;

[0021] A second definition processing module, used for performing definition processing on the image source data according to the requested resolution set in the image acquisition request to obtain first image data;

[0022] The transmission module is used to transmit the first image data to the display end specified by the image acquisition request, so that the display end performs definition processing on the first image data according to the definition adjustment parameters corresponding to the requested resolution.

[0023] In a fifth aspect, an embodiment of the present specification provides an electronic device, the electronic device comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the steps of the above method are implemented when the computer program is executed by the processor.

[0024] In a sixth aspect, an embodiment of the present specification provides a computer storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the above method are implemented.

[0025] In an embodiment of the present specification, the camera processing system responds to an image acquisition request to acquire image source data collected by the camera, the camera processing system performs clarity processing on the image source data according to the requested resolution set in the image acquisition request to obtain first image data, transmits the first image data to the display end specified by the image acquisition request, the display end receives the first image data sent by the camera processing system, the display end decodes the first image data to obtain decoded second image data, the display end confirms the clarity adjustment parameters of the second image data according to the requested resolution, the display end processes the second image data using the clarity adjustment parameters to obtain third image data, and renders and displays the third image data. Different clarity optimization parameters are used for images of different resolutions on the display end side and the camera processing system side, thereby achieving characteristic optimization processing of image quality, so that low-resolution images are displayed more clearly on screens with higher resolutions than those with lower resolutions. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the embodiments of this specification or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0027] Figure 1 is a schematic diagram of an application environment of an image optimization method provided in an embodiment of this specification;

[0028] Figure 2 It is a flowchart of an image optimization method provided in an embodiment of this specification;

[0029] Figure 3 is an example schematic diagram of an image optimization method provided in an embodiment of this specification;

[0030] Figure 4 is an example schematic diagram of an image optimization method provided in an embodiment of this specification;

[0031] Figure 5 It is a flowchart of an image optimization method provided in an embodiment of this specification;

[0032] Figure 6 is a structural schematic diagram of an image optimization device provided in an embodiment of this specification;

[0033] Figure 7 is a structural schematic diagram of an image optimization device provided in an embodiment of this specification;

[0034] Figure 8 is a structural schematic diagram of an image optimization device provided in an embodiment of this specification;

[0035] Fig. 9 It is a structural schematic diagram of an electronic device provided in an embodiment of this specification. DETAILED DESCRIPTION

[0036] The following will be combined with the drawings in the embodiments of this specification to clearly and completely describe the technical solutions in the embodiments of this specification. Obviously, the described embodiments are only part of the embodiments of this specification, not all of the embodiments. Based on the embodiments in this specification, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this specification.

[0037] See also Figure 1 , which is a schematic diagram of an application environment of an image optimization method provided in an embodiment of this specification. The application environment of the image optimization method in one embodiment of the present application includes an interactive tablet 1, which can be composed of two or more physical entities or one physical entity. From a hardware perspective, the hardware to which the interactive tablet 1 refers is essentially a computer device with the equivalent capabilities of a personal computer, which has a hardware device with necessary components disclosed by the von Neumann principle, such as a central processing unit (including an arithmetic unit and a controller), a memory, an input device, and an output device; wherein the computer program is stored in the memory, and the central processing unit calls the computer program stored in the memory to run, executes the instructions in the computer program, and interacts with the input and output devices to complete specific functions. Among them, the interactive tablet 1 is provided with a display screen, and a display area 2 is provided on the display screen for displaying image data, and the image data can be a picture or a video, without specific limitation.

[0038] For ease of understanding, the interactive tablet 1 is used as an application environment for exemplary description in the embodiment. Among them, the interactive tablet 1 can be an integrated device that controls the content displayed on the interactive tablet 1 and realizes human-computer interaction through touch technology, which integrates one or more functions such as a projector, an electronic whiteboard, a screen, an audio system, a television, and a video conferencing terminal. Typically, the interactive tablet is installed with at least one type of operating system, wherein the operating system includes but is not limited to an Android system, a Linux system, and a Windows system. In one embodiment, the interactive tablet 1 can install at least one application based on the operating system. In the embodiment, an exemplary description is given with a whiteboard application with a video conferencing function. Among them, the whiteboard application can be an application that comes with the operating system, or it can be an application downloaded from a third-party device or server. Optionally, in addition to the video conferencing function, the whiteboard application can also have a writing function, a screen projection function, etc. The interactive tablet can conduct an online meeting with a remote terminal device through the whiteboard application through the server. On the interactive tablet side, the user accesses an external signal source on the interactive tablet to display the screen content of the signal source on the interactive tablet, and operates the interactive tablet to share the desktop screen of the external signal source to the remote terminal device. Optionally, the interactive tablet can also obtain other types of image data through the whiteboard application, such as surveillance video data, classroom teaching videos, etc. In actual applications, there is no restriction on the type of image data.

[0039] Among them, in order to realize the collection of conference images, the interactive tablet 1 can be equipped with a built-in or external camera to shoot and record the internal scenes of the conference room, and transmit the original image signal captured by the camera to the camera processing system; optionally, the camera can also have a recording function to collect sound information in the conference room. It can be understood that in actual applications, the camera may not be in the same space as the interactive tablet, and any camera can be used to collect image data outside the space where the interactive tablet is located, and the camera processing system performs image processing and transmits it to the interactive tablet.

[0040] In the related art, when playing videos, multiple resolutions (definition options) such as 1080P, 720P, 480P, etc. are usually provided, so that people can switch video resolutions according to different meeting situations, network conditions, and viewing effect requirements to meet people's needs for different display screens. In an exemplary application scenario, if a 4K camera is turned on during a meeting and 1080P resolution is selected in the whiteboard application, the application will request a video stream from the camera. At this time, a camera processing system, such as an ISP (Image Signal Processor), is used to process and optimize the original image signal captured from the camera and output the video of the requested resolution. The display end decodes and renders the received video stream data and displays it on the screen. It can be understood that in order to provide users with clearer videos, the highest video recording resolution supported by the camera can reach 4K to capture more video details from the video source. At the same time, in order to provide better display effects, the screen of the display end can be displayed on a large screen that supports 4K resolution. When the network signal is poor, or the user requests a video with a resolution lower than 4K, the camera processing system uses the ISP parameters corresponding to the 4K resolution to process the black and white raw format image output by the image sensor in the camera, and then compresses the image (for example, the graphics acceleration engine RGA (Raster Graphic Acceleration Unit) can be used) to output it to the display end with a resolution of 1080P. The display end directly decodes and renders the received 1080P video stream data and displays it on the 4K large screen. Using this processing method to display low-resolution videos on a high-resolution screen is equivalent to stretching the 1080P picture, resulting in poor display clarity. Especially for large-size interactive tablets, when displaying low-resolution videos, the problems of blur and distortion are more obvious. Therefore, how to improve the clarity of low-resolution videos displayed on larger resolution screens and improve user perception is an urgent problem to be solved.

[0041] In response to the above problems, the present application proposes an image optimization method. According to the requested resolution required by the user, the clarity optimization can be performed twice at the display end and the ISP end (camera processing system), respectively. The camera processing system performs a clarity optimization on the collected image source data once to obtain the first image data. When the display end receives the first image data, it can confirm the resolution (requested resolution) of the received first image data, and provide a set of corresponding clarity adjustment parameters for decoding and rendering according to the resolution, so that the video stream or picture can adapt to the screen resolution of the current display end, so that the requested resolution (such as 1080p) can be displayed more clearly on the large screen with higher resolution (such as 4k) at the display end. Different from the related art, the camera processing system performs unified optimization on all resolutions. For example, if the camera acquisition resolution is 4K, the optimization parameters corresponding to 4K are used, that is, there is only one set of ISP parameters, which cannot meet the problem of high-definition clarity requirements of other resolutions. The optimization method of the present application can adapt to different resolutions for characteristic clarity processing, thereby improving the display effect of images at various clarity on the large screen.

[0042] The image optimization method provided in this specification is described in detail below in conjunction with specific embodiments.

[0043] See also Figure 2 , is a flow chart of an image optimization method provided in the embodiment of this specification. Figure 2 As shown, the embodiment of the present application jointly describes the specific process of the image optimization method from the display end side and the camera processing system side, and the method may include the following steps S101-S104.

[0044] S101, a camera processing system obtains image source data collected by a camera in response to an image acquisition request;

[0045] In one embodiment, when the camera processing system receives an image acquisition request sent by the display end, the image source data captured by the camera can be acquired. Specifically, the image acquisition request can be triggered by the user in the whiteboard application of the interactive tablet, for example, when the user clicks on the confirmation button of the related image receiving function such as start shooting, start meeting, start receiving, etc. It should be noted that the image acquisition request can also be triggered by the application in the terminal device, that is, the terminal device controls the camera processing system and the display end. Among them, the camera processing system is mainly used for image acquisition, the display end device is mainly used for image display, the terminal device is used to request image data from the camera, and can transmit the image data to the display end; or the terminal device controls the camera to output image data of a specific resolution to the display end.

[0046] Optionally, the image acquisition request also includes the requested camera identifier, so as to start the corresponding camera to collect image source data, or confirm the image source data to be displayed on the display end from multiple working cameras. For example, if there are multiple cameras with different shooting angles, one or more cameras can be identified to obtain the image source data collected. Multiple image source data can be processed by the same camera processing system, or they can be processed by different camera processing systems.

[0047] S102, the camera processing system performs definition processing on the image source data according to the requested resolution set in the image acquisition request to obtain first image data;

[0048] In one embodiment, when the user turns on the image receiving function, the application can automatically set the requested definition and generate an image acquisition request based on the network conditions, the processing power of the display end processor, the application scenario (e.g., a high-definition requirement scenario or a high-smoothness requirement scenario), etc. Optionally, a resolution selection control can be provided in the application for the user to set the requested resolution by himself, and the upper limit of the resolution selection is the highest video recording / picture shooting resolution supported by the camera.

[0049] Specifically, the camera processing system may include an ISP module. A black and white raw image is output from the image sensor (Sensor) of the camera. The ISP module adds color, sharpens the details, enhances the image, and obtains the first image data after processing. In the related art, the camera processing system uniformly optimizes all resolutions. For example, if the camera acquisition resolution is 4K, 4K optimization parameters are used. There is only one set of ISP parameters, which cannot meet the high-definition requirements of other resolutions and clarity. In this embodiment, the ISP module uses a clarity enhancement algorithm or clarity enhancement parameter corresponding to the requested resolution to perform clarity processing according to the requested resolution during processing, so as to obtain the first image data with a resolution of the requested resolution after clarity processing. Among them, using a clarity enhancement algorithm or clarity enhancement parameter corresponding to the requested resolution for clarity processing is to perform an IQ (image quality, image quality) parameter debugging for clarity. It can be understood that for images with different resolutions, the required IQ parameters are different. For example, for images with lower resolutions, the sharpening degree required is higher. Therefore, different IQ parameters (or ISP parameters) can be set for different resolutions to maximize the image quality.

[0050] S103, transmitting the first image data to a display terminal specified by the image acquisition request, so that the display terminal performs definition processing on the first image data according to a definition adjustment parameter corresponding to the requested resolution;

[0051] In one embodiment, after the camera processing system outputs the first image data, it is transmitted to the display end indicated by the image acquisition request. It is understandable that the image acquisition request may include a receiving device identifier to confirm which device the camera processing system needs to transmit the first image data to. For example, the first image data may be directly transmitted to the display end. For another example, the first image data is transmitted to the terminal device, and then the terminal device transmits the first image data to the display end.

[0052] S104, the display terminal receives first image data sent by the camera processing system, where the first image data is obtained by the camera processing system performing definition processing on image source data collected by the camera according to a requested resolution set by the display terminal;

[0053] In one embodiment, the display terminal receives the first image data sent by the camera processing system. The display terminal and the camera can be connected by HDMI, USB, or a network cable.

[0054] S105, the display end decodes the first image data to obtain decoded second image data;

[0055] In one embodiment, the first image data is usually not a real image, but binary data obtained after encoding for easy transmission, so the first image data needs to be decoded first to obtain the second image data.

[0056] S106, the display end confirms the clarity adjustment parameter of the second image data according to the requested resolution, wherein the requested resolution is lower than the screen resolution of the display end;

[0057] In one embodiment, the display end obtains a definition adjustment parameter corresponding to the requested resolution for the second image data to perform definition processing on the second image data. It is understandable that a set of image parsing parameters is usually configured for the screen for parsing the image stream data. For example, a 4K screen will have a set of parameters. Regardless of the resolution of the received image data, the display parameters of the 4K screen will be used for display, which will cause the image data to be incompatible and unmatched with the screen, making the image seen by the user on the screen unclear. In this embodiment, the definition adjustment parameter corresponding to the requested resolution can be confirmed according to the requested resolution of the first image data, and the first image data can be adjusted using the parameter. The definition adjustment parameter is used to adjust the factors affecting the picture quality, and the factors affecting the picture quality include sharpness, signal-to-noise ratio, color, dynamic range, etc. The key indicators that usually affect the picture clarity are sharpness, noise and gamma, where gamma represents the distortion of the output image of the display to the input signal. Therefore, in some feasible implementations, the definition adjustment parameters mainly include parameters for adjusting sharpness, noise and gamma.

[0058] It should be noted that this embodiment mainly focuses on the implementation process of displaying a low-resolution image on a high-resolution screen, so the requested resolution is lower than the screen resolution of the display end. It is understandable that when displaying a high-resolution image on a low-resolution screen, the image processing method provided in this embodiment can also be used according to actual needs, that is, the clarity adjustment parameters are in one-to-one correspondence with the resolution.

[0059] S107, the display end processes the second image data using the definition adjustment parameter to obtain third image data, and renders and displays the third image data.

[0060] In one embodiment, the display end processes the second image data using the definition adjustment parameter to obtain the third image data, and renders the third image data to obtain the final displayed image information.

[0061] For details, see Figure 3 , Figure 3 An example schematic diagram of an image optimization method provided in the embodiments of this specification is as follows: Figure 3 As shown, the image optimization method provided in the embodiment of the present specification can be implemented in the following manner: when the camera processing system receives an image acquisition request sent by the display end, the camera can send image source data to the camera processing system, the camera processing system processes the image source data according to the requested resolution in the image acquisition request to generate first image data, transmits the first image data to the display end, the display end decodes the first image data, and obtains clarity adjustment parameters according to the requested resolution, uses the clarity adjustment parameters to perform clarity enhancement processing on the second image data, and renders and displays the second image data.

[0062] For details, see Figure 4 , Figure 4 An example schematic diagram of an image optimization method provided in the embodiments of this specification is as follows: Figure 4 As shown, the image optimization method provided in the embodiment of the present specification can be implemented in the following manner: when the camera processing system receives an image acquisition request sent by an application (terminal device), the camera processing system obtains image source data from the camera, and the camera processing system processes the image source data according to the requested resolution in the image acquisition request to generate first image data, and transmits the first image data to the application, which transmits the first image data to the display end, and the display end decodes the first image data, and obtains clarity adjustment parameters according to the requested resolution, uses the clarity adjustment parameters to perform clarity enhancement processing on the second image data, and renders and displays the second image data.

[0063] In the embodiment of the present specification, the camera processing system responds to the image acquisition request to obtain the image source data collected by the camera, the camera processing system performs definition processing on the image source data according to the requested resolution set in the image acquisition request to obtain the first image data, and transmits the first image data to the display end specified by the image acquisition request, the display end receives the first image data sent by the camera processing system, the display end decodes the first image data to obtain the decoded second image data, the display end confirms the definition adjustment parameters of the second image data according to the requested resolution, the display end processes the second image data using the definition adjustment parameters to obtain the third image data, and renders and displays the third image data. By performing characteristic processing on the requested image data of different resolutions, that is, the camera processing system and the display end both use the definition processing method corresponding to the requested resolution to process the image data, so that the requested resolution is displayed more clearly on the larger screen with higher resolution on the display end, thereby improving the image display effect on the display end.

[0064] See also Figure 5 , is a flow chart of an image optimization method provided in the embodiment of this specification. Figure 5 As shown, the embodiment of the present application describes the specific process of the image optimization method from the display end side, and the method may include the following steps S201-S205.

[0065] S201, sending an image acquisition request to a camera processing system to obtain first image data after definition processing by the camera processing system, wherein the image acquisition request includes a requested resolution;

[0066] In one embodiment, the display end may generate an image acquisition request and send it to the camera processing system.

[0067] Optionally, before the display terminal sends the image acquisition request to the camera processing system, the display terminal may further include: confirming the requested resolution in response to a definition selection operation in the display terminal application; and generating the image acquisition request based on the requested resolution. Specifically, the display terminal may be provided with an application, a definition selection control is provided in the application, and the requested resolution is confirmed in response to a user's operation on the definition selection control.

[0068] S202, decoding the first image data to obtain decoded second image data;

[0069] S203, obtaining a definition adjustment parameter database corresponding to the screen resolution of the display terminal, wherein the definition adjustment parameter database stores a correspondence between definition adjustment parameters and resolution;

[0070] It is understandable that when the image resolution is adjusted to match the screen resolution, the calibration parameters used will change due to changes in the image resolution and the screen resolution. For example, the calibration parameters used to display 1080P on a 4K screen are different from those used to display 1080P on a 2K screen. Therefore, according to different screen resolutions, a corresponding clarity calibration parameter database can be obtained so that the clarity improvement process can be accurately performed. For example, if the screen is a 4K screen, a clarity calibration parameter database corresponding to the 4K screen can be obtained. If the screen is a 2K screen, a clarity calibration parameter database corresponding to the 2K screen can be obtained. The clarity calibration parameter database stores the correspondence between the clarity calibration parameters and the resolution. For example, the 4K clarity calibration parameter database can store the clarity calibration parameters corresponding to 1080P: PQ (picture quality) parameter 1, and the clarity calibration parameters corresponding to 720P: PQ parameter 2.

[0071] S204, acquiring a definition adjustment parameter corresponding to the requested resolution from a definition adjustment parameter database, and confirming the definition adjustment parameter as the definition adjustment parameter of the second image data;

[0072] Specifically, the definition adjustment parameter database can be stored in the display terminal, or in the cloud, or in other terminal devices, and is not specifically limited. According to the requested resolution, the display terminal can query the definition adjustment parameter database to obtain the corresponding definition adjustment parameters.

[0073] In one embodiment, based on the same concept as above, on the camera processing system side, when the image source data collected by the camera is processed for clarity according to the image quality processing parameter to obtain the first image data, the following steps S301-S302 may be included:

[0074] S301, based on a preset mapping relationship between resolution and clarity parameters, confirming image quality processing parameters corresponding to the requested resolution;

[0075] S302: Perform clarity processing on image source data collected by a camera according to an image quality processing parameter to obtain first image data.

[0076] Specifically, the camera processing system may store a mapping relationship between resolution and clarity parameters, wherein the clarity parameter is also an image quality processing (IQ) parameter, which is used to process the image signal (i.e., image source data) output from the sensor to improve the image quality. According to the pre-stored mapping relationship, the image quality processing parameter corresponding to the requested resolution may be confirmed, and the image source data collected by the camera may be processed for clarity according to the image quality processing parameter to obtain the first image data.

[0077] Optionally, performing definition processing on the image source data acquired by the camera according to the image quality processing parameter to obtain the first image data includes: compressing the acquisition resolution of the image source data to the requested resolution to obtain the third image data; performing definition processing on the third image data according to the image quality processing parameter to obtain the first image data. In a feasible implementation, the camera processing system may first compress (scale) the image source data to obtain the third image data, and then perform definition processing on the third image data according to the image quality processing parameter.

[0078] S205, using the definition adjustment parameter to process the second image data to obtain third image data, and rendering and displaying the third image data.

[0079] Specifically, the second image data is processed according to the definition adjustment parameters confirmed from the definition adjustment parameter database to obtain the third image data, and the third image data is rendered and displayed.

[0080] In the embodiment of the present specification, an image acquisition request is sent to the camera processing system through the display end to obtain the first image data after the clarity processing of the camera processing system, the first image data is decoded to obtain the decoded second image data, a clarity adjustment parameter database corresponding to the screen resolution of the display end is obtained, and the clarity adjustment parameters corresponding to the requested resolution are obtained from the clarity adjustment parameter database, which are confirmed as the clarity adjustment parameters of the second image data, and the second image data is processed using the clarity adjustment parameters to obtain the third image data, and the third image data is rendered and displayed. The clarity adjustment parameters of the requested resolution are obtained through the pre-constructed clarity adjustment parameter database, and the image is adaptively processed for clarity to improve the effect of the clarity processing and display a clearer image on the screen of the display end.

[0081] The following will be combined with the attached Figure 6-8 , the image optimization device provided in the embodiment of this specification is introduced in detail. It should be noted that the attached Figure 6-8 The image optimization device in this manual is used to execute Figure 2-Figure 5 For the convenience of explanation, only the part related to the embodiment of this specification is shown. For the specific technical details not disclosed, please refer to this specification. Figure 2-Figure 5 The embodiment shown.

[0082] See also Figure 6, which shows a schematic diagram of the structure of an image optimization device provided by an exemplary embodiment of the present specification. The image optimization device can be implemented as all or part of the device through software, hardware or a combination of both. The device 1 includes a receiving module 11, a decoding module 12, a parameter confirmation module 13, and a first definition processing module 14.

[0083] The receiving module 11 is used to receive first image data sent by the camera processing system, where the first image data is obtained by the camera processing system performing definition processing on the image source data collected by the camera according to the requested resolution set by the display terminal;

[0084] A decoding module 12, configured to decode the first image data to obtain decoded second image data;

[0085] A parameter confirmation module 13, used to confirm the clarity adjustment parameters of the second image data according to the requested resolution, wherein the requested resolution is lower than the screen resolution of the display end;

[0086] The first definition processing module 14 is used to process the second image data using the definition adjustment parameters to obtain the third image data, and render and display the third image data.

[0087] Optional, see Figure 7 , is a schematic diagram of the structure of an image optimization device provided by an exemplary embodiment of this specification. Figure 7 As shown, the image optimization device also includes a sending module 15, which is used to send an image acquisition request to the camera processing system to obtain the first image data after the clarity processing of the camera processing system, wherein the image acquisition request includes a requested resolution.

[0088] Optionally, the sending module 15 is specifically configured to respond to a definition selection operation in the display end application and confirm the requested resolution;

[0089] Generates an image fetch request based on the requested resolution.

[0090] Optionally, the parameter confirmation module 13 is specifically used to obtain a definition adjustment parameter database corresponding to the screen resolution of the display terminal, and the definition adjustment parameter database stores a corresponding relationship between the definition adjustment parameters and the resolution;

[0091] A definition adjustment parameter corresponding to the requested resolution is obtained from a definition adjustment parameter database and is confirmed as the definition adjustment parameter of the second image data.

[0092] See also Figure 8, which shows a schematic diagram of the structure of an image optimization device provided by an exemplary embodiment of the present specification. The image optimization device can be implemented as all or part of the device through software, hardware or a combination of both. The device 2 includes an image acquisition module 21, a second definition processing module 22, and a transmission module 23.

[0093] The image acquisition module 21 is used to obtain the image source data acquired by the camera in response to the image acquisition request;

[0094] A second definition processing module 22, configured to perform definition processing on the image source data according to the requested resolution set in the image acquisition request, so as to obtain first image data;

[0095] The transmission module 23 is used to transmit the first image data to the display end specified by the image acquisition request, so that the display end performs definition processing on the first image data according to the definition adjustment parameters corresponding to the requested resolution.

[0096] Optionally, the second definition processing module 22 is specifically used to confirm the image quality processing parameter corresponding to the requested resolution based on a preset mapping relationship between resolution and definition parameters;

[0097] The image source data collected by the camera is processed for clarity according to the image quality processing parameter to obtain the first image data.

[0098] Optionally, the second definition processing module 22 is specifically used to compress the acquisition resolution of the image source data to the requested resolution to obtain the third image data;

[0099] The third image data is processed for clarity according to the image quality processing parameter to obtain the first image data.

[0100] It should be noted that the image optimization device provided in the above embodiment only uses the division of the above functional modules as an example when executing the image optimization method. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the image optimization device provided in the above embodiment and the image optimization method embodiment belong to the same concept, and the implementation process thereof is detailed in the method embodiment, which will not be repeated here.

[0101] The serial numbers of the embodiments of the present specification are for description only and do not represent the advantages and disadvantages of the embodiments. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0102] The embodiment of the present specification also provides a computer storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the above-mentioned Figure 2-Figure 5 The image optimization method of the embodiment shown in the figure can be found in the specific execution process. Figure 2-Figure 5 The specific description of the illustrated embodiment will not be repeated here.

[0103] Please refer to Fig. 9 , which shows a schematic diagram of the structure of an electronic device provided by an exemplary embodiment of this specification. The electronic device in this specification may include one or more of the following components: a processor 110, a memory 120, an input device 130, an output device 140, and a bus 150. The processor 110, the memory 120, the input device 130, and the output device 140 may be connected via the bus 150.

[0104] The processor 110 may include one or more processing cores. The processor 110 uses various interfaces and lines to connect various parts of the entire electronic device, and executes various functions and processes data of the terminal 100 by running or executing instructions, programs, code sets or instruction sets stored in the memory 120, and calling data stored in the memory 120. Optionally, the processor 110 can be implemented in at least one hardware form of digital signal processing (DSP), field-programmable gate array (FPGA), and programmable logic array (PLA). The processor 110 can integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. Among them, the CPU mainly processes the operating system, user pages, and applications; the GPU is responsible for rendering and drawing display content; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 110, but may be implemented separately through a communication chip.

[0105] The memory 120 may include a random access memory (RAM) or a read-only memory (ROM). Optionally, the memory 120 includes a non-transitory computer-readable medium (Non-Transitory Computer-Readable Storage Medium). The memory 120 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 120 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc. The operating system may be an Android system, including a system deeply developed based on the Android system, an IOS system developed by Apple, including a system deeply developed based on the IOS system or other systems.

[0106] The memory 120 can be divided into an operating system space and a user space. The operating system runs in the operating system space, and native and third-party applications run in the user space. In order to ensure that different third-party applications can achieve good operating results, the operating system allocates corresponding system resources to different third-party applications. However, the requirements for system resources in different application scenarios in the same third-party application are also different. For example, in the local resource loading scenario, the third-party application has higher requirements for disk reading speed; in the animation rendering scenario, the third-party application has higher requirements for GPU performance. The operating system and third-party applications are independent of each other, and the operating system often cannot perceive the current application scenario of the third-party application in a timely manner, resulting in the operating system being unable to perform targeted system resource adaptation according to the specific application scenario of the third-party application.

[0107] In order for the operating system to distinguish the specific application scenarios of third-party applications, it is necessary to open up data communication between third-party applications and the operating system so that the operating system can obtain the current scenario information of third-party applications at any time, and then perform targeted system resource adaptation based on the current scenario.

[0108] The input device 130 is used to receive input commands or data, and includes but is not limited to a keyboard, a mouse, a camera, a microphone, or a touch device. The output device 140 is used to output commands or data, and includes but is not limited to a display device and a speaker. In one example, the input device 130 and the output device 140 can be combined, and the input device 130 and the output device 140 are touch screen displays.

[0109] The touch display screen can be designed as a full screen, a curved screen or a special-shaped screen. The touch display screen can also be designed as a combination of a full screen and a curved screen, or a combination of a special-shaped screen and a curved screen, which is not limited in the embodiments of this specification.

[0110] In addition, those skilled in the art can understand that the structure of the electronic device shown in the above drawings does not constitute a limitation on the electronic device, and the electronic device may include more or fewer components than shown, or combine certain components, or arrange the components differently. For example, the electronic device also includes components such as a radio frequency circuit, an input unit, a sensor, an audio circuit, a WiFi module, a power supply, and a Bluetooth module, which will not be described in detail here.

[0111] exist Fig. 9 In the electronic device shown, the processor 110 may be used to call a computer application stored in the memory 120 and specifically perform the following operations:

[0112] Receiving first image data sent by a camera processing system, where the first image data is obtained by the camera processing system performing definition processing on image source data collected by the camera according to a requested resolution set by the display terminal;

[0113] Decoding the first image data to obtain decoded second image data;

[0114] Determining a definition adjustment parameter of the second image data according to a requested resolution, wherein the requested resolution is lower than a screen resolution of the display end;

[0115] The second image data is processed using the clarity adjustment parameter to obtain third image data, and the third image data is rendered and displayed.

[0116] In one embodiment, the processor 110 further performs the following operations:

[0117] An image acquisition request is sent to the camera processing system to obtain first image data after definition processing by the camera processing system, wherein the image acquisition request includes a requested resolution.

[0118] In one embodiment, the processor 110 further performs the following operations:

[0119] In response to a definition selection operation in the display end application, confirming the requested resolution;

[0120] Generates an image fetch request based on the requested resolution.

[0121] In one embodiment, the processor 110 further performs the following operations:

[0122] In response to the image acquisition request, acquiring image source data collected by the camera;

[0123] Performing definition processing on the image source data according to the requested resolution set in the image acquisition request to obtain first image data;

[0124] The first image data is transmitted to a display end specified by the image acquisition request, so that the display end performs definition processing on the first image data according to a definition adjustment parameter corresponding to the requested resolution.

[0125] In one embodiment, when the processor 110 performs the definition processing on the image source data according to the requested resolution set in the image acquisition request to obtain the first image data, the processor 110 specifically performs the following operations:

[0126] Based on a preset mapping relationship between resolution and clarity parameters, confirm image quality processing parameters corresponding to the requested resolution;

[0127] The image source data collected by the camera is processed for clarity according to the image quality processing parameter to obtain the first image data.

[0128] In one embodiment, when the processor 110 performs the definition processing on the image source data collected by the camera according to the image quality processing parameter to obtain the first image data, the processor 110 specifically performs the following operations:

[0129] Compressing the acquisition resolution of the image source data to the requested resolution to obtain third image data;

[0130] The third image data is processed for clarity according to the image quality processing parameter to obtain the first image data.

[0131] In the embodiment of the present specification, the camera processing system responds to the image acquisition request to obtain the image source data collected by the camera, the camera processing system performs definition processing on the image source data according to the requested resolution set in the image acquisition request to obtain the first image data, and transmits the first image data to the display end specified by the image acquisition request, the display end receives the first image data sent by the camera processing system, the display end decodes the first image data to obtain the decoded second image data, the display end confirms the definition adjustment parameters of the second image data according to the requested resolution, the display end processes the second image data using the definition adjustment parameters to obtain the third image data, and renders and displays the third image data. By performing characteristic processing on the requested image data of different resolutions, that is, the camera processing system and the display end both use the definition processing method corresponding to the requested resolution to process the image data, so that the requested resolution is displayed more clearly on the larger screen with higher resolution on the display end, thereby improving the image display effect on the display end.

[0132] Furthermore, an image acquisition request is sent to the camera processing system through the display end to obtain the first image data after the clarity processing of the camera processing system, the first image data is decoded to obtain the decoded second image data, a clarity adjustment parameter database corresponding to the screen resolution of the display end is obtained, the clarity adjustment parameters corresponding to the requested resolution are obtained from the clarity adjustment parameter database, the clarity adjustment parameters are confirmed as the clarity adjustment parameters of the second image data, the second image data is processed using the clarity adjustment parameters to obtain the third image data, and the third image data is rendered and displayed. The clarity adjustment parameters of the requested resolution are obtained through the pre-constructed clarity adjustment parameter database, and the image is adaptively processed for clarity to improve the effect of the clarity processing and display a clearer image on the screen of the display end.

[0133] In addition, an embodiment of the present specification provides a computer program product, which includes a computer program. When the computer program is executed by a processor of an electronic device, the processor can at least implement the above-mentioned Figures 2 to 5 The image optimization method provided in the illustrated embodiment.

[0134] A person skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing the relevant hardware through a computer program, and the above-mentioned program can be stored in a computer-readable storage medium, and when the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, the above-mentioned storage medium can be a disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc.

[0135] The above disclosure is only the preferred embodiment of this specification, which certainly cannot be used to limit the scope of rights of this specification. Therefore, equivalent changes made according to the claims of this specification are still within the scope covered by this specification.

Claims

1. An image optimization method, characterized in that: Applied to the display end, including: Receiving first image data sent by a camera processing system, wherein the first image data is obtained by the camera processing system performing definition processing on image source data collected by the camera according to a requested resolution set by the display terminal; Decoding the first image data to obtain decoded second image data; Determining a definition adjustment parameter of the second image data according to the requested resolution, wherein the requested resolution is lower than a screen resolution of the display terminal; The second image data is processed using the clarity adjustment parameter to obtain third image data, and the third image data is rendered and displayed.

2. The method according to claim 1, characterized in that The method further comprises: An image acquisition request is sent to a camera processing system to acquire first image data after definition processing by the camera processing system, wherein the image acquisition request includes a requested resolution.

3. The method according to claim 2, characterized in that The method further comprises: In response to a definition selection operation in the display application, confirming the requested resolution; An image acquisition request is generated based on the requested resolution.

4. The method according to claim 1, characterized in that The determining the definition adjustment parameter of the second image data according to the requested resolution includes: Acquire a definition adjustment parameter database corresponding to the screen resolution of the display terminal, wherein the definition adjustment parameter database stores a correspondence between definition adjustment parameters and resolution; A definition adjustment parameter corresponding to the requested resolution is obtained from a definition adjustment parameter database and confirmed as the definition adjustment parameter of the second image data.

5. An image optimization method, characterized in that: Applied to camera processing systems, including: In response to the image acquisition request, acquiring image source data collected by the camera; Performing definition processing on the image source data according to the requested resolution set in the image acquisition request to obtain first image data; The first image data is transmitted to a display end specified by the image acquisition request, so that the display end performs clarity processing on the first image data according to a clarity adjustment parameter corresponding to the requested resolution.

6. The method according to claim 5, characterized in that The performing definition processing on the image source data according to the requested resolution set in the image acquisition request to obtain the first image data includes: Based on a preset mapping relationship between resolution and clarity parameters, confirming image quality processing parameters corresponding to the requested resolution; The image source data collected by the camera is processed for clarity according to the image quality processing parameter to obtain first image data.

7. The method according to claim 6, characterized in that The step of performing definition processing on the image source data collected by the camera according to the image quality processing parameter to obtain the first image data includes: Compressing the acquisition resolution of the image source data to the requested resolution to obtain third image data; The third image data is processed for clarity according to the image quality processing parameter to obtain the first image data.

8. An image optimization device, characterized in that: The device comprises: A receiving module, used for receiving first image data sent by a camera processing system, wherein the first image data is obtained by the camera processing system performing definition processing on image source data collected by the camera according to a requested resolution set by the display terminal; A decoding module, used for decoding the first image data to obtain decoded second image data; a parameter confirmation module, configured to confirm a definition adjustment parameter of the second image data according to the requested resolution, wherein the requested resolution is lower than a screen resolution of the display terminal; The first definition processing module is used to process the second image data using the definition adjustment parameters to obtain third image data, and render and display the third image data.

9. An image optimization device, characterized in that: The device comprises: An image acquisition module, used to obtain image source data acquired by a camera in response to an image acquisition request; A second definition processing module, configured to perform definition processing on the image source data according to the requested resolution set in the image acquisition request, so as to obtain first image data; The transmission module is used to transmit the first image data to the display end specified by the image acquisition request, so that the display end performs definition processing on the first image data according to the definition adjustment parameters corresponding to the requested resolution.

10. An electronic device, characterized in that: include: Processor and memory; The memory stores a computer program, wherein the computer program is suitable for being loaded by the processor and executing the steps of the method according to any one of claims 1 to 7.

11. A computer storage medium, characterized in that: The computer storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images