Image display method and electronic device

Abstract

This application provides an image display method and an electronic device. In this method, the electronic device can display a scaled-down first image in response to a user's scaling operation on a first image. The scaled-down first image differs from the original first image in display parameters and / or image content details. Thus, the electronic device can adjust the image display effect according to the user's scaling operation during image display, thereby improving the user's viewing experience.

Description

Technical Field

[0001] This application relates to the field of electronic equipment technology, and in particular to an image display method and an electronic device. Background Technology

[0002] Currently, when capturing images or videos, the camera determines appropriate display parameters (such as color, brightness, etc.) based on the current shooting environment and the specific display screen (such as the camera's display screen) configuration, so that the captured images or videos can be displayed on the specific display screen in the current shooting environment to achieve a better display effect.

[0003] Whether it's an image directly captured or a picture from a video, the display effect is fixed once the image is captured at the camera. The display effect is not adjusted in any way during the subsequent display process on different display devices, which makes it impossible to guarantee the user's viewing experience. Summary of the Invention

[0004] This application provides an image display method and electronic device, which can adjust the display effect of the image according to the user's operation during the image display process, thereby improving the user's viewing experience.

[0005] Firstly, embodiments of this application provide an image display method, which can be applied to an electronic device, the electronic device including a display screen. Here, "electronic device" can refer to the electronic device itself, or to a processor, module, chip, or chip system within the electronic device that implements the method. The following description uses an electronic device as an example; the method includes the following steps:

[0006] An electronic device displays a first image on a display screen; in response to a zoom operation performed by a user on the first image, the electronic device displays a zoomed-out first image; wherein the zoomed-out first image differs from the first image in display parameters and / or image content details; the display parameters include at least one of the following: brightness, color, contrast, saturation, and sharpness.

[0007] This method allows the electronic device to display a scaled-down first image in response to a user's zoom operation on the displayed first image. The scaled-down first image differs from the original first image in display parameters and / or image content details. This allows the electronic device to adjust the image display effect based on the user's zoom operation during image display, thereby improving the user's viewing experience.

[0008] In one possible design, the electronic device may further generate the scaled first image by the following steps:

[0009] In response to the scaling operation, the electronic device acquires first display scene information and a target scaling ratio indicated by the scaling operation; wherein the first display scene information includes at least one of the following: configuration parameters of the display screen and illumination information in the current environment; then, the electronic device determines target display parameters based on the first display scene information and the target scaling ratio; finally, the electronic device generates the scaled first image based on the target display parameters.

[0010] Through this design, electronic devices can determine the target display parameters of the scaled first image based on the first display scene information that affects the image display effect and the target scaling ratio, thereby generating the scaled first image so that the scaled first image can achieve a better display effect in the current display scene, thereby improving the user's viewing experience.

[0011] In one possible design, the electronic device can determine the target display parameters based on the first display scene information and the target scaling ratio in the following manner:

[0012] Method 1: The electronic device acquires first metadata of the first image; wherein, the first metadata includes display parameters of the first image under multiple display scene information and multiple scaling ratios; and the target display parameters are determined in the first metadata according to the first display scene information and the target scaling ratio.

[0013] Method 2: The electronic device inputs the first display scene information and the target scaling ratio into the first calculation model to obtain the target display parameters; wherein, the first calculation model is used to indicate the correspondence between the display scene information, the scaling ratio of the image and the display parameters of the image.

[0014] With this design, the electronic device can determine the target display parameters of the first image based on the display parameter adjustment strategy indicated by the metadata in the first image or a local calculation model.

[0015] In one possible design, the target display parameters include: the target color of the image region corresponding to each light source information in the first image; the electronic device can determine the target display parameters based on the first display scene information and the target scaling ratio through the following steps:

[0016] The electronic device determines the color of light from at least one light source in the first image; then, based on the first display scene information, the target scaling ratio, and the color of light from each light source in the first image, the electronic device determines the target color of the image region corresponding to each light source in the first image.

[0017] With this design, electronic devices can adjust the color of the image area near the light source based on the color of the light source information of the first image, thereby increasing the realism of the scaled image.

[0018] In one possible design, the electronic device can also acquire the target scaling ratio indicated by the scaling operation; and when the target scaling ratio is greater than 100%, generate a scaled first image whose image content details differ from the first image in the following manner:

[0019] Method 1: The electronic device acquires the original image of the first image; wherein, the original image is the full image acquired by the image sensor during the capture of the first image without image processing; the bit depth of the original image is higher than that of the first image, and the image content detail of the original image is higher than that of the first image; the electronic device generates the scaled first image according to the target scaling ratio and the original image;

[0020] Method 2: The electronic device performs image recognition on the first image to obtain feature information of the first image; wherein, the feature information of the first image includes at least one of the following: the type of object in the first image, the outline of the object in the first image; the electronic device predicts the image content details of the scaled first image based on the target scaling ratio and the feature information of the first image; the electronic device generates the scaled first image based on the predicted image content details of the scaled first image, the target scaling ratio, and the first image;

[0021] Method 3: The electronic device inputs the first image and the target scaling ratio into the second calculation model to obtain the scaled first image; wherein, the second calculation model is used to enlarge the input image based on the input scaling ratio and increase the image content details of the input image.

[0022] This design allows electronic devices to enhance the detail of the enlarged first image in scenarios where magnification is required, thereby improving the user's viewing experience.

[0023] In one possible design, the electronic device can acquire the original image of the first image through the following steps:

[0024] The electronic device acquires second metadata of the first image; wherein the second metadata is the residual of the first image relative to the original image; and then determines the original image based on the first image and the second metadata.

[0025] With this design, the electronic device can recover the original image of the first image based on the metadata of the first image.

[0026] In one possible design, the first image is an image obtained by electro-optical conversion using a perceptually quantized PQ nonlinear photoelectric conversion curve. This reduces image data loss by using a PQ nonlinear photoelectric conversion curve (e.g., BT.1886), allowing the first image to retain more image data during image processing.

[0027] In one possible design, the first image has a bit depth of 12 bits, which allows the first image to retain more details and displays the information captured by the shooting device when the first image is displayed on a screen with various configuration parameters.

[0028] In one possible design, the first image is generated without adjusting the brightness or color of the original image; wherein the original image is the full image acquired by the image sensor during the capture of the first image without any image processing.

[0029] Since adjusting the brightness and color of the original image after acquiring it through the image sensor can also cause data loss in the original image, this design allows the camera to avoid adjusting the brightness and color of the original image when generating the first image, thereby reducing data loss in the original image and allowing the captured first image to retain more image data.

[0030] Secondly, embodiments of this application provide an electronic device including units for performing the steps of the method provided in the first aspect above. For example, the electronic device may include a display unit and a processing unit, wherein the display unit is used to display a user interface and the processing unit is used to implement the method provided in the first aspect.

[0031] Thirdly, embodiments of this application provide an electronic device including a processor and a memory; the processor is coupled to the memory and is configured to read a computer program stored in the memory to execute the method provided in the first aspect.

[0032] Fourthly, embodiments of this application provide a chip for reading a computer program stored in a memory and executing the method provided in the first aspect. Optionally, the chip may include a processor coupled to the memory for reading the computer program stored in the memory and implementing the method provided in the first aspect. Optionally, the chip may further include components such as a memory, a communication interface, and a power supply module. The memory is used to store the computer program, the communication interface is used to receive and send data, and the power supply module is used to supply power to the processor.

[0033] Fifthly, embodiments of this application also provide a chip system including a processor for supporting a computer device in implementing the methods provided in any of the above aspects. In one possible design, the chip system further includes a memory for storing programs and data necessary for the computer device. The chip system may be composed of chips or may include chips and other discrete devices.

[0034] In a sixth aspect, embodiments of this application provide a computer storage medium storing a computer program that, when run on an XR device, causes the computer to execute the method provided in the first aspect.

[0035] In a seventh aspect, embodiments of this application provide a computer program product comprising a computer program; when the computer program is run on a computer, the computer performs the method provided in the first aspect.

[0036] The technical effects that can be achieved by any of the second to seventh aspects mentioned above can be described with reference to the technical effects that can be achieved by any possible design in the first aspect mentioned above, and the repetitions will not be discussed. Attached Figure Description

[0037] Figure 1 A structural diagram of an electronic device provided in an embodiment of this application;

[0038] Figure 2 A software system architecture diagram of an electronic device provided in this application embodiment;

[0039] Figure 3 A flowchart illustrating an image display method provided in an embodiment of this application;

[0040] Figure 4A An example diagram of an image display provided in an embodiment of this application;

[0041] Figure 4B An example diagram of an image display provided in an embodiment of this application;

[0042] Figure 5A An image processing architecture diagram provided in this application embodiment;

[0043] Figure 5B This is a schematic diagram of a traditional image display scheme;

[0044] Figure 5C A schematic diagram illustrating an image display scheme provided in an embodiment of this application;

[0045] Figure 5D A schematic diagram illustrating another image display scheme provided in an embodiment of this application;

[0046] Figure 6 This is a structural diagram of an electronic device provided in an embodiment of this application. Detailed Implementation

[0047] This application provides an image display method and electronic device, which can adjust the display effect of an image according to the user's operation during the image display process, thereby improving the user's viewing experience. The method and device are based on the same technical concept. Since the principles by which the method and device solve the problem are similar, the implementation of the device and method can be referred to each other, and repeated details will not be elaborated further.

[0048] The following explanations of some terms used in this application are provided to facilitate understanding by those skilled in the art.

[0049] 1) Electronic equipment refers to devices or apparatuses that have data connectivity, data calculation, and processing capabilities. Generally, electronic equipment has a display screen.

[0050] For example, the electronic device in this application may be a tablet computer, personal computer (PC), laptop computer, computer, netbook, in-vehicle computer, in-vehicle terminal, in-vehicle system, in-vehicle display screen, in-vehicle tablet, central control screen, mobile phone, smart wearable device (e.g., smartwatch, smart bracelet, smart glasses, smart helmet, etc.), personal digital assistant (PDA), smart home device (e.g., smart TV, smart mirror, smart speaker, etc.). This application does not limit the specific form of the electronic device.

[0051] Electronic devices can perform their functions and provide services to users through an operating system they run. For example, the electronic device may, but is not limited to, running an operating system... Or other operating systems.

[0052] 2) Display scene information, which describes the scene (such as device configuration or natural environment) in which the electronic device displaying the image is located. The display effect of the same image will also be different under different display scene information.

[0053] In this application embodiment, the displayed scene information may include, but is not limited to, at least one of the following: configuration parameters of the electronic device's display screen, and lighting information of the current environment in which the electronic device is located.

[0054] 3) Configuration parameters of the display screen of the electronic device. In the embodiments of this application, the configuration parameters of the display screen are parameters that affect the display effect of the image displayed on the display screen, and may include, but are not limited to, at least one of the following: peak brightness, color gamut, contrast ratio, high dynamic range (HDR) support and HDR standard, etc.

[0055] Peak brightness, also known as the maximum brightness of a display screen, is measured in nits (cd / m²). 2 For example, the suitable brightness range for indoor use is 250-300 nits; the suitable brightness range for bright environments is 300-400 nits; and the suitable brightness range for outdoor or high-brightness environments is 500 nits or more.

[0056] Color gamut, or simply color range, refers to the range of colors a display screen can show. Common color gamut standards include: standard red, green, and blue (sRGB), Adobe RGB, and DCI-P3.

[0057] Contrast ratio is the ratio of the brightness of the brightest area to the darkest area of ​​a display screen. Common display screen contrast ratios include: standard contrast ratio 1000:1 and high contrast ratio 10000:1.

[0058] HDR support and HDR standards refer to whether a display supports HDR technology, and if so, the HDR standards it supports. HDR technology aims to enhance the brightness, contrast, and color depth of images, thereby improving their realism and immersiveness. Common HDR standards include HDR10, HDR10+, Dolby Vision, and Hybrid Log-Gamma (HLG).

[0059] 4) Illumination information in the current environment, used to reflect the illumination conditions in the current environment. In the embodiments of this application, illumination information may include, but is not limited to, at least one of the following: illumination intensity, illumination color temperature, light color, etc.

[0060] Illuminance refers to the luminous flux received per unit area, often simply called illuminance, and is measured in lux (Lux). The greater the illuminance, the brighter the light emitted by the luminous body and the wider the area illuminated.

[0061] Light color temperature is a unit of measurement for the color components in light. When a black body is heated to a certain temperature, the color of the light it emits is the same as the color of the light emitted by a certain light source. The temperature at which the black body is heated can be called the color temperature of that light source. The unit of light color temperature can be expressed in Kelvin (K).

[0062] Color of light refers to the hue or color of light, which is primarily determined by the wavelength of the light. Different wavelengths of light correspond to different colors, ranging from red to violet in the visible spectrum, with a wavelength range of approximately 400 to 700 nanometers.

[0063] 5) Image display parameters, including at least one of the following: brightness, color, contrast, saturation, and sharpness.

[0064] Brightness can refer to the overall brightness of an image, the brightness of different areas of the image, or the brightness of different pixels within the image.

[0065] Color, also known as hue or tint, refers to the overall color of an image. In the embodiments of this application, the color of an image can refer to the color of the entire image, the color of different areas of the image, or the color of different pixels.

[0066] Contrast ratio refers to the difference in brightness between the brightest and darkest parts of an image. Higher contrast results in greater contrast, making details stand out and colors more vivid. However, excessively high contrast can lead to loss of detail. Low contrast makes an image appear flat and lacking in depth, also resulting in loss of detail.

[0067] Saturation refers to the purity or intensity of a color, that is, how vivid the color is. High-saturation images appear more vibrant and brighter, while low-saturation images appear darker and more muted. Appropriate saturation can make the colors in an image more vivid and appealing; excessive saturation may result in overly glaring colors, while excessively low saturation may make the image appear flat.

[0068] Sharpness refers to the clarity, detail, and edge sharpness of an image. High sharpness makes image details and edges clearer, but excessive sharpness (oversharpening) can introduce noise and artifacts. Low sharpness (blurring) can make an image appear blurry.

[0069] 6) Image bit depth, also known as bit depth, color depth, or bit depth, refers to the number of bits of data occupied by each pixel in an image, measured in bits. The data for each pixel can include information such as its color, brightness, and grayscale value. A higher bit depth results in richer colors and more detail in the image.

[0070] It should be understood that in the embodiments of this application, "at least one" means one or more, and "more than one" means two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c can be single or multiple.

[0071] In the embodiments of this application, descriptions such as "when," "under the circumstances," "if," and "if" all refer to the electronic device making corresponding processing under certain objective circumstances. They are not time limits, nor do they require the electronic device to make a judgment action when implementing it, nor do they imply any other limitations.

[0072] It should be noted that in this application, "for indicating" can include both direct and indirect indication. When describing information as indicating A, it can include whether the information directly or indirectly indicates A, but does not necessarily mean that the information contains A. Taking first information indicating first content as an example, the first information can contain the first content, or a part of the first content, or an identifier or index of the first content, and can also contain algorithms or calculation parameters for determining the first content. This application does not limit the manner of "indication".

[0073] In this application, "containing / including A" may be equivalent to "containing / including information A". Information A is used to indicate A.

[0074] In addition, it should be understood that in the description of this application, the words "first" and "second" are used only for the purpose of distinguishing descriptions and should not be construed as indicating or implying relative importance or order.

[0075] As described in the background section, currently, when capturing images or videos, the camera can adjust the brightness and color of the captured images or adjust its operating parameters according to the specific shooting environment and the configuration parameters of the specific display screen, so that the captured images or videos can achieve a better display effect when displayed on the specific display screen under that shooting environment. However, the display effect of the images captured by the camera is fixed. During the display process, especially when the user performs a zoom operation on the image displayed on the electronic device, the electronic device does not make any adjustments to the display effect of the image, which cannot guarantee the user's viewing experience.

[0076] Based on this, embodiments of this application provide an image display method. In this method, an electronic device can display a scaled-down first image in response to a user's scaling operation on a displayed first image, and the scaled-down first image differs from the original first image in display parameters and / or image content details. Thus, the electronic device can adjust the image display effect according to the user's scaling operation during image display, thereby improving the user's viewing experience.

[0077] The solutions provided in the embodiments of this application will be described in detail below with reference to the accompanying drawings.

[0078] This application provides an electronic device that can implement the display method provided in this application. See below for further details. Figure 1 The structure of the electronic device provided in the embodiments of this application will be described.

[0079] like Figure 1 As shown, the electronic device 100 may include some or all of the following components: processor 110, external memory interface 120, internal memory 121, USB interface 130, charging management module 140, power management module 141, battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and SIM card interface 195.

[0080] Processor 110 may include one or more processing units, such as a central processing unit (CPU), application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors. The controller may serve as the central nervous system and command center of electronic device 100. The controller can generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution. An ISP can perform various image processing functions, such as exposure blending, black level compensation, lens correction, bad pixel correction, color interpolation, noise removal, automatic white balance, brightness and color adjustment (such as tone mapping), color correction, electro-optical conversion (such as gamma correction, PQ conversion, etc.), color space conversion, color noise removal and edge enhancement, color and contrast enhancement, automatic exposure control, and so on.

[0081] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 may be a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from this memory. By providing memory, the number of times the processor 110 accesses data in the internal memory 121 can be reduced, thus reducing the processor 110's waiting time and improving system efficiency.

[0082] The method provided in this application embodiment can be controlled or invoked by the processor 110 to complete, such as controlling the display screen 194 to display the user interface and images, acquiring the operation information and sensor data collected by the sensor module 180, communicating with other electronic devices through the wireless communication module 160, and receiving and transmitting audio signals through the audio module 170.

[0083] Display screen 194 is used to display a user interface. Display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled LED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 100 may include one or N displays 194, where N is a positive integer greater than 1. Display screen 194 can be used to display information input by the user, information provided to the user, and various graphical user interfaces (GUIs). For example, display screen 194 may display windows, status bars, photos, pictures, videos, web pages, or files, etc. Furthermore, it is understood that in some embodiments, the status bar may also include Bluetooth icons, Wi-Fi icons, external device icons, etc.

[0084] In this embodiment, the display screen 194 can be a single flexible display screen, or it can be a splicing display screen composed of two or more rigid screens and a flexible screen located between two adjacent rigid screens.

[0085] Camera 193 is used to capture still images or videos. Optionally, electronic device 100 may include 1 to N cameras 193. For example, camera 193 may include a front-facing camera or a rear-facing camera, or a single camera 193 may function as both a front-facing and a rear-facing camera. Typically, camera 193 may include a photosensitive element such as a lens assembly and an image sensor. The lens assembly includes multiple lenses (convex or concave lenses) for collecting light signals reflected from the object to be photographed and transmitting the collected light signals to the image sensor. The image sensor generates a raw image of the object to be photographed based on the light signals.

[0086] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, program code for at least one application, etc. The operating system may include, but is not limited to, […]. The storage data area can store data created during the use of the electronic device 100. For example, the storage data area can store image-related data (including image data and image metadata), and can also store various image processing algorithms or image processing models.

[0087] The internal memory 121 may also store one or more computer programs for performing the methods provided in the embodiments of this application. These one or more computer programs, stored in the internal memory 121 and configured to be executed by one or more processors 110, include instructions that can be used to perform the steps in the following embodiments.

[0088] In addition, the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0089] The sensor module 180 may include a fingerprint sensor, a touch sensor, a pressure sensor, a magnetic sensor, an ambient light sensor, a barometric pressure sensor, a bone conduction sensor, etc.

[0090] A touch sensor, also known as a "touch panel," can be located on the display screen 194. The touch sensor detects touch operations applied to or near it. It then transmits the detected touch operation to an application processor to determine the type of touch event. Visual output related to the touch operation can be provided via the display screen 194. In some embodiments, the touch sensor may also be located on the surface of the electronic device 100, in a different position than the display screen 194.

[0091] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0092] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.

[0093] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.

[0094] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal, which is then transmitted to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through the display screen 194. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be housed in the same device as the mobile communication module 150 or other functional modules.

[0095] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0096] In addition, the electronic device 100 can implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, and an application processor, such as music playback and recording. The electronic device 100 can receive key input 190, generating key signal inputs related to user settings and function control. The electronic device 100 can use a motor 191 to generate vibration alerts. The indicator 192 in the electronic device 100 can be an indicator light, used to indicate charging status, battery level changes, messages, missed calls, notifications, etc. The SIM card interface 195 in the electronic device 100 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation with the electronic device 100.

[0097] It should be understood that in practical applications, Figure 1 The electronic device 100 shown is merely an example and does not constitute a limitation on the electronic device. Furthermore, the electronic device 100 may have more or fewer components than those shown in the figure, may combine two or more components, or may have different component configurations. The various components shown in the figure may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits.

[0098] Figure 1The hardware structure of the electronic device has been introduced; the software structure is described below. The software system of the electronic device provided in this application embodiment can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application embodiment uses a layered architecture as an example, referring to... Figure 2 The software structure of an electronic device is illustrated by example.

[0099] A layered architecture divides the software within an electronic device into several layers, each with a clear role and function. Layers can communicate with each other through software interfaces. For example... Figure 2 As shown, the software architecture of an electronic device, from top to bottom, includes at least the following: application layer, system service layer, and kernel layer. Additionally, an electronic device may include a hardware abstraction layer (HAL), which provides hardware resource support for the electronic device.

[0100] The application layer is the top layer of the operating system, including the operating system's native applications and installed third-party applications, such as camera, gallery, calendar, Bluetooth, music, video, messaging, calculator, chat applications, video applications, music applications, electronic map applications, social applications, and so on.

[0101] The system service layer is an important part of the operating system of an electronic device, including various system services provided by the operating system. For example, the system service layer may include: window management service, operation management service, notification management service, layer management service, input management service, image adjustment service, access control service, etc.

[0102] The window management service is used to manage the display and configuration of windows. Based on display settings and multiple management functions, it controls the display of windows or interfaces on the screen, adjusting their transparency, position, and size. It can also lock the screen and take screenshots. The window management service can obtain parameters such as screen size and resolution, and can also identify display areas in the user interface, such as the status bar.

[0103] The operation and management service is responsible for starting, switching, and scheduling various components in the system, as well as managing and scheduling applications.

[0104] Notification management services allow applications to display notification information in the status bar, as well as to convey informational messages. These messages can disappear automatically after a short pause, without requiring user interaction.

[0105] The input management service is used to collect, process, and distribute user operation information and input events. For example, the input management service can receive operation information reported by touch drivers or other input device drivers (such as keyboard drivers, mouse drivers, etc.), convert it into input events, and distribute the input events to other modules for processing.

[0106] Layer management service is a standalone service provided by the operating system of an electronic device. It is a low-level, resident service of the operating system. During device operation, this layer management service needs to run continuously, and the operating system prioritizes allocating resources to it to ensure that it can perform image compositing at any time, thereby ensuring that the electronic device can display the user interface in real time. The layer management service is mainly responsible for the creation, control, and management of layers. It composites and renders the image frames of the corresponding window in each layer, and finally combines the graphic frames from all layers into the image of the user interface to be displayed on the screen.

[0107] Image adjustment services are used to adjust the display parameters or content details of an image based on the scaling operation performed by the user during the display of an image on an electronic device. This results in a scaled image with different display parameters and / or content details from the original image, thereby improving the display effect of the image when the electronic device displays the scaled image and thus enhancing the user's viewing experience.

[0108] Access control services can provide access permission verification for various applications in the application layer and other system services in the system service layer.

[0109] Optionally, between the application layer and the system service layer, the software architecture of the electronic device may also include an application framework layer (FWK) (not shown in the figure). The application framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The application framework layer may include some predefined functions. For example, the application framework layer may include a content provider, a view system, a resource manager, etc. The content provider is used to store and retrieve data, making this data accessible to applications in the application layer. The view system includes visual controls, such as controls for displaying text, images, documents, etc.; the controls in the view system can be used to build the user interface of the application.

[0110] The kernel layer provides the core system services of the operating system, such as security, memory management, process management, network protocol stack, and driver models, all of which are implemented based on the kernel layer. The kernel layer also serves as an abstraction layer between the hardware and software stacks. This layer contains many drivers related to electronic devices, including: display drivers; keyboard drivers; mouse drivers; Flash drivers for memory-based devices; camera drivers; audio drivers; Bluetooth drivers; WiFi drivers; and touch drivers.

[0111] HAL (Hardware Abstraction Layer) is the interface layer between the operating system kernel and the hardware circuitry of an electronic device, and its purpose is to abstract the hardware. For example, HAL can include various sensors, displays, cameras, hardware composers (HWCs), and other hardware components in an electronic device. The HWC is primarily responsible for image compositing and display.

[0112] It should be noted that, Figure 2 This is merely an example of the software architecture of an electronic device, simply listing some layers and software modules, and does not constitute any limitation on the software architecture of the electronic device. In practical applications, the operating system of an electronic device may include other layers, or each layer may include other software modules for implementing one or more functions or services. Furthermore, this application does not limit the specific layer where each software module resides. For example, some system services in the system service layer may be deployed in the application framework layer or in the kernel layer.

[0113] Furthermore, this application does not specifically limit the names of the various software modules in the software structure. For example, in In operating systems, the window management service can be WindowManagerServer (WMS), the layer management service can be the layer management engine (SurfaceFlinger), and the input management service can be InputManagerService. operating system( In a HarmonyOS operating system, the window management service can be SceneBoard (SCB), the layer management service can be RenderService (RS), and the input management service can be a multimodal input service. The multimodal input service aims to support developers in providing users with a rich variety of human-computer interaction methods. While continuously improving support for traditional input methods, the multimodal input service will also leverage the distributed advantages of OpenHarmony to enhance cross-device interaction experiences and provide system-level support capabilities for new scenarios and new businesses. The input component of the multimodal input service adopts the OpenHarmony system-level input event management framework, connecting southbound to various input devices (touchscreens, mice, keyboards, remote controls, gamepads, etc.), aggregating various input events (button presses, touches, etc.), and distributing them to other system services or applications after normalization / standardization processing.

[0114] This application provides an image display method, which can be applied to, for example... Figure 1 or Figure 2 The electronic device shown. See below. Figure 3 The flowchart shown illustrates the method provided in the embodiments of this application.

[0115] S301: The electronic device displays the first image on the screen.

[0116] Optionally, the first image may be a file in image format or a frame from a video file; this application does not limit this.

[0117] In the embodiments of this application, the electronic device can display images in various application scenarios. For example, after the camera application in the electronic device takes a picture, the electronic device can display the image. Another example is when a user opens the electronic device's gallery and selects an image or video to display, the electronic device displays that image or image from the video. Yet another example is when a user selects an image or video to display from various application windows, and the electronic device can display the selected image or image from the video in that application window.

[0118] S302: The electronic device displays a scaled first image in response to a scaling operation performed by the user on the first image; wherein the scaled first image differs from the first image displayed in S301 in terms of display parameters and / or image content details.

[0119] In this embodiment, the image display parameters include at least one of the following: brightness, color, contrast, saturation, and sharpness. For a description of the image display parameters, please refer to the explanation of terms in point 5) above; it will not be repeated here.

[0120] Furthermore, the embodiments of this application do not limit the specific operation form of the zoom operation. For example, the zoom operation can be an up or down scrolling operation performed by the user on the mouse wheel of the electronic device. Another example is a pinch-to-zoom or pinch-to-spread operation performed by the user on the touch screen of the electronic device. Yet another example is a zoom operation performed by the user on the keyboard of the electronic device using a zoom shortcut key. Still another example is a click operation performed by the user on the zoom button, magnify button, or minimize button in the window displayed on the electronic device; the zoom operation can also be a sliding operation performed by the user on the zoom ratio slider in the window displayed on the electronic device.

[0121] During the execution of S302, the electronic device may also generate a scaled first image that differs from the first image in display parameters and / or image content details. In embodiments of this application, the electronic device may, but is not limited to, generate this scaled first image through the following implementations A1-A3.

[0122] Implementation method A1: The electronic device can generate a scaled first image with different display parameters from the first image by following the steps A1-1 to A1-3:

[0123] Step A1-1: In response to the received zoom operation, the electronic device acquires first display scene information and the target zoom ratio indicated by the zoom operation; wherein, the first display scene information includes at least one of the following: configuration parameters of the electronic device's display screen, and illumination information in the current environment. The electronic device can acquire illumination information in the current environment through its own ambient light sensor, or it can interact with other external electronic devices or light sensors to acquire illumination information in the current environment. This application does not limit the method by which the electronic device acquires illumination information in the current environment.

[0124] Optionally, the display configuration parameters may include, but are not limited to, at least one of the following: peak brightness, color gamut, contrast ratio, HDR support, and HDR standard. Current ambient lighting information may include, but is not limited to, at least one of the following: light intensity, light color temperature, and light color. For an explanation of the display scene information and the specific information it contains, please refer to the explanations of terms in points 2) to 4) above; they will not be repeated here.

[0125] Step A1-2: The electronic device can determine the target display parameters based on the first display scene information and the target scaling ratio.

[0126] Optionally, in this step, the electronic device may, but is not limited to, determine the target display parameters through the following methods.

[0127] The first implementation: The file of the first image can contain not only the image data of the first image, but also the metadata of the first image. This metadata can contain the adjustment strategy for the target display parameters of the first image, i.e., the display parameters under multiple display scenarios and multiple scaling ratios. In this way, the electronic device can determine the first display scene information and the target display parameters under the target scaling ratio based on the metadata of the first image. It should be noted that the file of the first image (including the image data and metadata of the first image) is generated by the capturing device of the first image during the process of capturing the first image. This capturing device can be this electronic device or other electronic devices; this application does not limit this. Based on this, in this implementation, the electronic device can execute steps A1-2 through the following steps:

[0128] Step B1: The electronic device acquires the first metadata of the first image. This first metadata includes display parameters of the first image under various display scenarios and scaling ratios.

[0129] Step B2: The electronic device determines the target display parameters in the first metadata based on the first display scene information and the target scaling ratio.

[0130] The second implementation method: The electronic device can calculate the first display scene information and the target display parameters under the target scaling ratio based on a local computing model. Based on this, the electronic device can execute steps A1-2 through the following steps:

[0131] The electronic device inputs the first display scene information and the target scaling ratio into a first calculation model to obtain the target display parameters; wherein, the first calculation model is used to indicate the correspondence between the display scene information, the image scaling ratio, and the image display parameters. Optionally, the first calculation model can be trained using multiple sample data, each sample data containing display scene information, the image scaling ratio, and the image display parameters.

[0132] Through these two implementation methods, electronic devices can adjust image display parameters according to the ambient lighting conditions within the range supported by the display screen's configuration parameters. For example, when the ambient light intensity is high, the electronic device can increase the image's brightness, contrast, and saturation, or adjust the image's colors to make them richer and more vibrant. Conversely, when the ambient light intensity is low, the electronic device can reduce the image's brightness, contrast, and saturation, or adjust the image's colors to make the image appear flat and non-glaring. Furthermore, when the ambient light has color, the electronic device can also adjust the overall color of the image to match the color of the ambient light, thereby increasing the image's realism.

[0133] The third implementation method: The electronic device can determine the color of the image area corresponding to the light source information based on the color of the light source information of the first image. In this way, the electronic device can adjust the color of the image area near the light source based on the color of the light source information of the first image to increase the realism of the scaled image. Based on this, the target display parameters in step A1-2 include: the target color of the image area corresponding to each light source information in the first image. The electronic device can execute the above steps A1-2 through the following steps C1-C2:

[0134] Step C1: The electronic device determines the color of light from at least one light source in the first image.

[0135] It should be noted that the light source indicated by at least one light source information in the first image can be a light source specified or set by the user, or a light source identified by the electronic device in the image content of the first image, or an ambient light source saved by the shooting device when the first image was taken. This application does not limit this.

[0136] Step C2: The electronic device determines the target color of the image area corresponding to each light source information in the first image based on the first display scene information, the target scaling ratio, and the color of light from each light source information in the first image.

[0137] It should be noted that this application does not limit the image area corresponding to each light source information. For example, an electronic device can determine the type of light source, and then determine the image area corresponding to each light source information based on the type of each light source and the direction of illumination of the light emitted by the light source, that is, determine the image area where the object illuminated by each light source is located.

[0138] In step C2, the electronic device can calculate the target color of the image region corresponding to each light source information using a calculation model or a set algorithm; this application does not limit this calculation. Through step C2, the electronic device can adjust the color of the image region corresponding to each light source information in the first image when scaling the first image. Optionally, in this embodiment, the electronic device can adjust the color of the image region corresponding to the light source information according to the following principles:

[0139] When the lighting information in the current environment reflects that the current ambient light is white, the higher the scaling ratio of the first image, the closer the hue of the image area corresponding to each light source information is to the light color of that light source information; the lower the scaling ratio of the first image, the closer the hue of the image area corresponding to each light source information is to the overall hue of the first image.

[0140] When the lighting information in the current environment is not white, the higher the scaling ratio of the first image, the closer the hue of the image area corresponding to each light source is to the superposition of the light color of that light source and the color of the ambient light; the lower the scaling ratio of the first image, the closer the hue of the image area corresponding to each light source is to the overall hue of the first image.

[0141] like Figure 4A As shown, in the study scene captured in image a, there is a light source—a floor lamp. When the user zooms in on image a, the electronic device can identify the color of the floor lamp's light as yellow through step C1 above, and through step C2, determine the color (hue of the floor lamp's light) of the image area corresponding to the floor lamp in the zoomed-in image a. Then, the electronic device can generate and display the zoomed-in image a, where the image area corresponding to the floor lamp (i.e., the floor lamp's light color) in the zoomed-in image a... Figure 4A The color tone within the dashed box area is yellowish.

[0142] It should also be noted that the electronic device can use any one of the above-mentioned implementation methods to determine the target display parameters; it can also combine multiple implementation methods to determine the target display parameters, and this application does not limit this. For example, when the target display parameters include multiple parameters, the electronic device uses the first implementation method to determine all the parameters in the target parameters; or the electronic device uses the first implementation method to determine some of the parameters in the target display parameters, and uses the second or third implementation method to determine another part of the parameters in the target display parameters.

[0143] Steps A1-3: The electronic device generates a scaled first image based on the target display parameters.

[0144] Through the above implementation method A1, the electronic device can determine the target display parameters of the scaled first image based on the first display scene information that affects the image display effect and the target scaling ratio, thereby generating the scaled first image so that the scaled first image can achieve a better display effect in the current display scene, thereby improving the user's viewing experience.

[0145] It should be noted that when the target scaling ratio indicated by the user's scaling operation is less than 100% (i.e., when the electronic device needs to display a scaled-down first image), the electronic device can reduce the image content details in the first image while adjusting the image display parameters in implementation method A1. For example, in a scenario where the first image needs to be scaled down, the electronic device can reduce the image content details in the scaled-down first image by lowering the brightness, sharpness, color, or contrast.

[0146] Implementation method A2: In scenarios where the first image needs to be enlarged, the electronic device can further enhance the image content details of the enlarged first image to improve the user's viewing experience. That is, after the electronic device obtains the target scaling ratio indicated by the scaling operation, when the target scaling ratio is greater than 100%, the electronic device can, but is not limited to, enhance the image content details of the enlarged first image through the following implementation methods to generate a scaled first image with more image content details than the first image.

[0147] The first implementation method: When the target scaling ratio is greater than 100%, the electronic device can generate the scaled (enlarged) first image through the following steps D1-D2:

[0148] Step D1: The electronic device acquires the original image of the first image; wherein, the original image is the full image acquired by the image sensor of the capturing device during the capture of the first image without image processing; the bit depth of the original image is higher than the bit depth of the first image, and the image content detail of the original image is higher than the image content detail of the first image.

[0149] Optionally, the electronic device can obtain the original image of the first image based on the metadata of the first image. As described in the first implementation of steps A1-2 above, the file of the first image can contain not only the image data of the first image, but also the metadata of the first image. This metadata can contain the residual of the first image relative to the original image. That is, in step D1, the electronic device can obtain the second metadata of the first image; wherein, the second metadata is the residual of the first image relative to the original image; then, the electronic device can determine the original image based on the first image and the second metadata. In this way, the electronic device can recover the original image of the first image based on the first image and the residual of the first image relative to the original image.

[0150] In other implementations, the metadata of the first image in the first image file may directly contain the image data of the original image. In this way, the electronic device can directly recover the original image from the image data of the original image during the execution of step D1.

[0151] Step D2: The electronic device can generate a scaled first image based on the target scaling ratio and the original image.

[0152] Optionally, the electronic device can scale the original image according to a target scaling ratio to generate a scaled first image. For example, when the size of the original image is the same as the size of the first image, the electronic device can scale the original image to the target scaling ratio to obtain the scaled first image. As another example, when the size of the original image is different from the size of the first image, the electronic device can scale the original image to the same size as the first image, and then scale the original image to the target scaling ratio.

[0153] In this implementation, since the original image has a higher bit depth, the image content details of the original image are also higher than those of the first image. Therefore, the electronic device generates a scaled first image based on the original image, which can retain more image content details in the scaled first image, making the scaled first image clearer, thereby improving the image display effect and thus improving the user's viewing experience.

[0154] The second implementation method: When the target scaling ratio is greater than 100%, the electronic device can generate the scaled first image by performing the following steps E1-E3, based on the content of the first image, to calculate the image content details in the first image:

[0155] Step E1: The electronic device performs image recognition on the first image to obtain the feature information of the first image; wherein, the feature information of the first image includes at least one of the following: the type of object in the first image, the outline of the object in the first image.

[0156] Step E2: The electronic device predicts the image content details of the scaled first image based on the target scaling ratio and the feature information of the first image.

[0157] In step E2, the electronic device can calculate the details of the object in the first image based on the target scaling ratio and the features (type and / or contour) of the object in the first image. For example... Figure 4B As shown, the electronic device can identify the objects in the unscaled image b as buildings and their outlines, thereby predicting the details of the windows and walls in the buildings, and thus obtaining a magnified image b with richer image content details.

[0158] Step E3: The electronic device generates a scaled first image based on the predicted image content details of the scaled first image, the target scaling ratio, and the first image.

[0159] Optionally, in this step, the electronic device can enlarge the first image to the target scaling ratio and then add the predicted image content details of the scaled first image to the enlarged first image.

[0160] Through this implementation, the electronic device can calculate the image content details of the first image based on the content in the first image, thereby generating a scaled-up first image with richer image content details.

[0161] The third implementation method: When the target scaling ratio is greater than 100%, the electronic device can supplement the image content details in the magnified first image through the following steps, based on the set calculation model:

[0162] The electronic device inputs a first image and a target scaling ratio into a second calculation model to obtain a scaled first image; wherein, the second calculation model is used to enlarge the input image based on the input scaling ratio and increase the image content details of the input image.

[0163] like Figure 4A or Figure 4B As shown, when a user zooms in on image a or image b displayed on an electronic device, the electronic device can obtain magnified images a and b with richer details based on any of the above implementation methods.

[0164] Implementation method A3: When the target zoom ratio indicated by the user's zoom operation is greater than 100%, the electronic device can combine the above-described implementation methods A1 and A2 to generate a zoomed-out first image with different display parameters than the first image and more detailed image content. The specific implementation process can be found in the above-described implementation methods A1 and A2, and will not be repeated here.

[0165] It should be noted that, to ensure the display effect of the first image, the electronic device can execute the above process every time it receives a zoom operation from the user on the first image. In this way, the electronic device can adjust the display effect of the zoomed first image in real time based on the user's zoom operation. Furthermore, when the user zooms in on the first image, if the size of the zoomed-in first image exceeds the image display area on the electronic device's screen, the electronic device can display a portion of the zoomed-in first image within that image display area. For details, please refer to existing image display solutions; further elaboration will not be provided here.

[0166] It should also be noted that after acquiring the original image through the image sensor, the imaging device performs photoelectric conversion on the original image to facilitate subsequent transmission and storage. Compared to other photoelectric conversion curves (functions) (e.g., gamma photoelectric conversion curves), photoelectric conversion using a perceptual quantizer (PQ) nonlinear photoelectric conversion curve (e.g., BT.1886) can reduce data loss in the original image. Therefore, in the embodiments of the application, optionally, the first image is an image obtained by photoelectric conversion using the PQ nonlinear photoelectric conversion curve, that is, the first image is obtained by the imaging device performing PQ photoelectric conversion on the original image.

[0167] Optionally, the bit depth of the first image is 12 bits. In this embodiment, the bit depth of the first image is 12 bits, compared to conventional bit depths (10 bits, 8 bits, etc.), which allows the first image to retain more details and displays the information captured by the shooting device on a display screen with various configuration parameters.

[0168] Furthermore, after acquiring the original image through the image sensor, the capturing device may perform brightness and color adjustment processing on the original image. However, the process of brightness and color adjustment processing on the original image also causes data loss. Therefore, in this embodiment, the first image is generated without brightness and color adjustment processing on the original image of the first image; wherein, the original image is the full image acquired by the image sensor during the capture of the first image without image processing.

[0169] Optionally, in step S301, when the electronic device displays the unscaled first image on the screen, it may also adjust the display parameters of the first image based on the first display scene information. The specific process by which the electronic device determines the target display parameters of the unscaled first image can be referred to the description in steps A1-2 of implementation method A1 in S302 above, and will not be repeated here. Unlike step A1-2, the target scaling ratio is 100%.

[0170] In summary, this application provides an image display method. Through this method, an electronic device can respond to a user's zoom operation on a displayed first image, displaying a zoomed-out first image, wherein the zoomed-out first image differs from the original first image in display parameters and / or image content details. Thus, the electronic device can adjust the image display effect according to the user's zoom operation during image display, thereby improving the user's viewing experience.

[0171] based on Figure 3 The illustrated embodiment provides an image display method, and this application provides a series of image display schemes. The following uses image n as an example, see [reference needed]. Figures 5A-5DThe image display scheme provided in the embodiments of this application will be described.

[0172] like Figure 5A As shown, depending on the different functions of processing image n, the embodiments of this application involve two modules: a shooting end and a display end. Optionally, the shooting end and the display end can be located in the same electronic device or in different electronic devices; this application does not limit this.

[0173] The capturing end includes at least a camera device and an ISP (Image Signal Processor) for capturing images of the actual scene and obtaining a final image file (n). The camera device can be a webcam, specifically comprising a lens assembly and an image sensor. The lens assembly captures light signals from the actual scene and transmits these signals to the image sensor. The image sensor performs photoelectric conversion on the received light signals to generate the original image of the actual scene. Optionally, the image sensor can generate multiple frames of original images of the actual scene with different exposures based on different exposure parameters. The ISP performs various image processing steps on the original images captured by the camera device, such as exposure fusion, black level compensation, lens correction, bad pixel correction, color interpolation, noise removal, automatic white balance, brightness and color adjustment (e.g., tone mapping), color correction, electro-optical conversion (e.g., gamma correction, PQ conversion), color space conversion, color noise removal and edge enhancement, color and contrast enhancement, automatic exposure control, etc. (the order of these steps is not limited), ultimately generating an image file (e.g., image file n) that is easy to save and transmit, so that the display end can display the image based on the image file. For example, the image file format can be High Efficiency Image File Format (HEIF), Joint Photographic Experts Group (JPG), etc.

[0174] The display unit has at least a processor and a display screen. After acquiring a file of image n, it obtains image n based on the file and performs various image processing operations on image n, such as brightness and color adjustment, pixel processing (denoising, filtering, edge enhancement, etc. for each pixel), scaling and cropping, rendering, etc., to display image n on the display screen. The processor can obtain image n based on the file and perform the aforementioned image processing procedures on image n. The processor can adjust display parameters and / or image content details of image n based on user scaling operations, thereby adjusting the display effect of image n based on user scaling operations. The display screen is used to display image n.

[0175] like Figure 5BAs shown in the traditional image display scheme: At the shooting end, the ISP can perform exposure fusion on multiple frames of original images with different exposure levels generated by the image sensor to generate the original image n, such as an 18-bit full image; then the ISP can perform brightness and color adjustment processing (such as tone-mapping processing) and other image processing on the original image (among which, electro-optical conversion can be performed using gamma correction, i.e., using the gamma photoelectric conversion curve to perform electro-optical conversion on the original image) to generate an 8-bit image n; finally, the ISP encodes the image data of image n to obtain the file of image n. After obtaining the file of image n, the display end decodes the encoded data of image n in the file to obtain image n; then it continues to perform image processing on image n, so that image n can be displayed on the display screen.

[0176] Because each image processing step performed by the ISP results in data loss of the original image, the details of the original image content are lost. Therefore, such as... Figure 5C As shown, in an image display scheme provided in this application embodiment, since the subsequent display end will perform image display adjustment processing (including adjustment of display parameters such as color and brightness) during the image display process, the ISP at the shooting end can avoid performing brightness and color adjustment processing on the original image. This preserves as much of the image content detail as possible. Furthermore, when performing electro-optical conversion processing on the image, the ISP can use PQ conversion to perform electro-optical conversion on the original image, that is, using the PQ nonlinear photoelectric conversion curve (e.g., BT.1886) to reduce data loss in the original image. The ISP can generate a 12-bit PQ image n by performing image processing (including PQ conversion) on an 18-bit original image. In addition, after encoding the image data of image n, the ISP can also organize the encoded data and metadata of image n into a file of image n. The metadata of image n can include first metadata and / or second metadata of image n. A description of the first and second metadata can be found in [reference needed]. Figure 3 The descriptions of the first metadata and second metadata of the first image in the illustrated embodiment will not be repeated here.

[0177] Based on the image generation scheme provided in this application, such as Figure 5CAs shown, during the process of displaying image n on the display end, after obtaining the file of image n, the display end decodes the encoded data of image n in the file to obtain image n (a 12-bit PQ image); then, it continues to perform image display adjustments and traditional image processing on image n, so that image n can be displayed on the screen. During the image display adjustment process, the display end can adjust the display parameters and image content details of image n based on display scene information, the target scaling ratio of image n, and the metadata of image n (first metadata and / or second metadata). For details, please refer to [reference needed]. Figure 3 The embodiments shown describe the first implementation method in implementation method A1 and the first implementation method in implementation method A2.

[0178] See Figure 5D As shown, in another image display scheme provided in this application embodiment, the ISP in the shooting end can generate the image n file using a traditional image generation scheme. (And...) Figure 5C The image display scheme differs from the previous one in that: during the display process of image n, the display terminal can adjust the display parameters and image content details of image n based on the display scene information and the target scaling ratio of image n. For details, please refer to [reference needed]. Figure 3 The embodiments shown describe the second and third implementations of implementation A1 and implementation A2.

[0179] It should be noted that in the above embodiments, the same or similar concepts can be referenced to each other, and the same or similar steps can also be referenced to each other.

[0180] It should also be noted that each step in the above embodiments can be executed by the corresponding device, or by components such as chips, processors, or chip systems within that device. The embodiments of this application do not limit their execution. The above embodiments are merely illustrative examples of execution by the corresponding device. Furthermore, the specific implementation methods or examples in the above embodiments do not limit the solutions provided by the embodiments of this application.

[0181] It should be noted that in the above embodiments, some steps may be selected for implementation, and the order of the steps in the figures may be adjusted. This application does not limit this. It should be understood that performing some of the steps in the figures, adjusting the order of the steps, or combining them in a specific implementation all fall within the protection scope of this application.

[0182] It is understood that, in order to achieve the functions described in the above embodiments, each device involved in the above embodiments includes a hardware structure and / or software module corresponding to perform each function. Those skilled in the art should readily recognize that, based on the units and method steps of the various examples described in conjunction with the embodiments disclosed in this application, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed by hardware or by computer software driving hardware depends on the specific application scenario and design constraints of the technical solution.

[0183] It is understood that the architecture and application scenarios described in the embodiments of this application are for the purpose of more clearly illustrating the technical solutions of the embodiments of the present invention, and do not constitute a limitation on the technical solutions provided by the embodiments of the present invention. As those skilled in the art will know, with the evolution of network architecture and the emergence of new services, the technical solutions provided by the embodiments of the present invention are also applicable to similar technical problems.

[0184] It should be noted that the "steps" in the embodiments of this application are merely illustrative and are intended to better understand one method of presentation used in the embodiments. They do not constitute a substantial limitation on the execution of the solution of this application. For example, the "step" can also be understood as a "feature". Furthermore, the steps do not constitute any limitation on the execution order of the solution of this application. Any changes to the order of steps, or the merging or splitting of steps made on this basis without affecting the overall solution implementation, resulting in a new technical solution, are also within the scope of disclosure of this application.

[0185] Based on the same concept, embodiments of this application also provide an electronic device. For example... Figure 6 As shown, the electronic device 600 includes a display screen 601, one or more processors 602, and a memory 603. Optionally, the electronic device 600 may also include a communication module 604. For example, the above-mentioned devices can be connected via one or more communication buses. The one or more computer programs are stored in the memory 603 and configured to be executed by the one or more processors 602. The one or more computer programs include instructions that can be used to cause the electronic device 600 to perform various steps of the methods in the above embodiments.

[0186] For example, the one or more processors 602 described above may specifically be... Figure 1 The processor 110; the memory 603 mentioned above can specifically be... Figure 1 The internal memory 121 is included. The communication module 604 can be... Figure 1 The mobile communication module 150 and / or wireless communication module 160 are included; the display screen 601 can be... Figure 1 The display screen 194 in this embodiment is not limited in any way in this application.

[0187] Based on the same concept, embodiments of this application also provide an electronic device, which includes units for performing the various steps of the methods provided in the above embodiments.

[0188] For details on the specific functions of each module, please refer to the above embodiments; they will not be repeated here.

[0189] Based on the above embodiments, this application also provides a computer program product, which includes instructions; when the computer program is run on a computer, it causes the computer to execute the method provided in the above embodiments.

[0190] Based on the above embodiments, this application also provides a computer-readable storage medium storing computer program instructions, which, when executed by a computer, cause the computer to perform the methods provided in the above embodiments.

[0191] Optionally, the aforementioned computer may include, but is not limited to, control devices.

[0192] The storage medium can be any available medium that a computer can access. For example, but not limited to, a computer-readable medium can include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage media or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer.

[0193] Based on the above embodiments, this application also provides a chip for reading a computer program stored in a memory to implement the method provided in the above embodiments. Optionally, the chip may include a processor and a memory, wherein the processor is coupled to the memory and is used to read the computer program stored in the memory to implement the method provided in the above embodiments.

[0194] Based on the above embodiments, this application provides a chip system including a processor for supporting a computer device in implementing the functions involved in the control device in the above embodiments. In one possible design, the chip system further includes a memory for storing necessary programs and data of the computer device. This chip system may be composed of chips or may include chips and other discrete components.

[0195] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0196] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0197] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0198] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

Claims

1. An image display method, applied to an electronic device, characterized in that, include: Display the first image on the screen; In response to a user's zoom operation on the first image, a zoomed-out first image is displayed; wherein the zoomed-out first image differs from the first image in display parameters and / or image content details; the display parameters include at least one of the following: brightness, color, contrast, saturation, and sharpness.

2. The method as described in claim 1, characterized in that, The method further includes: In response to the scaling operation, first display scene information is obtained, and the target scaling ratio indicated by the scaling operation is obtained; wherein, the first display scene information includes at least one of the following: configuration parameters of the display screen, and illumination information in the current environment; Based on the first display scene information and the target scaling ratio, determine the target display parameters; The scaled first image is generated based on the target display parameters.

3. The method of claim 2, wherein, The step of determining the target display parameters based on the first display scene information and the target scaling ratio includes: Obtain first metadata of the first image; wherein the first metadata includes display parameters of the first image under multiple display scene information and multiple scaling ratios; determine the target display parameters in the first metadata according to the first display scene information and the target scaling ratio; or The first display scene information and the target scaling ratio are input into the first calculation model to obtain the target display parameters; wherein, the first calculation model is used to indicate the correspondence between the display scene information, the scaling ratio of the image and the display parameters of the image.

4. The method as described in claim 2 or 3, characterized in that, The target display parameters include: the target color of the image region corresponding to each light source information in the first image; determining the target display parameters based on the first display scene information and the target scaling ratio includes: Determine the color of light from at least one light source in the first image; Based on the first display scene information, the target scaling ratio, and the color of light from each light source in the first image, the target color of the image region corresponding to each light source in the first image is determined.

5. The method according to any one of claims 1 to 4, wherein The method further includes: Obtain the target scaling ratio indicated by the scaling operation; When the target scaling ratio is greater than 100%, the original image of the first image is acquired; wherein, the original image is the full image acquired by the image sensor during the capture of the first image without image processing; the bit depth of the original image is higher than that of the first image, and the image content detail of the original image is higher than that of the first image; the scaled first image is generated based on the target scaling ratio and the original image; or When the target scaling ratio is greater than 100%, image recognition is performed on the first image to obtain feature information of the first image; wherein, the feature information of the first image includes at least one of the following: the type of object in the first image, the outline of the object in the first image; based on the target scaling ratio and the feature information of the first image, the image content details of the scaled first image are predicted; based on the predicted image content details of the scaled first image, the target scaling ratio, and the first image, the scaled first image is generated; or When the target scaling ratio is greater than 100%, the first image and the target scaling ratio are input into the second calculation model to obtain the scaled first image; wherein, the second calculation model is used to enlarge the input image based on the input scaling ratio and increase the image content details of the input image.

6. The method as described in claim 5, characterized in that, The step of obtaining the original image of the first image includes: Obtain the second metadata of the first image; wherein the second metadata is the residual of the first image relative to the original image; The original image is determined based on the first image and the second metadata.

7. The method according to any one of claims 1-6, characterized in that, The first image is an image obtained by electro-optical conversion through perceptual quantization PQ nonlinear photoelectric conversion curve.

8. The method as described in claim 7, characterized in that, The first image has a bit depth of 12 bits.

9. The method of claim 7 or 8, wherein, The first image is generated without adjusting the brightness or color of the original image; wherein, the original image is the full image acquired by the image sensor during the capture of the first image without any image processing.

10. An electronic device, comprising: The electronic device includes: A display screen used to show the user interface; Memory is used to store computer program instructions; A processor for executing the computer program instructions to support the electronic device in implementing the method as described in any one of claims 1-9.

11. A computer readable storage medium, characterized in that, The computer-readable storage medium stores computer program instructions that, when executed by a processing circuit, implement the method as described in any one of claims 1-9.

12. A computer program product comprising instructions, characterized in that, When the computer program product is run on a computer, it causes the computer to perform the method as described in any one of claims 1-9.

Images