Image display method and device, equipment and storage medium

Abstract

The invention relates to an image display method and device, equipment and a storage medium, and the method comprises the steps: in a process of displaying a target image in a photo album, responding to a received amplification operation for the target image, determining a current display region of the target image, the target image comprises a plurality of sub-images shot by a plurality of lenses with different focal lengths at the same moment; determining a target sub-image containing the current display area in the plurality of sub-images, wherein the target sub-image is an image corresponding to the longest lens focal length in each sub-image containing the current display area; and switching the current display area displayed on the screen to the target sub-image. The splicing trace in the target image can be avoided, the visual effect of the target image is improved, and the computing power of the electronic equipment can be saved.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of terminals, and in particular, to an image display method and device, a terminal, and a storage medium. BACKGROUND

[0002] An album program is one of the most commonly used programs on a mobile terminal such as a smart phone or a tablet computer. The album program can be used to manage and display images in the mobile terminal. In the related art, because the imaging fields of view of the lenses of a multi-focal camera are different, the lens images can be spliced and fused to obtain a complete image, which is stored in the album, on the premise that the lens images have an overlap. However, when a user zooms in on the fused image in the album, the splicing traces in the image are easily found, which affects the visual effect of the image. SUMMARY

[0003] To overcome the problems in the related art, embodiments of the present disclosure provide an image display method, device, terminal, and storage medium to solve the defects in the related art.

[0004] According to a first aspect of embodiments of the present disclosure, an image display method is provided, and the method includes:

[0005] In the process of displaying a target image in an album, in response to receiving a zoom-in operation on the target image, a current display area of the target image is determined, and the target image includes multiple sub-images captured by multiple lenses with different focal lengths at the same time;

[0006] A target sub-image containing the current display area is determined from the multiple sub-images, and the target sub-image is an image with the longest corresponding lens focal length among the sub-images containing the current display area;

[0007] The current display area displayed on the screen is switched to the target sub-image.

[0008] In some embodiments, the determination of the target sub-image containing the current display area from the multiple sub-images includes:

[0009] A current zoom-in multiple of the target image is determined;

[0010] The target sub-image is determined based on an image corresponding to the current zoom-in multiple from the multiple sub-images.

[0011] In some embodiments, the determination of the target sub-image based on the image corresponding to the current zoom-in multiple from the multiple sub-images includes:

[0012] In response to the current magnification being less than the first magnification threshold, determining the target sub-image based on a first sub-image of the plurality of sub-images, the first sub-image being an image of the plurality of sub-images corresponding to a shortest lens focal length.

[0013] In some embodiments, the method further comprises:

[0014] In response to the current magnification being greater than or equal to the first magnification threshold, determining a second image region of a second sub-image of the plurality of sub-images, the second sub-image being an image of the plurality of sub-images corresponding to the current magnification, the second image region being an image region of the second sub-image in a coordinate system to which the first sub-image belongs;

[0015] In response to the current display region being contained in the second image region, determining the target sub-image based on the second sub-image.

[0016] In some embodiments, the determining the target sub-image based on the image of the plurality of sub-images corresponding to the current magnification comprises:

[0017] In response to the current magnification being greater than or equal to the first magnification threshold and less than a second magnification threshold, matching the current display region with a third image region of a third sub-image of the plurality of sub-images, the third sub-image being an image of the plurality of sub-images corresponding to the current magnification, the third image region being an image region of the third sub-image in a coordinate system to which the first sub-image belongs, the first sub-image being an image of the plurality of sub-images corresponding to a shortest lens focal length;

[0018] In response to the current display region being contained in the third image region, determining the target sub-image based on the third sub-image.

[0019] In some embodiments, the determining the target sub-image based on the image of the plurality of sub-images corresponding to the current magnification comprises:

[0020] In response to the current magnification being greater than or equal to the second magnification threshold, matching the current display region with a fourth image region of a fourth sub-image of the plurality of sub-images, the fourth sub-image being an image of the plurality of sub-images corresponding to the current magnification, the fourth image region being an image region of the fourth sub-image in a coordinate system to which the first sub-image belongs, the first sub-image being an image of the plurality of sub-images corresponding to a shortest lens focal length;

[0021] In response to the current display region being contained in the fourth image region, determining the target sub-image based on the fourth sub-image.

[0022] In some embodiments, before displaying the target image, the method further comprises obtaining the target image based on the following manner:

[0023] In response to detecting that the target subject is contained in the current framing preview frame, determining subject position information of the target subject;

[0024] In response to the subject position information being contained in image cropping frames of multiple lenses of different focal lengths, activating the multiple lenses of different focal lengths, and outputting multiple sub-images cropped based on the image cropping frames to the current framing preview frame for display;

[0025] In response to receiving an instruction for obtaining the target image, saving the multiple sub-images to the photo album.

[0026] In some embodiments, the method further comprises:

[0027] Detecting a focal length range currently used for shooting;

[0028] In response to the focal length range being a focal length range of a first lens, obtaining a current focusing distance of the first lens;

[0029] In response to the current focusing distance being greater than or equal to a distance threshold, determining that the first lens is in a telephoto shooting state, and detecting whether a target subject is contained in the current framing preview frame.

[0030] In some embodiments, the method further comprises determining the image cropping frames of the multiple lenses of different focal lengths based on the following manner:

[0031] Obtaining a zoom factor on the focal length range corresponding to the first lens;

[0032] Based on the zoom factor and a pre-constructed correspondence relationship, determining the image cropping frames of the multiple lenses of different focal lengths, the correspondence relationship including a relationship between various zoom factors and image cropping magnifications of the multiple lenses of different focal lengths.

[0033] In some embodiments, the outputting the multiple sub-images cropped based on the image cropping frames to the current framing preview frame for display comprises:

[0034] Determining an offset of the multiple sub-images relative to a first sub-image, the first sub-image being an image with the shortest focal length among the multiple sub-images;

[0035] Based on the offset, determining image coordinates of the multiple sub-images in a coordinate system to which the first sub-image belongs;

[0036] Based on the image coordinates, displaying the multiple sub-images in a picture-in-picture manner in the current framing preview frame.

[0037] According to a second aspect of the embodiments of the present disclosure, an image display device is provided, which comprises:

[0038] a region determining module configured to, in a process of displaying a target image in an album, determine a current display region of the target image in response to receiving a zoom-in operation on the target image, the target image containing a plurality of sub-images captured by a plurality of lenses with different focal lengths at the same time;

[0039] an image determining module configured to determine a target sub-image containing the current display region from the plurality of sub-images, the target sub-image being an image with the longest focal length of corresponding lenses among the sub-images containing the current display region;

[0040] an image switching module configured to switch the current display region displayed on the screen to the target sub-image.

[0041] In some embodiments, the image determining module comprises:

[0042] a multiple determining unit configured to determine a current zoom-in multiple of the target image;

[0043] an image determining unit configured to determine the target sub-image based on an image corresponding to the current zoom-in multiple from the plurality of sub-images.

[0044] In some embodiments, the image determining unit is further configured to, in response to the current zoom-in multiple being less than a first multiple threshold, determine the target sub-image based on a first sub-image from the plurality of sub-images, the first sub-image being an image with the shortest focal length of corresponding lenses among the plurality of sub-images.

[0045] In some embodiments, the image determining unit is further configured to:

[0046] in response to the current zoom-in multiple being greater than or equal to the first multiple threshold, determine a second image region of a second sub-image from the plurality of sub-images, the second sub-image being an image corresponding to the current zoom-in multiple from the plurality of sub-images, the second image region being an image region of the second sub-image in a coordinate system to which the first sub-image belongs;

[0047] in response to the current display region being contained in the second image region, determine the target sub-image based on the second sub-image.

[0048] In some embodiments, the image determining unit is further configured to:

[0049] in response to the current zoom ratio being greater than or equal to the first zoom ratio threshold and less than the second zoom ratio threshold, matching the current display region with a third image region of a third sub-image in the plurality of sub-images, the third sub-image being an image corresponding to the current zoom ratio in the plurality of sub-images, the third image region being an image region of the third sub-image in a coordinate system of a first sub-image, the first sub-image being an image with the shortest focal length in the plurality of sub-images;

[0050] in response to the current display region being contained in the third image region, determining the target sub-image based on the third sub-image.

[0051] In some embodiments, the image determination unit is further configured to:

[0052] in response to the current zoom ratio being greater than or equal to the second zoom ratio threshold, matching the current display region with a fourth image region of a fourth sub-image in the plurality of sub-images, the fourth sub-image being an image corresponding to the current zoom ratio in the plurality of sub-images, the fourth image region being an image region of the fourth sub-image in a coordinate system of a first sub-image, the first sub-image being an image with the shortest focal length in the plurality of sub-images;

[0053] in response to the current display region being contained in the fourth image region, determining the target sub-image based on the fourth sub-image.

[0054] In some embodiments, the apparatus further comprises an image acquisition module;

[0055] The image acquisition module comprises:

[0056] an information determination unit configured to determine subject position information of a target subject in response to detecting that the target subject is contained in a current framing preview frame;

[0057] an image preview unit configured to activate a plurality of lenses with different focal lengths and output a plurality of sub-images cut based on image cut frames of the plurality of lenses with different focal lengths to the current framing preview frame for display in response to the subject position information being contained in the image cut frames of the plurality of lenses with different focal lengths;

[0058] an image saving unit configured to save the plurality of sub-images to the photo album in response to receiving an instruction for acquiring the target image.

[0059] In some embodiments, the image acquisition module further comprises a subject detection unit;

[0060] The subject detection unit is configured to:

[0061] detect a focal length range currently used for shooting.

[0062] in response to the focal length of the first lens, obtaining a current focusing distance of the first lens;

[0063] in response to the current focusing distance being greater than or equal to a distance threshold, determining that the first lens is in a telephoto shooting state, and detecting whether a target subject is included in the current framing preview frame.

[0064] In some embodiments, the image acquisition module further includes a cropping frame determination unit;

[0065] The cropping frame determination unit is configured to:

[0066] obtain a zoom magnification on the focal length corresponding to the first lens;

[0067] determine the image cropping frame of the multiple lenses with different focal lengths based on the zoom magnification and a pre-constructed correspondence relationship, the correspondence relationship including a relationship between various zoom magnifications and image cropping magnifications of the multiple lenses with different focal lengths.

[0068] In some embodiments, the image preview unit is further configured to:

[0069] determine an offset of the multiple sub-images relative to a first sub-image, the first sub-image being an image with the shortest focal length of the corresponding lens among the multiple sub-images;

[0070] determine image coordinates of the multiple sub-images in a coordinate system to which the first sub-image belongs based on the offset;

[0071] display the multiple sub-images in a picture-in-picture manner in the current framing preview frame based on the image coordinates.

[0072] According to a third aspect of the embodiments of the present disclosure, an electronic device is provided, and the device includes:

[0073] a processor and a memory for storing a computer program;

[0074] wherein the processor is configured to implement the following when executing the computer program:

[0075] in a process of displaying a target image in an album, in response to receiving a zoom-in operation on the target image, determining a current display area of the target image, the target image including multiple sub-images taken by multiple lenses with different focal lengths at the same time;

[0076] determining a target sub-image including the current display area among the multiple sub-images, the target sub-image being an image with the longest focal length of the corresponding lens among each sub-image including the current display area;

[0077] switch the current display region displayed on the screen to the target sub-image.

[0078] According to a fourth aspect of the embodiments of the present disclosure, a computer readable storage medium is provided, which stores a computer program. The program is executed by a processor to implement the following steps:

[0079] In the process of displaying a target image in an album, in response to receiving a zoom-in operation on the target image, a current display region of the target image is determined, the target image containing multiple sub-images taken by multiple lenses with different focal lengths at the same time;

[0080] A target sub-image containing the current display region is determined from the multiple sub-images, the target sub-image being the image with the longest focal length of the corresponding lens among the sub-images containing the current display region;

[0081] The current display region displayed on the screen is switched to the target sub-image.

[0082] The technical solutions provided by the embodiments of the present disclosure can have the following beneficial effects:

[0083] The present disclosure determines the current display region of the target image in the process of displaying a target image in an album in response to receiving a zoom-in operation on the target image, the target image containing multiple sub-images taken by multiple lenses with different focal lengths at the same time, and determines a target sub-image containing the current display region from the multiple sub-images, the target sub-image being the image with the longest focal length of the corresponding lens among the sub-images containing the current display region, and then switches the current display region displayed on the screen to the target sub-image. Since picture splicing and fusion are not required, the present disclosure can avoid the appearance of splicing marks in the target image, thereby improving the visual effect of the target image. In addition, since the sub-images taken by each lens are decoded specifically during the zoom-in operation of the user, the present disclosure can avoid decoding all images taken by the lenses, thereby saving the computing power of the electronic device.

[0084] It should be understood that the foregoing general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. BRIEF DESCRIPTION OF DRAWINGS

[0085] The accompanying drawings, which are incorporated into and form part of the specification, illustrate embodiments consistent with the present disclosure and, together with the specification, serve to explain the principles of the present disclosure.

[0086] Figure 1A is a flowchart of an image display method according to an exemplary embodiment of the present disclosure;

[0087] Figure 1B is an effect schematic diagram of an image display method according to an example embodiment of the present disclosure;

[0088] Figure 1C is an effect schematic diagram of an image display method according to another example embodiment of the present disclosure;

[0089] Figure 1D is an effect schematic diagram of an image display method according to another example embodiment of the present disclosure;

[0090] Figure 2 is a flowchart showing how to determine a target sub-image containing the current display region in the plurality of sub-images according to an example embodiment of the present disclosure;

[0091] Figure 3 is a flowchart showing how to determine the target sub-image based on an image corresponding to the current magnification in the plurality of sub-images according to an example embodiment of the present disclosure;

[0092] Figure 4 is a flowchart showing how to determine the target sub-image based on an image corresponding to the current magnification in the plurality of sub-images according to another example embodiment of the present disclosure;

[0093] Figure 5 is a flowchart showing how to obtain the target image according to an example embodiment of the present disclosure;

[0094] Figure 6 is a flowchart showing how to determine image cropping frames of the plurality of lenses with different focal lengths according to an example embodiment of the present disclosure;

[0095] Figure 7A is a flowchart showing how to output the plurality of sub-images cropped based on the image cropping frames to the current framing preview frame for display according to an example embodiment of the present disclosure;

[0096] Figure 7B is an effect schematic diagram of outputting the plurality of sub-images to the current framing preview frame for display according to an example embodiment of the present disclosure;

[0097] Figure 7C is an effect schematic diagram of outputting the plurality of sub-images to the current framing preview frame for display according to another example embodiment of the present disclosure;

[0098] Figure 8 is a block diagram of an image display apparatus according to an example embodiment of the present disclosure;

[0099] Figure 9is a block diagram of yet another image display device according to an example embodiment of the present disclosure;

[0100] Figure 10 is a block diagram of an electronic device according to an example embodiment of the present disclosure. DETAILED DESCRIPTION

[0101] The example embodiments will be described in detail herein with reference to the drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The example embodiments described in the following detailed description are not meant to be exhaustive or to be limited to the precise form disclosed. They are chosen and described to provide the fullest explanation of the principles and applications of the present disclosure as claimed.

[0102] Figure 1A is a flowchart of an image display method according to an example embodiment; the method of the present embodiment can be performed by an image display device, which can be configured in an electronic device with multiple lenses of different focal lengths, such as a mobile phone, a tablet computer, smart glasses, a smart watch, etc. As shown in Figure 1A the method comprises the following steps S101-S103:

[0103] In step S101, in the process of displaying a target image in an album, in response to receiving a zoom-in operation on the target image, the current display area of the target image is determined.

[0104] In the present embodiment, the album mentioned above can refer to an album program in the electronic device. For example, when a user browses the album of the electronic device, a target image selected in the album can be displayed. In this process, if the user performs a zoom-in operation on the target image (for example, an operation of clicking a zoom-in function button or an operation of stretching the target image by at least two fingers, etc.), the electronic device can determine the current display area of the target image (i.e., the area of the target image currently displayed on the screen of the electronic device) in response to the operation.

[0105] In the present embodiment, the target image contains multiple sub-images taken by multiple lenses of different focal lengths at the same time. For example, the multiple lenses of different focal lengths can include an ultra-wide lens (ultraWide), a main camera wide lens (wide), a telephoto lens (tele5x or tele3x), etc.

[0106] In some embodiments, determining the current display area of the target image can refer to the coordinates of the current display area, such as the rectangular frame coordinates of the current display area. For the sake of distinction, the current display area is named as "Rect_display" hereinafter.

[0107] In some embodiments, the target image can be obtained in the following manner Figure 5 The embodiments are not described in detail here.

[0108] In step S102, a target sub-image containing the current display region is determined in the plurality of sub-images.

[0109] In this embodiment, after the current display region Rect_display of the target image is determined, a target sub-image containing the current display region can be determined in the plurality of sub-images.

[0110] The target sub-image can be the image with the longest focal length corresponding to the lens in each sub-image containing the current display region.

[0111] For example, the plurality of lenses include an ultra-wide lens (ultraWide), a wide lens (wide), and a tele lens (tele5x or tele3x). The three lenses are sorted in order from short to long focal length: ultraWide < wide < tele5x or tele3x, and the plurality of sub-images captured by the three lenses are ultraWide sub-image, wide sub-image, and tele sub-image, respectively. On this basis, the image with the longest focal length corresponding to the lens can be detected in the ultraWide sub-image, the wide sub-image, and the tele sub-image containing the current display region.

[0112] For example, if only the ultraWide sub-image contains the current display region Rect_display, the ultraWide sub-image can be determined as the target sub-image; if only the ultraWide sub-image and the wide sub-image contain the current display region Rect_display, the Wide sub-image can be determined as the target sub-image; if the ultraWide sub-image, the wide sub-image, and the tele sub-image all contain the current display region Rect_display, the tele sub-image can be determined as the target sub-image.

[0113] It can be understood that the plurality of lenses including the ultra-wide lens (ultraWide), the wide lens (wide), and the tele lens (tele5x or tele3x) are only used for illustrative purposes, and the number and types of lenses can be added or reduced based on actual needs in application, which is not limited in this embodiment.

[0114] In step S103, the current display region of the screen display is switched to the target sub-image.

[0115] In this embodiment, when the target sub-image containing the current display region is determined in the plurality of sub-images, the current display region displayed on the screen can be switched to the target sub-image.

[0116] For example, the screen of the electronic device can be switched from displaying the current display region to displaying the target sub-image by seamless switching.

[0117] For example, Figure 1B is an effect diagram of an image display method according to an exemplary embodiment of the present disclosure; Figure 1C is an effect diagram of an image display method according to another exemplary embodiment of the present disclosure; Figure 1D is an effect diagram of an image display method according to another exemplary embodiment of the present disclosure. As shown in Figures 1B-1D When a user views a target image in a photo album of an electronic device, for example, in the process of zooming in the target image from 0.5x to 5x, when the zooming factor is between 0.5x and 0.99x, the display can display the ultraWide sub-image as shown in Figure 1B When the zooming factor is greater than 1x, it can be determined whether the Wide sub-image contains the current display region entirely: if yes, a seamless switching can be performed to replace the zoomed-in region of the ultraWide sub-image displayed on the screen at this time with the zoomed-in region of the Wide sub-image as shown in Figure 1C Further, when the user continues to zoom in the target image to a zooming factor greater than 5x, a second determination can be made, i.e., whether the tele sub-image contains the current display region entirely: if yes, a seamless switching can be performed again to replace the zoomed-in region of the Wide sub-image displayed on the screen at this time with the zoomed-in region of the tele sub-image as shown in Figure 1D .

[0118] It can be understood that, by seamless switching, the currently displayed image can be switched seamlessly, and the clarity of the currently displayed image can be improved. Since the target image of the embodiment does not undergo image splicing and fusion, splicing marks in the display process of the target image can be avoided, and thus the visual effect of the target image can be improved. Further, in the process of zooming in on the target image by the user, the sub-images photographed by each lens are displayed and decoded in a targeted manner (for example, when the ultra-wide sub-image is determined as the target sub-image, the wide sub-image and the tele sub-image do not need to be displayed and decoded; when the wide sub-image is determined as the target sub-image, the tele sub-image does not need to be displayed and decoded), that is, all the images photographed by each lens can be avoided from being decoded, and thus the computing power of the electronic device can be saved, and the performance of the electronic device can be improved.

[0119] As can be known from the above description, the method of the embodiment can determine the current display area of a target image in a photo album in response to receiving a zoom-in operation on the target image, the target image containing multiple sub-images photographed by multiple lenses with different focal lengths at the same time, and determine a target sub-image containing the current display area among the multiple sub-images, the target sub-image being the image with the longest corresponding lens focal length among the sub-images containing the current display area, and then switch the current display area displayed on the screen to the target sub-image. Since image splicing and fusion are not required, splicing marks in the target image can be avoided, and thus the visual effect of the target image can be improved. Further, in the process of zooming in on the target image by the user, the sub-images photographed by each lens are decoded in a targeted manner, and thus all the images photographed by each lens can be avoided from being decoded, and thus the computing power of the electronic device can be saved.

[0120] Figure 2 is a flowchart illustrating how to determine a target sub-image containing the current display area among the multiple sub-images according to an example embodiment of the disclosure; the embodiment is exemplarily described based on how to determine a target sub-image containing the current display area among the multiple sub-images in the above embodiment.

[0121] As Figure 2 shown, the step S102 of determining a target sub-image containing the current display area among the multiple sub-images can include the following steps S201-S202:

[0122] In step S201, the current zoom-in multiple of the target image is determined.

[0123] In this embodiment, when the target sub-image containing the current display region is determined from the plurality of sub-images, the current magnification of the target image can be obtained.

[0124] For example, when a user views a target image in an album, the target image can be magnified from 0.5x to 5x, and so on. It should be noted that the manner of determining the current magnification of the target image can refer to a solution in the related art, for example, obtained from an album application, which is not limited in this embodiment.

[0125] In step S202, the target sub-image is determined based on the image corresponding to the current magnification from the plurality of sub-images.

[0126] In this embodiment, after the current magnification of the target image is determined, the image corresponding to the current magnification from the plurality of sub-images can be determined, and then the target sub-image is determined based on the image.

[0127] For example, after the image corresponding to the current magnification from the plurality of sub-images is determined, if the image has only one, the image can be determined as the target sub-image; and if the image has two or more, the target sub-image can be determined based on the image regions and the lengths of the corresponding lens focal lengths of the images.

[0128] In some other embodiments, the manner of determining the target sub-image can refer to the embodiments shown in the following Figure 3 or Figure 4 which will not be described in detail here.

[0129] As can be seen from the above description, by determining the current magnification of the target image and determining the target sub-image based on the image corresponding to the current magnification from the plurality of sub-images, the target sub-image can be accurately determined based on the current magnification of the target image, and then the current display region displayed on the screen can be switched to the target sub-image, which can improve the visual effect of the target image, avoid decoding all images taken by the lens, and thus save the computing power of the electronic device and improve the user experience.

[0130] Figure 3 is a flowchart illustrating how to determine the target sub-image based on the image corresponding to the current magnification from the plurality of sub-images according to an example embodiment of the present disclosure; this embodiment is illustratively described based on how to determine the target sub-image containing the current display region from the plurality of sub-images in the above embodiment.

[0131] For example, as shown in Figure 3As shown, the step of determining the target sub-image containing the current display region in the plurality of sub-images in step S202 can include steps S301-S304.

[0132] In step S301, it is determined whether the current magnification is less than a first magnification threshold: if yes, step S302 is performed; if no, step S303 is performed.

[0133] In this embodiment, after determining the current magnification of the target image, the current magnification can be compared with the first magnification threshold, and then step S302 is performed when the current magnification is less than the first magnification threshold, and step S303 is performed when the current magnification is greater than or equal to the first magnification threshold.

[0134] For example, assuming that the electronic device is a dual-camera device with an ultra-wide lens (ultraWide) and a main wide lens (wide), the correspondence between different magnifications and corresponding sub-images can be determined as shown in Table 1 as follows:

[0135] Table 1

[0136]

[0137] In the above table, the ultraWide sub-image can refer to a sub-image captured by the ultra-wide lens (ultraWide), and the Wide sub-image can refer to a sub-image captured by the main wide lens (wide).

[0138] It should be noted that the above-mentioned dual-camera device including an ultra-wide lens (ultraWide) and a main wide lens (wide) is only used for illustrative purposes, and in application, the number and types of lenses can be added or reduced based on actual needs, for example, extended to a triple-camera, quad-camera device, etc., which is not limited in this embodiment.

[0139] In step S302, the target sub-image is determined based on a first sub-image in the plurality of sub-images.

[0140] In this embodiment, when the current magnification is less than the first magnification threshold, the target sub-image can be determined based on a first sub-image in the plurality of sub-images. The first sub-image is the image with the shortest focal length corresponding to the lens in the plurality of sub-images.

[0141] For example, referring to Table 1, the first multiple threshold can be 1.0x, and the ultraWide sub-image (first sub-image) can be determined as the target sub-image when the current zoom level zoom user is less than 1.0x. It can be understood that the ultraWide sub-image corresponds to the shortest focal length among the sub-images captured by the three lenses.

[0142] In step S303, a second image region of a second sub-image in the plurality of sub-images is determined.

[0143] In this embodiment, when the current zoom level is greater than or equal to the first multiple threshold, a second image region of a second sub-image in the plurality of sub-images can be determined, wherein the second sub-image corresponds to the current zoom level among the plurality of sub-images.

[0144] For example, referring to Table 1, when the current zoom level zoom user is greater than or equal to 1.0x, the image region of the Wide sub-image (for ease of distinction, this image region is named as a "second image region") can be determined.

[0145] It should be noted that the second image region can be an image region of the second sub-image in a coordinate system of the first sub-image (i.e., the sub-image corresponding to the shortest focal length among the plurality of sub-images).

[0146] In some embodiments, the second image region of the second sub-image can be determined based on a cropping multiple and an offset of the second sub-image. The offset of the second sub-image can be an offset of the second sub-image relative to the first sub-image. As an example, after obtaining the cropping multiple and the offset of the second sub-image, the second image region of the second sub-image, i.e., the coordinates of the second sub-image in the coordinate system of the first sub-image, can be obtained by combining a region of interest mapping (ROImapping) algorithm. It should be noted that the cropping multiple and the offset of the second sub-image can be obtained based on an algorithm in the related art, such as a multi-camera space alignment conversion (SAT) algorithm, and the present embodiment does not limit this.

[0147] In step S304, in response to the current display region being contained in the second image region, the target sub-image is determined based on the second sub-image.

[0148] In this embodiment, after the second image region of the second sub-image is determined, the current display region can be matched with the second image region to determine whether the current display region is contained in the second image region.

[0149] On this basis, when it is determined that the current display region is contained in the second image region, the target sub-image can be determined based on the second sub-image. For example, when it is determined that there is only one second sub-image containing the current display region, this image can be determined as the target sub-image; and if there are two or more second sub-images containing the current display region, the longest one corresponding to the lens focal length can be determined as the target sub-image.

[0150] For example, when it is determined that the current display region Rect_display is contained in Rect_wide, the Wide sub-image (i.e., the second sub-image) can be determined as the target sub-image. Conversely, if the current display region Rect_display is not contained in Rect_wide, the ultraWide sub-image (the first sub-image) can be determined as the target sub-image.

[0151] As can be seen from the above description, the embodiment can accurately determine the target sub-image based on the image corresponding to the current magnification in the plurality of sub-images, and then switch the current display region of the screen to the target sub-image, thereby improving the visual effect of the target image and the user experience.

[0152] Figure 4 is a flowchart illustrating how to determine the target sub-image based on the image corresponding to the current magnification in the plurality of sub-images according to another exemplary embodiment of the present disclosure; the embodiment is exemplarily described based on how to determine the target sub-image based on the image corresponding to the current magnification in the plurality of sub-images.

[0153] As Figure 4 shown, the step S202 of determining the target sub-image containing the current display region in the plurality of sub-images can include the following steps S401-S407:

[0154] In step S401, it is determined whether the current magnification is less than the first magnification threshold: if yes, step S402 is performed; if no, step S403 is performed.

[0155] In this embodiment, after determining the current zoom level of the target image, the current zoom level can be compared with the first zoom threshold, and then step S402 is performed when the current zoom level is less than the first zoom threshold, and step S403 is performed when the current zoom level is greater than or equal to the first zoom threshold.

[0156] For example, assuming that the electronic device is a three-camera device with an ultra-wide lens (ultraWide), a main wide-angle lens (wide), and a telephoto lens (tele5x or tele3x), the correspondence between different zoom levels and corresponding sub-images can be determined in advance as shown in Table Two below:

[0157] Table Two

[0158]

[0159] In the above table, the ultraWide sub-image can refer to the sub-image captured by the ultra-wide lens (ultraWide), the Wide sub-image can refer to the sub-image captured by the main wide-angle lens (wide), and the tele sub-image can refer to the sub-image captured by the telephoto lens (tele5x or tele3x).

[0160] It should be noted that the above-mentioned dual-camera device including an ultra-wide lens (ultraWide) and a main wide-angle lens (wide) is only used for illustrative purposes, and in application, the number and types of lenses can be added or reduced based on actual needs, for example, extended to a quad-camera device, etc., which is not limited in this embodiment.

[0161] In step S402, the target sub-image is determined based on a first sub-image in the plurality of sub-images.

[0162] In this embodiment, when the current zoom level is less than the first zoom threshold, the target sub-image can be determined based on a first sub-image in the plurality of sub-images. The first sub-image is the image corresponding to the shortest lens focal length in the plurality of sub-images.

[0163] Taking Table Two above as an example, the first zoom threshold can be 1.0x, and then when the current zoom level zoom_user is less than 1.0x, the ultraWide sub-image (first sub-image) can be determined as the target sub-image. It can be understood that the ultraWide sub-image corresponds to the shortest lens focal length among the sub-images captured by the three lenses.

[0164] In step S403, it is determined whether the current zoom level is greater than or equal to a second zoom threshold: if not, step S404 is performed; if yes, step S406 is performed.

[0165] In this embodiment, when it is determined that the current zoom level of the target image is greater than or equal to the first zoom threshold, the current zoom level can be further compared with a second zoom threshold, where the second zoom threshold is greater than the first zoom threshold; then, when the current zoom level is less than the second zoom threshold, step S404 is performed, and when the current zoom level is greater than or equal to the second zoom threshold, step S406 is performed.

[0166] In step S404, the current display region is matched with a third image region of a third sub-image in the plurality of sub-images.

[0167] In this embodiment, when it is determined that the current zoom level is less than the second zoom threshold, the current display region can be matched with a third image region of a third sub-image in the plurality of sub-images. The third sub-image can be a sub-image corresponding to the current zoom level in the plurality of sub-images, and the third image region can be an image region of the third sub-image in the coordinate system of the first sub-image.

[0168] In some embodiments, the third image region of the third sub-image can be determined based on a clipping ratio and an offset of the third sub-image. The offset of the third sub-image can be an offset of the third sub-image relative to the first sub-image. As an example, when the clipping ratio and the offset of the third sub-image are obtained, the third image region of the third sub-image, i.e., the coordinates of the third sub-image in the coordinate system of the first sub-image, can be obtained by combining the ROI mapping algorithm. It should be noted that the clipping ratio and the offset of the third sub-image can be obtained based on an algorithm in the related art, such as the multi-camera space alignment conversion (SAT) algorithm, and the present embodiment does not limit this. Then, when the third image region of the third sub-image is determined, the current display region can be matched with the third image region to determine whether the current display region is contained in the third image region.

[0169] Still taking Table 2 as an example, the second zoom threshold can be 5.0x, and then when the current zoom level zoom_user is less than 5.0x, the third sub-image region (for ease of distinction, the region is named as Rect_wide below) of the Wide sub-image (third sub-image) can be determined, and then it is determined whether the current display region Rect_display is contained in Rect_wide.

[0170] In step S405, in response to the current display region being contained in the third image region, the target sub-image is determined based on the third sub-image.

[0171] In the embodiment, when it is determined that the current display region Rect_display is included in Rect_wide, the Wide sub-image (i.e., the third sub-image) can be determined as the target sub-image. Conversely, if the current display region Rect_display is not included in Rect_wide, the ultraWide sub-image (the first sub-image) can be determined as the target sub-image.

[0172] In step S406, the current display region is matched with a fourth image region of a fourth sub-image in the plurality of sub-images.

[0173] In the embodiment, when it is determined that the current magnification is greater than or equal to the second magnification threshold, the current display region can be matched with a fourth image region of a fourth sub-image in the plurality of sub-images. The fourth sub-image can be an image corresponding to the current magnification in the plurality of sub-images, and the fourth image region can be an image region of the fourth sub-image in the coordinate system of the first sub-image.

[0174] In some embodiments, the fourth image region of the fourth sub-image can be determined based on a cropping ratio and an offset of the fourth sub-image. The offset of the fourth sub-image can be an offset of the fourth sub-image relative to the first sub-image. As an example, when the cropping ratio and the offset of the fourth sub-image are obtained, the fourth image region of the fourth sub-image, i.e., the coordinates of the fourth sub-image in the coordinate system of the first sub-image, can be obtained in combination with an ROI mapping algorithm. It should be noted that the cropping ratio and the offset of the fourth sub-image can be obtained based on an algorithm in the related art, such as a multi-camera space alignment conversion (SAT) algorithm, and the embodiment is not limited in this regard. Further, when the fourth image region of the fourth sub-image is determined, the current display region can be matched with the fourth image region to determine whether the current display region is included in the fourth image region.

[0175] Still taking Table 2 as an example, when the current magnification zoom_user is greater than or equal to 5.0x, the fourth sub-image region (for ease of distinction, the region is named as "Rect_tele" below) of the tele sub-image (the fourth sub-image) can be determined, and it is further determined whether the current display region Rect_display is included in Rect_tele.

[0176] In step S407, in response to the current display region being included in the fourth image region, the target sub-image is determined based on the fourth sub-image.

[0177] In this embodiment, when it is determined that the current display area Rect_display is included in Rect_tele, the tele sub-image (the fourth sub-image) can be determined as the target sub-image. Conversely, if the current display area Rect_display is not included in Rect_tele, step S404 can be returned to determine whether the current display area Rect_display is included in Rect_wide.

[0178] As can be seen from the above description, the embodiment can accurately determine the target sub-image based on the image corresponding to the current magnification in the plurality of sub-images, and then switch the current display area of the screen display to the target sub-image, which can improve the visual effect of the target image and further improve the user experience.

[0179] Figure 5 is a flowchart illustrating how to obtain the target image according to an example embodiment of the present disclosure; the embodiment is exemplarily described based on how to obtain the target image.

[0180] As shown in Figure 5 , the image display method of the embodiment can further include obtaining the target image based on steps S501-S503:

[0181] In step S501, in response to detecting that the target subject is included in the current framing preview frame, the subject position information of the target subject is determined.

[0182] In this embodiment, when the user uses the electronic device to take a picture, the electronic device can detect whether the target subject is included in the current framing preview frame, and then determine the subject position information of the target subject, such as the subject image frame coordinates of the target subject, when it is detected that the target subject is included in the current framing preview frame. In order to facilitate distinction, the subject image frame coordinates will be named as "Rect_main" hereinafter.

[0183] In some embodiments, the type of the target subject described above can be set based on scene requirements, such as being set as at least one of a human face subject, a human body subject, a sculpture subject, an outdoor billboard, and an outdoor column object, and the like, which is not limited in the embodiment.

[0184] It is worth noting that the manner of detecting whether the target subject is included in the current framing preview frame can be selected from object detection algorithms in related technologies based on requirements, such as being selected as an automatic scene detection (ASD) algorithm, and the like, which is not limited in the embodiment.

[0185] In the related art, in the long shot shooting state, sometimes the scene of the target subject in front and the background behind needs to be shot, at which time a wider picture needs to be framed. However, when shooting in a wider picture (i.e., using a larger field of view FOV), the focal length will be relatively small, and the subject cannot be kept clear. To solve this problem, the related art can use multiple lenses to frame and shoot respectively, and then splice and fuse the shot images. However, this scheme usually needs to activate all lenses unconditionally, resulting in large power consumption of the system, and the final image is prone to have splicing marks, affecting the visual effect of the image. Thus, the embodiment can detect whether the target subject is included in the current framing preview frame when detecting that the electronic device is in the long shot shooting state, and then implement the scheme of the embodiment when detecting that the target subject is included in the current framing preview frame, to solve the above problems in the related art.

[0186] Illustratively, when a user shoots based on an electronic device, the electronic device can detect the focal length currently used for shooting, and in response to the focal length being the focal length of a first lens, acquire the current focusing distance of the first lens, and then in response to the current focusing distance being greater than or equal to a distance threshold, determine that the first lens is in a long shot shooting state, and detect whether the target subject is included in the current framing preview frame. For example, when the electronic device detects that the focal length currently used for shooting is the focal length of a super wide-angle lens (or a main camera wide-angle lens), the current focusing distance "afDis" of the lens can be acquired, and the focusing distance "afDis" is compared with the distance threshold (e.g., 1.2 meters, etc.). If the focusing distance "afDis" is greater than or equal to 1.2 meters, it can be determined that the lens is in a long shot shooting state, and then it can be detected whether the target subject is included in the current framing preview frame.

[0187] In step S502, in response to the subject position information being included in the image cropping frames of multiple lenses of different focal lengths, the multiple lenses of different focal lengths are activated, and multiple sub-images cropped based on the image cropping frames are output to the current framing preview frame for display.

[0188] In the embodiment, after determining the subject position information of the target subject, it can be detected whether the subject position information is included in the image cropping frames of multiple lenses of different focal lengths, and then when it is detected that the subject position information is included in the image cropping frames of multiple lenses of different focal lengths, the multiple lenses of different focal lengths can be activated, and multiple sub-images cropped based on the image cropping frames can be output to the current framing preview frame for display.

[0189] For example, it is assumed that the electronic device is a three-camera device with an ultra-wide lens (ultraWide), a main wide lens (wide), and a telephoto lens (tele5x or tele3x). When the user takes a photo using the focal length of the ultra-wide lens (ultraWide), the ultra-wide lens is activated at this time (i.e., the main wide lens and the telephoto lens are not activated), and then the main wide lens is activated when the subject position information of the target subject is detected to be included in the image cropping frame of the main wide lens, and then the ultraWide sub-image cropped by the image cropping frame of the ultra-wide lens and the Wide sub-image cropped by the image cropping frame of the main wide lens can be output to the current framing preview frame for display. On this basis, if the subject position information of the target subject is also detected to be included in the image cropping frame of the telephoto lens, the telephoto lens is activated, and then the ultraWide sub-image, the Wide sub-image, and the tele sub-image cropped by the image cropping frame of the telephoto lens can be output to the current framing preview frame for display. It can be understood that if the subject position information of the target subject is not detected to be included in the image cropping frame of the main wide lens, the main wide lens and the telephoto lens are not activated, and only the ultraWide sub-image is output to the current framing preview frame for display.

[0190] In step S503, in response to receiving an instruction for acquiring the target image, the multiple sub-images are saved to the album.

[0191] In this embodiment, after the multiple lenses of different focal lengths are activated and the multiple sub-images cropped based on the image cropping frames are output to the current framing preview frame for display, the user can send an instruction for acquiring the target image to the electronic device based on the user's own needs, and then the electronic device can save the multiple sub-images collected by the currently activated lens to the album in response to receiving the instruction.

[0192] As can be known from the above description, in the embodiment, the subject body position information of the target subject is determined in response to the detection that the target subject is contained in the current framing preview frame, the multiple lenses of different focal lengths are activated in response to the subject position information being contained in the image cropping frames of the multiple lenses of different focal lengths, and the multiple sub-images cropped based on the image cropping frames are output to the current framing preview frame for display, so that the corresponding lens can be activated accurately based on the image cropping frame in which the target subject is located, the problem of large system power consumption caused by the unconditional activation of all lenses during image acquisition can be avoided, and by outputting the multiple sub-images to the current framing preview frame for display, the user can know the details of the images captured by each lens before shooting, the user's shooting experience can be improved, and by saving the multiple sub-images in the album, the target sub-image can be determined according to the current display area of the target image when the target image in the album is displayed in an enlarged manner, the splicing traces in the target image can be avoided, the visual effect of the target image can be improved, and by decoding the sub-images captured by each lens in a targeted manner, the images captured by all lenses can be avoided from being decoded, so that the computing power of the electronic device can be saved.

[0193] Figure 6 is a flowchart illustrating how to determine the image cropping frames of the multiple lenses of different focal lengths according to an example embodiment of the present disclosure; the embodiment is exemplarily described based on how to determine the image cropping frames of the multiple lenses of different focal lengths on the basis of the above embodiment.

[0194] As Figure 6 shown, before the above step S502, the embodiment further includes determining the image cropping frames of the multiple lenses of different focal lengths based on the following steps S601-S602:

[0195] In step S601, the zoom magnification on the focal length corresponding to the first lens is acquired.

[0196] In the embodiment, when the target subject is detected to be contained in the current framing preview frame and the subject body position information of the target subject is determined, in order to determine the image cropping frames of the multiple lenses of different focal lengths in the electronic device, the zoom magnification on the focal length corresponding to the first lens can be acquired.

[0197] For example, it is still assumed that the electronic device is a three-camera device with an ultra-wide lens (ultraWide), a main wide-angle lens (wide), and a telephoto lens (tele5x or tele3x), then:

[0198] If the focal length used in the current shooting is an ultra-wide focal length, such as 0.5x-1x, i.e., the first lens is an ultra-wide lens, the zoom of the corresponding focal length of the ultra-wide lens can be obtained, such as 0.5x, 0.6x, 0.7x, 0.8x, or 0.9x, etc.

[0199] If the focal length used in the current shooting is a main wide focal length, such as 1x-3x (or 1x-5x), i.e., the first lens is a main wide lens, the zoom of the corresponding focal length of the lens can be obtained, such as 1x, 2x, 3x (or 1x, 2x, 3x, 4x), etc.

[0200] In step S602, based on the zoom and the pre-constructed correspondence relationship, the image cropping frame of the multiple lenses with different focal lengths is determined.

[0201] In this embodiment, after obtaining the zoom zoom of the corresponding focal length of the first lens, the image cropping ratio (i.e., the cropping ratio of the image) of the multiple lenses with different focal lengths can be determined based on the zoom and the pre-constructed correspondence relationship, and then the image cropping frame (i.e., the final image region obtained after cropping the original image) of the multiple lenses with different focal lengths can be determined according to the image cropping ratio of the multiple lenses and the original image collected by the corresponding lens. As an example, the image cropping frame of the corresponding lens can be obtained by dividing the original image by the cropping ratio.

[0202] The correspondence relationship includes the relationship between various zooms and the image cropping ratios of the multiple lenses with different focal lengths.

[0203] Still assuming that the electronic device is a three-camera device with an ultra-wide lens (ultraWide), a main wide lens (wide), and a telephoto lens (tele5x or tele3x), then:

[0204] If the focal length used in the current shooting is an ultra-wide focal length, the image cropping ratio of the main wide lens and the telephoto lens (tele3x or tele5x) can be determined based on the zoom zoom of the ultra-wide lens and by looking up the correspondence relationship shown in Table Three below.

[0205] Table Three

[0206]

[0207] If the focal length used in the current shooting is a main wide focal length, the image cropping ratio zoom_t3 of the tele3x telephoto lens and the image cropping ratio zoom_t5 of the tele5x telephoto lens can be determined respectively by using the zoom zoom_w of the main wide lens and by combining the correspondence relationships shown in the following formulas (6-1) and (6-2).

[0208] zoom_t3 = 3 + zoom_w / 3; (6-1)

[0209] wherein, 1 <= zoom_w < 3.

[0210] zoom_t5 = 5 + zoom_w / 5; (6-2)

[0211] wherein, 1 <= zoom_w < 5.

[0212] In some embodiments, the focal lengths of the multiple lenses with different focal lengths are negatively correlated with the sizes of the respective image cropping frames (i.e., the shorter the focal length, the larger the image cropping frame), and the image cropping frames of the multiple lenses with different focal lengths are in a step-by-step containing relationship, such as:

[0213] the image cropping frame of the ultra-wide-angle lens > (contains) the image cropping frame of the main wide-angle lens > (contains) the image cropping frame of the telephoto lens.

[0214] As can be seen from the above description, by obtaining the zoom factor on the focal length corresponding to the first lens, and determining the image cropping frame of the multiple lenses with different focal lengths based on the zoom factor and the corresponding relationship constructed in advance, the image cropping frame of the multiple lenses with different focal lengths can be accurately determined based on the zoom factor of the first lens (i.e., the lens corresponding to the focal length used for current shooting), and then it can be accurately judged whether the subject position information is contained in the image cropping frame of the multiple lenses, the multiple sub-images cropped based on the image cropping frame can be activated in the subsequent multiple lenses, and the multiple sub-images cropped based on the image cropping frame can be output to the current framing preview frame for display, and in response to receiving an instruction for obtaining the target image, the multiple sub-images can be saved to the album, which not only can avoid the problem of large system power consumption caused by unconditionally activating all lenses during image acquisition, but also can enable the user to know the details of the images captured by each lens before shooting, and can improve the user's shooting experience.

[0215] Figure 7A is a flowchart illustrating how to output the multiple sub-images cropped based on the image cropping frame to the current framing preview frame for display according to an exemplary embodiment of the present disclosure; the present embodiment is exemplarily explained based on how to output the multiple sub-images cropped based on the image cropping frame to the current framing preview frame for display as an example.

[0216] As Figure 7A shown in the above step S502, the multiple sub-images cropped based on the image cropping frame can be output to the current framing preview frame for display, which can include the following steps S701-S703:

[0217] In step S701, the offsets of the plurality of sub-images relative to a first sub-image are determined.

[0218] In this embodiment, when the plurality of sub-images cut based on the image cut frame are output to the current framing preview frame for display, the offsets of the plurality of sub-images relative to a first sub-image can be determined. The first sub-image can be the image corresponding to the shortest focal length in the plurality of sub-images.

[0219] For example, when the plurality of lenses include an ultra-wide lens (ultraWide), a wide lens (wide), and a tele lens (tele5x or tele3x), the three lenses are sorted in order of increasing focal length as follows: ultraWide < wide < tele5x or tele3x. Then, the ultraWide sub-image captured by the ultra-wide lens can be used as the first sub-image, and the offsets of the other sub-images relative to the first sub-image can be determined. As an example, the offsets can refer to the offsets of the center points of the other sub-images relative to the center point of the first sub-image.

[0220] It should be noted that the offsets of the plurality of sub-images relative to the first sub-image can be obtained based on an algorithm in the related art, such as a multi-camera spatial alignment conversion (SAT) algorithm, and the present embodiment does not limit this.

[0221] In step S702, the image coordinates of the plurality of sub-images in the coordinate system of the first sub-image are determined based on the offsets.

[0222] In this embodiment, after the offsets of the plurality of sub-images relative to the first sub-image are determined, the image coordinates of the plurality of sub-images in the coordinate system of the first sub-image can be determined based on the offsets.

[0223] For example, when the offsets of the plurality of sub-images relative to the first sub-image are shift, the plurality of sub-images and the corresponding offsets shift can be transmitted to a camera application program, so that the camera application program can obtain the picture-in-picture window coordinates of each sub-image, i.e., the image coordinates of each sub-image in the coordinate system of the first sub-image, according to each offset.

[0224] In step S703, the plurality of sub-images are displayed in a picture-in-picture form in the current framing preview frame based on the image coordinates.

[0225] In this embodiment, after determining the image coordinates of the plurality of sub-images in the coordinate system to which the first sub-image belongs, the plurality of sub-images can be displayed in the current framing preview frame in a picture-in-picture manner based on the image coordinates, for example, a picture-in-picture window image of each sub-image can be displayed to a corresponding position (i.e. a position indicated by a picture-in-picture window coordinate) in the current framing preview frame.

[0226] For example, Figure 7B is an effect schematic diagram of outputting a plurality of sub-images to a current framing preview frame for display according to an example embodiment of the present disclosure; Figure 7C is an effect schematic diagram of outputting a plurality of sub-images to a current framing preview frame for display according to another example embodiment of the present disclosure. In this embodiment, the electronic device is still taken as an example of a three-camera device with an ultra-wide lens (ultraWide), a main wide-angle lens (wide), and a telephoto lens (tele, such as tele5x or tele3x).

[0227] As Figure 7B indicated, when the user uses the ultra-wide lens to take a photo, it can be determined whether the ultra-wide lens is currently taking a long shot according to the obtained focus distance. If it is a long shot, an algorithm such as Auto Scene Detection (ASD) can be called to detect whether a target subject appears in the current scene, and then the subject position information (such as a subject image frame representing the coordinate range where the subject is located) of the target subject can be obtained and judged. If the target subject falls within the image cropping frame of the main wide-angle lens Wide, the main wide-angle lens Wide is activated. If the target subject also falls within the image cropping frame of the telephoto lens tele, the main wide-angle lens Wide and the telephoto lens tele are activated at the same time. Then, after the original images captured by Wide and tele lenses are cropped into corresponding cropping ratios according to the current user zoom ratio (such as zoom=0.5x), the cropped Wide sub-image 002 and tele sub-image 003 can be displayed in the ultraWide sub-image 001 displayed in the current framing preview frame based on the picture-in-picture (PIP) technology.

[0228] Similarly, as Figure 7CAs shown, when the user uses the main camera wide-angle lens Wide to take a photo, it can be determined according to the obtained focusing distance whether the main camera wide-angle lens is currently taking a long shot. If it is a long shot, an algorithm such as Auto Scene Detection (ASD) can be called to detect whether a target subject appears in the current scene, and then the subject position information of the target subject can be obtained when the target subject is detected, and a judgment can be made; if the target subject falls within the image cropping frame of the telephoto lens tele, the telephoto lens tele is activated; and after the original image captured by the tele lens is cropped to the corresponding cropping ratio according to the current user zoom ratio (for example, zoom = 3x), the tele sub-image 005 obtained by cropping can be displayed in the Wide sub-image 004 displayed in the current viewfinder preview frame based on the Picture-in-Picture (PIP) technology.

[0229] As can be known from the above description, by displaying the plurality of sub-images in the current viewfinder preview frame in the form of a picture-in-picture, the plurality of sub-images cropped based on the image cropping frame can be output to the current viewfinder preview frame for display. Compared with the scheme in the related art in which only the image captured by the lens with the shortest focal length is displayed in the viewfinder preview, the user can know the details of the images captured by each lens before shooting, and the user's shooting experience can be improved.

[0230] Overall, the present disclosure can improve the local sharpness of preview and shooting while retaining a large field of view (FOV), and compared with the scheme in the related art in which images captured by multiple lenses are fused, the present scheme does not introduce new image processing algorithms, has small computational overhead, and can be popularized on low-end platforms. In the shooting process, the sharpness of the preview is improved by using multiple lenses, and a higher-definition image is displayed in the preview screen in the form of a picture-in-picture. The user can know the details of the images captured by each lens before shooting, and the user's shooting experience can be improved. Moreover, in the present scheme, the local sharpness of the image is improved by multiple camera lenses in a hardware complementary manner, and compared with the software processing manner in the related art in which only image processing algorithms are used, a more significant image quality improvement effect can be achieved.

[0231] Figure 8 is a block diagram of an image display device according to an example embodiment of the present disclosure; the device of the present embodiment can be configured in an electronic device with multiple lenses with different focal lengths, such as a mobile phone, a tablet computer, smart glasses, a smart watch, etc. As shown, the device can include a region determination module 110, an image determination module 120, and an image switching module 130, wherein: Figure 8

[0232] ​The area determination module 110 is used to determine the current display area of ​​the target image in response to receiving a zoom-in operation on the target image during the display of the target image in the album. The target image includes multiple sub-images taken at the same time by multiple lenses with different focal lengths.

[0233] The image determination module 120 is used to determine a target sub-image containing the current display area among the multiple sub-images, wherein the target sub-image is the image with the longest corresponding lens focal length among the sub-images containing the current display area;

[0234] The image switching module 130 is used to switch the currently displayed area on the screen to the target sub-image.

[0235] As described above, the device in this embodiment, during the display of a target image in a photo album, responds to a magnification operation on the target image, determines the current display area of ​​the target image, the target image comprising multiple sub-images captured simultaneously by multiple lenses with different focal lengths, and identifies a target sub-image containing the current display area among the multiple sub-images. The target sub-image is the image with the longest corresponding lens focal length among the sub-images containing the current display area. The device then switches the current display area on the screen to the target sub-image. Since image stitching and fusion are not required, stitching artifacts in the target image can be avoided, thereby improving the visual effect of the target image. Furthermore, since the sub-images captured by each lens are decoded selectively during the user's magnification of the target image, decoding images captured by all lenses can be avoided, thus saving the computing power of the electronic device.

[0236] Figure 9 This is a block diagram illustrating another image display device according to an exemplary embodiment of the present disclosure; the device of this embodiment can be configured in an electronic device with multiple lenses having different focal lengths, such as a mobile phone, tablet computer, smart glasses, smartwatch, etc. The region determination module 210, image determination module 220, and image switching module 230 are as described above. Figure 8 The functions of the region determination module 110, image determination module 120, and image switching module 130 in the illustrated embodiment are the same, and will not be described in detail here.

[0237] like Figure 9 As shown, the image determination module 220 may include:

[0238] The magnification determination unit 221 is used to determine the current magnification of the target image;

[0239] The image determining unit 222 is configured to determine the target sub-image based on an image corresponding to the current magnification in the plurality of sub-images.

[0240] In some embodiments, the image determining unit 222 is further configured to, in response to the current magnification being less than a first magnification threshold, determine the target sub-image based on a first sub-image in the plurality of sub-images, the first sub-image being an image in the plurality of sub-images corresponding to a shortest lens focal length.

[0241] In some embodiments, the image determining unit 222 can be further configured to:

[0242] In response to the current magnification being greater than or equal to the first magnification threshold, determine a second image region of a second sub-image in the plurality of sub-images, the second sub-image being an image in the plurality of sub-images corresponding to the current magnification, the second image region being an image region of the second sub-image in a coordinate system to which the first sub-image belongs;

[0243] In response to the current display region being contained in the second image region, determine the target sub-image based on the second sub-image.

[0244] In some embodiments, the image determining unit 222 can be further configured to:

[0245] In response to the current magnification being greater than or equal to the first magnification threshold and less than a second magnification threshold, match the current display region with a third image region of a third sub-image in the plurality of sub-images, the third sub-image being an image in the plurality of sub-images corresponding to the current magnification, the third image region being an image region of the third sub-image in a coordinate system to which the first sub-image belongs, the first sub-image being an image in the plurality of sub-images corresponding to a shortest lens focal length;

[0246] In response to the current display region being contained in the third image region, determine the target sub-image based on the third sub-image.

[0247] In some embodiments, the image determining unit 222 can be further configured to:

[0248] In response to the current magnification being greater than or equal to the second magnification threshold, match the current display region with a fourth image region of a fourth sub-image in the plurality of sub-images, the fourth sub-image being an image in the plurality of sub-images corresponding to the current magnification, the fourth image region being an image region of the fourth sub-image in a coordinate system to which the first sub-image belongs, the first sub-image being an image in the plurality of sub-images corresponding to a shortest lens focal length;

[0249] In response to the current display region being included in the fourth image region, the target sub-image is determined based on the fourth sub-image.

[0250] In another aspect, the apparatus can further include an image acquisition module 240.

[0251] The image acquisition module 240 can include:

[0252] An information determination unit 241 configured to determine subject position information of a target subject in response to detecting that the target subject is included in the current framing preview frame.

[0253] An image preview unit 242 configured to activate a plurality of lenses of different focal lengths in response to the subject position information being included in image cropping frames of the plurality of lenses of different focal lengths, and output a plurality of sub-images cropped based on the image cropping frames to the current framing preview frame for display.

[0254] An image saving unit 243 configured to save the plurality of sub-images to the photo album in response to receiving an instruction to acquire the target image.

[0255] In some embodiments, the image acquisition module 240 can further include a subject detection unit 244.

[0256] The subject detection unit 244 can be configured to:

[0257] detect a focal length range of a first lens currently used for shooting;

[0258] acquire a current focusing distance of the first lens in response to the focal length range being a focal length range of the first lens;

[0259] determine that the first lens is in a telephoto shooting state in response to the current focusing distance being greater than or equal to a distance threshold, and detect whether a target subject is included in the current framing preview frame.

[0260] In some embodiments, the image acquisition module 240 can further include a cropping frame determination unit 245.

[0261] The cropping frame determination unit 245 can be configured to:

[0262] acquire a zoom factor on the focal length range corresponding to the first lens;

[0263] determine image cropping frames of the plurality of lenses of different focal lengths based on the zoom factor and a pre-constructed correspondence relationship, the correspondence relationship including a relationship between various zoom factors and image cropping magnifications of the plurality of lenses of different focal lengths.

[0264] In some embodiments, the image preview unit 242 can be further configured to:

[0265] determining an offset of the plurality of sub-images relative to a first sub-image, the first sub-image being an image with the shortest focal length in the plurality of sub-images;

[0266] determining image coordinates of the plurality of sub-images in a coordinate system of the first sub-image based on the offset;

[0267] displaying the plurality of sub-images in a picture-in-picture manner in the current framing preview frame based on the image coordinates.

[0268] As to the apparatus in the above embodiments, the specific manners in which the respective modules perform operations have been described in detail in the embodiments of the method, and thus will not be described in detail here.

[0269] Figure 10 is a block diagram of an electronic device according to an example embodiment. The device 900 can be a mobile phone, a computer, a digital broadcast terminal, a message communicator, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, and the like, for example.

[0270] Referring to Figure 10 , the device 900 can include one or more of the following components: a processing component 902, a memory 904, a power supply component 906, a multimedia component 908, an audio component 910, an input / output (I / O) interface 912, a sensor component 914, and a communication component 916.

[0271] The processing component 902 usually controls overall operations of the device 900, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 902 can include one or more processors 920 to execute instructions to complete all or part of the steps of the image display method described above. In addition, the processing component 902 can include one or more modules to facilitate the interaction between the processing component 902 and other components. For example, the processing component 902 can include a multimedia module to facilitate the interaction between the multimedia component 908 and the processing component 902.

[0272] The memory 904 is configured to store various types of data to support operations of the device 900. Examples of these data include instructions for any application or method operating on the device 900, contact data, phonebook data, messages, pictures, videos, and the like. The memory 904 can be implemented by any type of volatile or non-volatile storage devices or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0273] Power component 906 provides power to the various components of device 900. Power component 906 can include a power supply management system, one or more power sources, and other components associated with generating, managing, and distributing power for device 900.

[0274] Multimedia component 908 includes a screen providing an output interface between device 900 and a user. In some embodiments, the screen can include a liquid crystal display panel and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense a touch, a slide, and a gesture on the touch panel. The touch sensor can not only sense a boundary of a touching or a sliding action, but also detect duration and pressure related to the touching or sliding action. In some embodiments, multimedia component 908 includes a front camera and / or a rear camera. The front and / or rear camera can receive external multimedia data when device 900 is in an operating mode, such as a shooting mode or a video mode. Each of the front and rear camera can be a fixed optical lens system or have a focal length and optical zoom capability.

[0275] Audio component 910 is configured to output and / or input an audio signal. For example, audio component 910 includes a microphone (MIC) configured to receive an external audio signal when device 900 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal can be further stored in memory 904 or transmitted via communication component 916. In some embodiments, audio component 910 also includes a speaker for outputting an audio signal.

[0276] I / O interface 912 provides an interface between processing component 902 and peripheral interface modules, which can be a keyboard, a click wheel, a button, and the like. The buttons can include, but are not limited to, a home button, a volume button, a start button, and a lock button.

[0277] The sensor component 914 includes one or more sensors for providing status assessments for various aspects of the device 900. For example, the sensor component 914 can detect an open / closed position of the device 900, relative positioning of components of the device 900, such as a display panel and a keypad of the device 900, a change in position of the device 900 or a component of the device 900, presence or absence of user contact with the device 900, orientation or acceleration / deceleration of the device 900, and temperature changes of the device 900. The sensor component 914 can also include proximity sensor(s) configured to detect presence of nearby objects without any physical contact. The sensor component 914 can further include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 914 can also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0278] The communication component 916 is configured to facilitate wired or wireless communication between the device 900 and another device. The device 900 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, 4G or 5G, or a combination thereof. In an exemplary embodiment, the communication component 916 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 916 further includes a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on Radio Frequency Identification (RFID) techniques, infrared data association (IrDA) techniques, ultra-wideband (UWB) techniques, Bluetooth (BT) techniques, and other techniques.

[0279] In an exemplary embodiment, the device 900 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, micro-controllers, microprocessors, or other electronic components, for performing the image display method described above.

[0280] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions, such as the memory 904 including instructions, is also provided, which can be executed by the processor 920 of the device 900 to complete the image display method described above. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disc, and an optical data storage device, etc.

[0281] Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the features disclosed herein. It is intended that the disclosure be construed as including any patents, patent applications, publications, publications, or other disclosure of the prior art that are referred to by their title or by a general identification of their content. It is intended that the disclosure encompass variations and modifications of the specific structure disclosed herein to the extent that these variations and modifications remain consistent with the general principles of the present disclosure. The specification and examples are to be regarded as exemplary in nature and not as restrictive.

[0282] It should be understood that the present disclosure is not limited to the precise structures herein described and illustrated in the drawings and that various modifications and changes can be made therein without departing from the scope thereof. The scope of the present disclosure is indicated by the appended claims.

Claims

1. An image presentation method, characterized by, The method comprises: In the process of displaying a target image in an album, in response to receiving a zoom-in operation on the target image, determining a current display region of the target image, the target image containing multiple sub-images taken by multiple lenses with different focal lengths at the same time; Determining a target sub-image containing the current display region in the multiple sub-images, the target sub-image being the image with the longest corresponding lens focal length among the sub-images containing the current display region; Switching the current display region displayed on the screen to the target sub-image.

2. The method of claim 1, wherein, The method further comprises: Determining a current zoom-in multiple of the target image; Determining the target sub-image based on the image corresponding to the current zoom-in multiple in the multiple sub-images.

3. The method of claim 2, wherein, The method further comprises: In response to the current zoom-in multiple being less than a first multiple threshold, determining the target sub-image based on a first sub-image in the multiple sub-images, the first sub-image being the image with the shortest corresponding lens focal length in the multiple sub-images.

4. The method of claim 3, wherein, The method further comprises: In response to the current zoom-in multiple being greater than or equal to the first multiple threshold, determining a second image region of a second sub-image in the multiple sub-images, the second sub-image being the image corresponding to the current zoom-in multiple in the multiple sub-images, the second image region being the image region of the second sub-image in a coordinate system to which the first sub-image belongs; In response to the current display region being contained in the second image region, determining the target sub-image based on the second sub-image.

5. The method of claim 2, wherein, The method further comprises: In response to the current zoom-in multiple being greater than or equal to a first multiple threshold and less than a second multiple threshold, matching the current display region with a third image region of a third sub-image in the multiple sub-images, the third sub-image being the image corresponding to the current zoom-in multiple in the multiple sub-images, the third image region being the image region of the third sub-image in a coordinate system to which the first sub-image belongs, the first sub-image being the image with the shortest corresponding lens focal length in the multiple sub-images; In response to the current display region being contained in the third image region, determining the target sub-image based on the third sub-image.

6. The method of claim 2, wherein, The method further comprises: In response to the current zoom-in multiple being greater than or equal to a second multiple threshold, matching the current display region with a fourth image region of a fourth sub-image in the multiple sub-images, the fourth sub-image being the image corresponding to the current zoom-in multiple in the multiple sub-images, the fourth image region being the image region of the fourth sub-image in a coordinate system to which the first sub-image belongs, the first sub-image being the image with the shortest corresponding lens focal length in the multiple sub-images; In response to the current display region being included in the fourth image region, the target sub-image is determined based on the fourth sub-image.

7. The method of claim 1, wherein, Before the target image is displayed, the method further includes obtaining the target image based on the following manner: In response to detecting that a target subject is included in the current framing preview frame, subject position information of the target subject is determined; In response to the subject position information being included in image cropping frames of multiple lenses of different focal lengths, the multiple lenses of different focal lengths are activated, and multiple sub-images cropped based on the image cropping frames are output to the current framing preview frame for display; In response to receiving an instruction for obtaining the target image, the multiple sub-images are saved to the album.

8. The method of claim 7, wherein, The method further includes: detecting a focal length range currently used for shooting; in response to the focal length range being a focal length range of a first lens, obtaining a current focusing distance of the first lens; in response to the current focusing distance being greater than or equal to a distance threshold, determining that the first lens is in a telephoto shooting state, and detecting whether a target subject is included in the current framing preview frame.

9. The method of claim 8, wherein, The method further includes determining the image cropping frames of the multiple lenses of different focal lengths based on the following manner: obtaining a zoom factor on the focal length range corresponding to the first lens; based on the zoom factor and a pre-constructed correspondence relationship, determining the image cropping frames of the multiple lenses of different focal lengths, the correspondence relationship including a relationship between various zoom factors and image cropping magnifications of the multiple lenses of different focal lengths.

10. The method of claim 7, wherein, The outputting of the multiple sub-images cropped based on the image cropping frames to the current framing preview frame for display includes: determining an offset of the multiple sub-images relative to a first sub-image, the first sub-image being an image of the multiple sub-images corresponding to the shortest focal length of the lenses; based on the offset, determining image coordinates of the multiple sub-images in a coordinate system to which the first sub-image belongs; based on the image coordinates, displaying the multiple sub-images in a picture-in-picture manner in the current framing preview frame.

11. An image display device, characterized by comprising: The apparatus includes: a region determination module configured to, in a process of displaying a target image in an album, in response to receiving a zoom-in operation on the target image, determine a current display region of the target image, the target image including multiple sub-images captured by multiple lenses of different focal lengths at the same time; an image determination module configured to determine, among the multiple sub-images, a target sub-image including the current display region, the target sub-image being an image of the multiple sub-images corresponding to the longest focal length of the lenses; an image switching module configured to switch the current display region displayed on a screen to the target sub-image.

12. The apparatus of claim 11, wherein, The image determination module includes: a factor determination unit configured to determine a current zoom-in factor of the target image; an image determination unit configured to determine the target sub-image based on an image of the multiple sub-images corresponding to the current zoom-in factor.

13. The apparatus of claim 12, wherein, The image determination unit is further configured to, in response to the current magnification being less than a first magnification threshold, determine the target sub-image based on a first sub-image in the plurality of sub-images, the first sub-image being an image corresponding to a shortest focal length in the plurality of sub-images.

14. The apparatus of claim 13, wherein, The image determination unit is further configured to: in response to the current magnification being greater than or equal to the first magnification threshold, determine a second image region of a second sub-image in the plurality of sub-images, the second sub-image being an image corresponding to the current magnification in the plurality of sub-images, the second image region being an image region of the second sub-image in a coordinate system to which the first sub-image belongs; in response to the current display region being contained in the second image region, determine the target sub-image based on the second sub-image.

15. The apparatus of claim 12, wherein, The image determination unit is further configured to: in response to the current magnification being greater than or equal to a first magnification threshold and less than a second magnification threshold, match the current display region with a third image region of a third sub-image in the plurality of sub-images, the third sub-image being an image corresponding to the current magnification in the plurality of sub-images, the third image region being an image region of the third sub-image in a coordinate system to which the first sub-image belongs, the first sub-image being an image corresponding to a shortest focal length in the plurality of sub-images; in response to the current display region being contained in the third image region, determine the target sub-image based on the third sub-image.

16. The apparatus of claim 12, wherein, The image determination unit is further configured to: in response to the current magnification being greater than or equal to the second magnification threshold, match the current display region with a fourth image region of a fourth sub-image in the plurality of sub-images, the fourth sub-image being an image corresponding to the current magnification in the plurality of sub-images, the fourth image region being an image region of the fourth sub-image in a coordinate system to which the first sub-image belongs, the first sub-image being an image corresponding to a shortest focal length in the plurality of sub-images; in response to the current display region being contained in the fourth image region, determine the target sub-image based on the fourth sub-image.

17. The apparatus of claim 11, wherein, The apparatus further includes an image acquisition module; The image acquisition module includes: an information determination unit configured to, in response to detecting that a target subject is contained in a current framing preview frame, determine subject position information of the target subject; an image preview unit configured to, in response to the subject position information being contained in image cropping frames of a plurality of lenses of different focal lengths, activate the plurality of lenses of different focal lengths, and output a plurality of sub-images cropped based on the image cropping frames to the current framing preview frame for display; an image saving unit configured to, in response to receiving an instruction for acquiring the target image, save the plurality of sub-images to the photo album.

18. The apparatus of claim 17, wherein, The image acquisition module further includes a subject detection unit; the subject detection unit is configured to: detect a focal length range currently used for shooting; in response to the focal length range being a focal length range of a first lens, acquire a current focusing distance of the first lens; In response to the current focusing distance being greater than or equal to a distance threshold, it is determined that the first lens is in a telephoto shooting state, and it is detected whether a target subject is included in the current framing preview frame.

19. The apparatus of claim 18, wherein, The image acquisition module further includes a cropping frame determination unit; The cropping frame determination unit is configured to: acquire a zoom factor on a focal length corresponding to the first lens; determine image cropping frames of the multiple lenses with different focal lengths based on the zoom factor and a pre-constructed correspondence relationship, the correspondence relationship including a relationship between various zoom factors and image cropping magnifications of the multiple lenses with different focal lengths.

20. The apparatus of claim 17, wherein, The image preview unit is further configured to: determine an offset of the multiple sub-images relative to a first sub-image, the first sub-image being an image with the shortest focal length of the corresponding lens among the multiple sub-images; determine image coordinates of the multiple sub-images in a coordinate system to which the first sub-image belongs based on the offset; display the multiple sub-images in a picture-in-picture manner in the current framing preview frame based on the image coordinates.

21. An electronic device, comprising: The device includes: a processor and a memory for storing a computer program; wherein the processor is configured to implement the following when executing the computer program: In a process of displaying a target image in an album, in response to receiving a zoom-in operation on the target image, a current display area of the target image is determined, the target image including multiple sub-images taken by multiple lenses with different focal lengths at the same time; a target sub-image containing the current display area is determined among the multiple sub-images, the target sub-image being an image with the longest focal length of the corresponding lens among the sub-images containing the current display area; the current display area displayed on the screen is switched to the target sub-image.

22. A computer readable storage medium having stored thereon a computer program, characterized in that, The program, when executed by a processor, implements the following: In a process of displaying a target image in an album, in response to receiving a zoom-in operation on the target image, a current display area of the target image is determined, the target image including multiple sub-images taken by multiple lenses with different focal lengths at the same time; a target sub-image containing the current display area is determined among the multiple sub-images, the target sub-image being an image with the longest focal length of the corresponding lens among the sub-images containing the current display area; the current display area displayed on the screen is switched to the target sub-image.

Images