Long-focus imaging method and electronic device

Abstract

This application provides a long-focus photography method and electronic device. The method can be implemented by an electronic device, such as a tablet or watch, that has a digital zoom function and a long-focus photography function. During the long-focus photography process, the method simultaneously displays two framed pictures: the original framed picture is displayed in an auxiliary viewfinder window at 5x magnification, and the framed picture obtained after the user adjusts the magnification to 50x is displayed in an image preview display area, providing the user with two preview pictures with different fields of view. During the long-focus photography process, the user can more easily find the subject to be photographed based on the original framed picture displayed in the auxiliary viewfinder window at 5x magnification, which improves the long-focus photography experience.

Description

Technical Field

[0001] This application claims priority to Chinese Patent Application No. 202010077034.6, titled "LONG-FOCUS SHOOTING METHOD AND ELECTRONIC DEVICE", filed with the China National Intellectual Property Administration on January 23, 2020, the entire content of which is incorporated herein by reference.

[0002] Technical Field This application relates to the field of electronic technology, and in particular, to a long-focus shooting method and an electronic device.

Background Art

[0003] With the continuous development of terminal technology, the shooting function has become an important feature of terminal devices and a major indicator for evaluating the performance of terminal devices. When a user takes a photo using a portable terminal device such as a mobile phone, the user has requirements for ultra-long-focus shooting. In the ultra-long-focus shooting process of a terminal device, by using the mounted long-focus prime lens, the picture taken by the long-focus prime lens is cropped near the center point, the image quality is optimized, and long-focus framing at a larger magnification is implemented.

[0004] For example, in the process of obtaining a 50x magnified framed picture through the ultra-telephoto shooting of a mobile phone, the 5x magnified framed picture taken by the telephoto prime lens of the mobile phone is cropped, and the 50x magnified framed picture is obtained through the digital zoom process. Since the axis of the lens of the mobile phone is fixed and cannot be rotated to find the subject of the shooting target during the shooting process, the user needs to align the mobile phone with the shooting target. However, the area of the 50x magnified framed picture is only 1 / 100 of the area of the 5x lens framed picture, the frame range is equivalent to that of a single-lens reflex lens with a focal length of 1340mm, the field of view (FOV) is only about 0.5 degrees, and the coverage area of the framed picture is very small. Therefore, ultra-telephoto shooting enlarges jitter and causes deviation of the framed picture. In addition, when the framed picture is considerably deviated, it is difficult to find the shooting target.

Summary of the Invention

[0005] This application provides a telephoto shooting method and an electronic device. In this method, two framed pictures are simultaneously displayed. As a result, in the telephoto shooting process, the user can more easily find the subject of the shooting target and improve the shooting experience.

[0006] According to a first aspect, a telephoto shooting method is provided and is executed by an electronic device including a lens. The method includes: displaying a shooting interface of a camera of the electronic device, where the shooting interface includes an image preview area that displays a first preview picture; detecting a first operation and, in response to the first operation, simultaneously displaying, by the electronic device, the image preview area and an auxiliary preview window on the shooting interface, where the auxiliary preview window displays a second preview picture. The first preview picture and the second preview picture are obtained by using the lens. The first preview picture is a framed picture at a first magnification, the second preview picture is a framed picture at a second magnification, the first preview picture is obtained by cropping the second preview picture, and the first magnification is greater than or equal to the second magnification.

[0007] According to the above solution, based on the current shooting requirements of the user, for example, in the telephoto shooting process, in this method, two framed pictures are simultaneously displayed. The original framed picture is displayed in the auxiliary viewfinder window at "5x", and the framed picture obtained after the user adjusts the magnification to "50x" is displayed in the image preview display area, providing the user with two preview pictures having different fields of view. In the telephoto shooting process, based on the original framed picture at "5x" displayed in the auxiliary viewfinder window, the user can more easily find the subject of the shooting object without changing the shooting angle of the mobile phone or the lens. This improves the telephoto shooting experience.

[0008] In connection with the first aspect, in some implementations of the first aspect, the image preview area and the auxiliary preview window are displayed in any one of the following ways: at least a part of the auxiliary preview window overlaps with the image preview area; the auxiliary preview window is displayed at a position outside the image preview area; or the auxiliary preview window is arranged at the lower left corner of the image preview area.

[0009] According to the above method, the auxiliary preview window can be displayed in different ways on the interface of the camera application, adapting to different shooting scenarios and improving the user's shooting experience. For example, since the auxiliary preview window and the image preview area do not overlap, the user can view a larger preview picture, thus improving the shooting experience.

[0010] In connection with the first aspect and the above implementations, in some implementations of the first aspect, the first operation is a user adjustment operation on the magnification in the magnification adjustment area. In response to the first operation, for the electronic device to display the auxiliary preview window on the shooting interface includes: when detecting that the first magnification is greater than or equal to the first threshold, the electronic device automatically displays the auxiliary preview window on the shooting interface.

[0011] Optionally, the user can slide the magnification within the magnification adjustment area 30 of the mobile phone. When the magnification reaches the first threshold (for example, "5x"), the mobile phone automatically switches the lens to the telephoto shooting mode and obtains the original framed picture by using the telephoto lens of the mobile phone. Alternatively, the lens may enter the telephoto shooting mode in another way such as user settings. This is not limited in this embodiment of the present application.

[0012] In connection with the first aspect and the above implementations, in some implementations of the first aspect, the first operation is a user operation for opening the auxiliary preview window in the camera application.

[0013] For example, a camera application may include a switch for enabling a telephoto shooting function, i.e., an auxiliary framed picture switch. For example, the auxiliary framed picture switch may be set within an upper menu area, and the user may directly tap the auxiliary framed picture switch within the upper menu area to enable the telephoto shooting function, and an auxiliary viewfinder frame is displayed. Alternatively, the auxiliary framed picture switch may be included within a settings menu, and the user may be able to enable the telephoto shooting function by using the settings menu, and an auxiliary viewfinder frame is displayed.

[0014] In relation to the first aspect and the above-described implementations, in some implementations of the first aspect, the auxiliary preview window further comprises a close button, and after the electronic device displays the auxiliary preview window on the shooting interface, the method further includes that when the electronic device detects a user operation on the close button, the electronic device closes the auxiliary preview window.

[0015] For example, when the user finishes focusing and the subject of the shooting target is displayed in the image preview area, the user may close the auxiliary viewfinder frame, and as a result, there may be a larger image preview area, which is convenient for the user to view the image preview picture.

[0016] In relation to the first aspect and the above-described implementations, in some implementations of the first aspect, the auxiliary preview window further comprises a target area, and the image of the first preview picture is obtained by processing the image within the target area, where the target area is a fixed area within the auxiliary preview window or the target area is an arbitrary area within the auxiliary preview window.

[0017] In relation to the first aspect and the above-described implementation, in some implementations of the first aspect, the method further includes detecting a drag operation on an auxiliary preview window and moving the auxiliary preview window from a first position to a second position in response to the drag operation.

[0018] According to the above method, the user can move the auxiliary viewfinder frame based on the image currently displayed in the image preview area, and minimize the coverage of the auxiliary viewfinder frame on the image displayed in the image preview display area.

[0019] According to a second aspect, there is provided an electronic device including a lens configured to obtain a picture to be taken, one or more processors, a memory, a plurality of applications, and one or more programs. The one or more programs are stored in the memory, and when the one or more programs are executed by the processor, the electronic device is capable of performing the steps of: displaying a shooting interface of the camera, where the shooting interface includes an image preview area that displays a first preview picture; detecting a first operation and, in response to the first operation, simultaneously displaying the image preview area and an auxiliary preview window on the shooting interface, where the auxiliary preview window displays a second preview picture. The first preview picture and the second preview picture are obtained by using the lens. The first preview picture is a framed picture at a first magnification, the second preview picture is a framed picture at a second magnification, the first preview picture is obtained by cropping the second preview picture, and the first magnification is greater than or equal to the second magnification.

[0020] In connection with the second aspect, in some implementations of the second aspect, the image preview area and the auxiliary preview window may be displayed in one of the following ways: at least a part of the auxiliary preview window overlaps with the image preview area; the auxiliary preview window is displayed outside the image preview area; or the auxiliary preview window is placed at the lower left corner of the image preview area.

[0021] In connection with the second aspect and the above-mentioned implementations, in some implementations of the second aspect, the first operation is a user's adjustment operation on the magnification in the magnification adjustment area. When one or more programs are executed by the processor, the electronic device can execute the step of automatically displaying an auxiliary preview window on the shooting interface when it detects that the first magnification is greater than or equal to the first threshold.

[0022] In connection with the second aspect and the above-mentioned implementations, in some implementations of the second aspect, the first operation is a user's operation to open the auxiliary preview window in the camera application.

[0023] In connection with the second aspect and the above-mentioned implementations, in some implementations of the second aspect, the auxiliary preview window further includes a close button. When one or more programs are executed by the processor, the electronic device can execute the step of closing the auxiliary preview window when it detects a user's operation on the close button.

[0024] In connection with the second aspect and the above-mentioned implementations, in some implementations of the second aspect, the auxiliary preview window further includes a target area. The image of the first preview picture is obtained by processing the image within the target area, and the target area is a fixed area within the auxiliary preview window or an arbitrary area within the auxiliary preview window.

[0025] In connection with the second aspect and the above implementation, in some implementations of the second aspect, when one or more programs are executed by a processor, the electronic device can detect a drag operation on an auxiliary preview window and execute steps to move the auxiliary preview window from a first position to a second position in response to the drag operation.

[0026] According to a third aspect, the present application provides an apparatus. The apparatus is included in an electronic device, and the apparatus has a function of implementing the behavior of the electronic device in the above aspects and possible implementations of the above aspects. The function can be implemented by using hardware or by using hardware that executes corresponding software. The hardware or software includes one or more modules or units corresponding to the aforementioned functions, such as a display module or unit, a detection module or unit, or a processing module or unit.

[0027] According to a fourth aspect, the present application provides an electronic device including a touch screen. The touch screen includes a touch sensing surface, a display, a camera, one or more processors, a memory, a plurality of applications, and one or more computer programs. The one or more computer programs are stored in the memory. The one or more computer programs include instructions. When the instructions are executed by the electronic device, the electronic device can execute a telephoto shooting method according to any possible implementation of any one of the above aspects.

[0028] According to a fifth aspect, the present application provides an electronic device including one or more processors and one or more memories. The one or more memories are coupled to the one or more processors. The one or more memories are configured to store computer program code, and the computer program code includes computer instructions. When the one or more processors execute the computer instructions, the electronic device can execute a telephoto shooting method according to any possible implementation of any one of the above aspects.

[0029] According to a sixth aspect, the present application provides a computer-readable storage medium including computer instructions. When the computer instructions are executed on an electronic device, the electronic device can execute a method according to any possible implementation of any one of the above aspects. Telephoto Photography

[0030] According to a seventh aspect, the present application provides a computer program product. When the computer program product is executed on an electronic device, the electronic device can execute a telephoto shooting method according to any possible implementation of any one of the above aspects.

Brief Description of the Drawings

[0031]

Figure 1

[0032]

Figure 2

[0033]

Figure 3

[0034]

Figure 4(a)

Figure 4(b)

Figure 4(c)

Figure 4(d)

[0035]

Figure 5(a)

Figure 5(b)

[0036]

Figure 6A

Figure 6B

[0037]

Figure 7

Embodiments for Carrying Out the Invention

[0038] The following describes the technical solutions in the embodiments of the present application with reference to the accompanying drawings in the embodiments of the present application. In the description of the embodiments of the present application, " / " means "or" unless otherwise specified. For example, A / B may represent A or B. In this specification, "and / or" only describes the relationship of association for explaining related objects and indicates that there may be three relationships. For example, A and / or B may represent the following three cases, that is, the case where only A exists, the case where both A and B exist, and the case where only B exists. In addition, in the description of the embodiments of the present application, "a plurality of" means two or more.

[0039] The following terms "first" and "second" are merely intended for explanation and should not be understood as an indication of relative importance or an implication thereof, nor as an implicit indication of the amount of technical features shown. Therefore, the features limited to "first" and "second" may explicitly or implicitly include one or more of the features, for example, the "first preview stream" and the "second preview stream" described in the embodiments of the present application.

[0040] The long-focus shooting method provided in the embodiments of the present application can be executed by any electronic device capable of implementing a shooting function, such as a mobile phone, a tablet computer, a wearable device, an in-vehicle device, an augmented reality (AR) / virtual reality (VR) device, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA). The specific type of the electronic device is not limited in the embodiments of the present application.

[0041] It should be understood that a lens, for example, a long-focus lens, is mounted within the electronic device. The lens may be a long-focus prime lens or may be a long-focus zoom lens that may appear in the future. The form of the lens is not limited in the present application.

[0042] For example, FIG. 1 is a schematic diagram of the structure of an electronic device 100 according to an embodiment of the present application. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headset jack 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display 194, a subscriber identification module (SIM) card interface 195, and the like. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, an optical proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

[0043] It can be understood that the structure shown in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In some other embodiments of the present application, the electronic device 100 may include more or fewer components than those shown in the drawings, some components may be combined, some components may be split, or different component arrangements may be used. The components shown in the drawings may be implemented by hardware, software, or a combination of software and hardware.

[0044] Processor 110 may include one or more processing units. For example, processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). Different processing units may be independent devices or may be integrated into one or more processors.

[0045] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal based on an instruction operation code and a time sequence signal to control instruction reading and instruction execution.

[0046] The memory may be further disposed within the processor 110 and configured to store instructions and data. In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, a universal serial bus (USB) interface, and / or the like.

[0047] The I2C interface is a bidirectional synchronous serial bus. The processor 110 may be coupled to the touch sensor 180K through the I2C interface. As a result, the processor 110 communicates with the touch sensor 180K through the I2C bus interface to implement the touch function of the electronic device 100. The MIPI interface may be configured to connect the processor 110 to peripheral components such as the display 194 or the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 communicates with the camera 193 through the CSI interface to implement the shooting function of the electronic device 100. The processor 110 communicates with the display 194 through the DSI to implement the display function of the electronic device 100.

[0048] It can be understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is merely an example for explanation and does not constitute a limitation on the structure of the electronic device 100. In some other embodiments of the present application, the electronic device 100 may alternatively use an interface connection method different from the interface connection method of the present embodiment, or a combination of multiple interface connection methods.

[0049] The charging management module 140 is configured to receive a charging input from a charger. The charger may be a wireless charger or a wired charger. The power management module 141 is configured to be connected to the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives inputs from the battery 142 and / or the charging management module 140 and supplies power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, the wireless communication module 160, etc.

[0050] The electronic device 100 implements a display function by using a GPU, a display 194, an application processor, etc. The GPU is a microprocessor for image processing and is connected to the display 194 and the application processor. The GPU is configured to execute mathematical and geometric calculations and render images. The processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0051] The display 194 is configured to display images, videos, etc. The display 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light emitting diode (AMOLED), a flexible light-emitting diode (FLED), a mini LED, a micro LED, a micro OLED, a quantum dot light emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or N displays 194, where N is a positive integer greater than 1.

[0052] The electronic device 100 can implement a photographing function by using an ISP, a camera 193, a touch sensor, a video codec, a GPU, a display 194, an application processor, etc. For example, in the embodiments of the present application, a telephoto photographing process is described.

[0053] The ISP is configured to process the data fed back by the camera 193. For example, when the shutter is pressed during shooting, light is sent through the lens to the photosensitive element of the camera. The light signal is converted into an electrical signal, and the photosensitive element of the camera transmits the electrical signal to the ISP for processing to convert the electrical signal into a visible image. The ISP may further perform algorithm optimization on the noise, brightness, and complexion of the image. The ISP may further optimize parameters such as the exposure and color temperature of the shooting scenario. In some embodiments, the ISP may be disposed within the camera 193.

[0054] The camera 193 is configured to capture a still image or video. The optical image of the object is generated through the lens and projected onto the photosensitive element. The photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) photosensitive element transistor. The photosensitive element converts the light signal into an electrical signal and then transmits the electrical signal to the ISP to convert the electrical signal into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard format such as RGB or YUV. It should be understood that in the description of the embodiments of the present application, an image in the RGB format is used as an example for illustration, and the image format is not limited in the embodiments of the present application. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0055] The digital signal processor is configured to process digital signals and may process another digital signal in addition to the digital image signal. For example, when the electronic device 100 selects a frequency, the digital signal processor is configured to perform a Fourier transform on the frequency energy.

[0056] The video codec is configured to compress or decompress digital video. The electronic device 100 may support one or more video codecs. Accordingly, the electronic device 100 may play or record in multiple coding formats, such as Moving Picture Experts Group (MPEG)-1, MPEG-2, MPEG-3, and MPEG-4, etc.

[0057] The external memory interface 120 may be configured to connect to an external memory card, such as a micro SD card, to expand the storage capacity of the electronic device 100. The internal memory 121 may be configured to store computer-executable program code, and the executable program code includes instructions. The processor 110 executes the instructions stored in the internal memory 121 and performs various functional applications and data processing of the electronic device 100. The internal memory 121 may include a program storage area and a data storage area.

[0058] The electronic device 100 may implement audio functions, such as playing and recording music, by using an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headset jack 170D, an application processor, etc.

[0059] The pressure sensor 180A is configured to sense a pressure signal and can convert the pressure signal into an electrical signal. The gyroscope sensor 180B may be configured to determine the motion posture of the electronic device 100. The barometric pressure sensor 180C is configured to measure barometric pressure. The magnetic sensor 180D includes a Hall effect sensor. The electronic device 100 can detect the opening and closing of the flip cover by using the magnetic sensor 180D. The acceleration sensor 180E can detect the acceleration of the electronic device 100 in various directions (usually three axes). The distance sensor 180F is configured to measure distance. The electronic device 100 can measure the distance in an infrared or laser manner. In some embodiments, in a shooting scenario, the electronic device 100 can measure the distance by using the distance sensor 180F to implement rapid focusing. The light proximity sensor 180G may include, for example, a light-emitting diode (LED) and an optical detector such as a photodiode. The ambient light sensor 180L is configured to sense the brightness of ambient light. The electronic device 100 can adaptively adjust the brightness of the display 194 based on the sensed brightness of the ambient light. The ambient light sensor 180L may be further configured to automatically adjust the white balance during shooting. The fingerprint sensor 180H is configured to collect fingerprints. The electronic device 100 can use the characteristics of the collected fingerprints to implement fingerprint-based unlocking, application lock access, fingerprint-based shooting, fingerprint-based call response, etc. The temperature sensor 180J is configured to detect temperature. The touch sensor 180K is also called a "touch panel". The touch sensor 180K may be disposed on the display 194. The touch sensor 180K and the display 194 constitute a touch screen. The touch sensor 180K is configured to detect a touch operation executed on or near the touch sensor 180K. The bone conduction sensor 180M can acquire a vibration signal. The audio module 170 can acquire an audio signal and implement an audio function through analysis based on the vibration signal of the vibrating bone in the voice part, which is acquired by the bone conduction sensor 180M.

[0060] The button 190 includes a power button, a volume button, etc. The button 190 may be a mechanical button or a touch button. The electronic device 100 can receive a button input and generate a button signal input related to user settings and function control of the electronic device 100. The motor 191 can generate a vibration prompt. The motor 191 may be configured to generate an incoming call vibration prompt and a touch vibration feedback. For example, touch operations (such as shooting and audio playback) executed in different applications may correspond to different vibration feedback effects. For touch operations executed in different areas of the display 194, the motor 191 may also correspond to different vibration feedback effects. The indicator 192 may be an indicator and may be configured to indicate a charging state and a power change, or may be configured to indicate a message, a missed incoming call, a notification, etc. The SIM card interface 195 is configured to connect to a SIM card.

[0061] The software system of the electronic device 100 may use a hierarchical architecture, an event-driven architecture, a microkernel architecture, a microservices architecture, or a cloud architecture. In one embodiment of the present application, an Android (registered trademark) system having a hierarchical architecture is used as an example to describe the software structure of the electronic device 100.

[0062] FIG. 2 is a block diagram of the software structure of the electronic device 100 according to an embodiment of the present application. In a hierarchical architecture, the software is divided into several layers, and each layer has a clear role and task. The layers communicate with each other through software interfaces. In some embodiments, the Android (registered trademark) system is divided into four layers from top to bottom: an application layer, an application framework layer, an Android (runtime) and a system library, and a hardware abstract layer (HAL).

[0063] The application layer may include a series of application packages. As shown in Figure 2, the application packages may include applications such as a camera, a gallery, music, and settings.

[0064] The application framework layer provides an application programming interface (API) and a programming framework for applications in the application layer. The application framework layer includes some defined functions. As shown in Figure 2, the application program framework layer may include a window manager, a content provider, a view system, a resource manager, a notification manager, etc.

[0065] The window manager is configured to manage window programs. The window manager can obtain the size of the display, determine whether there is a status bar, execute a screen lock, take a screenshot, etc.

[0066] The content provider is configured to store and obtain data and enable the data to be accessed by an application. The data may include videos, images, audio, outgoing and incoming calls, browsing history, bookmarks, address books, etc.

[0067] The view system includes visual controls such as controls for displaying text and controls for displaying pictures. The view system can be configured to build an application. The display interface may include one or more views. For example, a display interface including a message notification icon may include a text display view and a picture display view.

[0068] The resource manager provides an application with various resources such as localized strings, icons, pictures, layout files, and video files.

[0069] The notification manager enables an application to display notification information in the status bar and can be configured to transmit notification type messages of a. The notification information displayed in the status bar may automatically disappear after staying for a short pause, such as a message reminder used to notify the user that a download has been completed. Alternatively, the notification manager may be a notification that appears on the upper status bar of the system in the form of a graph or scroll bar text, such as a notification of an application running in the background or a notification that appears on the interface in the form of a dialog window. For example, text information is prompted and displayed within the status bar, and a prompt tone is generated by the notification manager. For example, the electronic device vibrates or an indicator blinks.

[0070] The Android (registered trademark) runtime includes a kernel library and a virtual machine. The Android (registered trademark) runtime is responsible for the scheduling and management of the Android (registered trademark) system. The kernel library includes two parts: functions that need to be called in the Java (registered trademark) language and the kernel library of Android (registered trademark).

[0071] The application layer and the application framework layer operate on the virtual machine. The virtual machine executes the Java (registered trademark) files of the application layer and the application framework layer as binary files. The virtual machine is configured to implement functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0072] The system library may include a plurality of functional modules, such as a surface manager, media libraries, a 3D graphics processing library (e.g., OpenGL ES), and a 2D graphics engine (e.g., SGL).

[0073] The surface manager manages the display subsystem and is configured to provide the fusion of 2D image layers and 3D image layers for a plurality of applications.

[0074] The media library supports playback and recording in a plurality of commonly used audio and video formats, still image files, etc. The media library may support a plurality of audio and video coding formats such as MPEG-4, H.264, MP3, AAC, AMR, JPG, and PNG.

[0075] The 3D graphics processing library is configured to implement 3D graphics drawing, image rendering, composition, layer processing, etc. The 2D graphics engine is a drawing engine for 2D drawing.

[0076] The HAL may be part of the kernel layer. Alternatively, the HAL is an independent layer, disposed between the kernel layer and the system library, and is a layer between hardware and software. The HAL may include hardware driver modules, such as a display driver, a camera driver, and a sensor driver. The application framework layer may call the hardware driver modules of the HAL.

[0077] In the telephoto shooting process described in the embodiments of this application, the user opens the camera application. The camera application is started in the application layer of FIG. 2 and sends an instruction to the HAL to start the camera driver, sensor driver, and display driver in the HAL, whereby the electronic device can start the camera or lens for collecting images. In the process of the camera collecting images, light is transmitted through the camera to the image sensor, and the image sensor performs a conversion from light to electricity on the optical signal to convert the optical signal into an image visible to the user. The output image data is transferred to the system library of FIG. 2 in the form of a data stream. The three-dimensional graphics processing library and the image processing library implement functions such as drawing, image rendering, synthesis, and layer processing to generate the display layer. The surface manager performs fusion processing and the like on the display layer, transfers the display layer to the view system of the content provider, window manager, and application framework layer, and controls the display of the display interface. Finally, the preview image is displayed in the image preview area of the camera application or on the display of the electronic device.

[0078] For ease of understanding, in the following embodiments of this application, an electronic device having the structure shown in FIGS. 1 and 2 is used as an example to describe the shooting process of the electronic device.

[0079] FIG. 3 is a schematic diagram of the control structure in the shooting process of the electronic device. The control structure 300 includes a lens 310, an image sensor 320, and an image signal processing (ISP) module 330.

[0080] Lens 310 may correspond to camera 193 of electronic device 100 in FIG. 1 and is configured to acquire images. For example, camera 193 may be embodied as one or more different lenses such as a wide-angle lens, a main lens, a telephoto lens, or a time of flight (TOF) lens. In embodiments of the present application, the form and quantity of the lens are not limited. In an embodiment of the present application, an example where the electronic device has a telephoto prime lens is used to explain the process of taking a telephoto photo by the electronic device using the telephoto prime lens.

[0081] Image sensor 320 is a semiconductor chip, and the surface of image sensor 320 includes hundreds of thousands to millions of photodiodes. When the photodiodes are irradiated with light, charges are generated and converted into digital signals by using an analog-to-digital converter. Image sensor 320 may be a charge coupled device (CCD), or may be a complementary metal-oxide semiconductor (CMOS). The CCD may be made of a highly photosensitive semiconductor material, can convert light into charges, and the charges are then converted into digital signals by an analog-to-digital converter chip. The CCD is usually composed of many photosensitive units in megapixel units. When the surface of the CCD is irradiated with light, each photosensitive unit reflects the charges on the component. The signals generated by all the photosensitive units are combined to form a complete picture. That is, the optical image is converted into a raw image. In some embodiments, image sensor 320 may also be referred to as a photosensitive chip, a photosensitive element, etc.

[0082] The ISP module 330 processes the raw image, performs optimization processing on the digital image signal through a series of complex mathematical algorithm operations, and finally can transmit the processed signal to the display of the electronic device, especially for displaying the image. The ISP module 330 may correspondingly be represented as an independent image processing chip or a digital signal processing (DSP) chip. Alternatively, the ISP module 330 may be a functional module corresponding to the processor 110 in the electronic device 100 shown in FIG. 1, and may include logic and firmware operating on the logic, and timely transfer the data acquired by the photosensitive chip to the processor 110 quickly and refresh the photosensitive chip. In addition, the ISP module 330 further performs algorithm optimization on the noise, brightness and appearance of the image, and may optimize parameters such as exposure parameters and color temperature in the shooting scenario.

[0083] Specifically, in the shooting process, the user opens the camera, and light is sent through the lens 310 to the image sensor 320. In other words, after the lens 310 projects the environmental light signal onto the photosensitive area of the image sensor 320, the image sensor 320 converts the environmental light signal into an image visible to the naked eye through optoelectronic conversion. Then, the raw internal image (in Bayer format) is sent to the ISP module 330. The ISP module 330 performs algorithm processing, outputs the image in the RGB space region to the back-end collection unit, and displays the image in the image preview area of the electronic device or on the display of the electronic device. In this process, the processor 110 uses the firmware executed on the processor 110 to perform corresponding control in the lens 310, the image sensor 320 and the ISP module 330, and completes the image preview or shooting function.

[0084] The following will detail the telephoto shooting method provided in the embodiments of the present application with reference to the accompanying drawings and application scenarios.

[0085] FIGS. 4(a) to 4(d) are schematic diagrams of a graphical user interface (GUI) in a telephoto shooting process according to an embodiment of the present application. In the present application, a mobile phone is used as an electronic device for explaining in detail the telephoto shooting method provided in the present application. FIG. 4(a) currently shows output interface content 401 displayed by the screen display system of the mobile phone in the unlocked mode of the mobile phone. The interface content 401 is the home screen of the mobile phone. The interface content 401 displays a plurality of applications (Apps), such as applications like album, settings, music, and camera. It should be understood that the interface content 401 may further include more applications. This is not limited in the present application.

[0086] As shown in FIG. 4(a), the user taps on the icon of the camera application, and in response to the user's tap operation, the mobile phone enters the preview interface 402 of the camera application shown in FIG. 4(b). The preview interface 402 of the camera application includes a plurality of menu areas, and each area includes various buttons used to implement various different functions of the camera application. For example, FIG. 4(b) shows the upper menu area 10, the zoom adjustment area 30, the image preview display area 40, and the lower menu area of the preview interface 402 of the camera application. It should be understood that the method of dividing the areas is not limited in this embodiment of the present application. The areas may be adjacent, separated, overlapping, etc. For the ease of explanation, in this embodiment of the present application, the areas of the preview interface 402 of the camera application are divided as shown by the dashed boxes in the figure.

[0087] The upper menu area 10 includes a plurality of buttons such as a flashlight button and an artificial intelligence (AI) recognition button so as to meet different shooting requirements of users. Details are not described in this specification. The magnification adjustment area 30 is used to display the magnification in the shooting process. The user can change the preview image of the shooting object by sliding above the magnification in the magnification adjustment area 30 and changing the shooting focal length of the mobile phone or the shooting lens.

[0088] For example, in FIG. 4(b), "1x" indicates that a preview image is obtained by using the main lens of the mobile phone (for example, the focal length is 27 millimeters), "0.7x" indicates that a preview image is obtained by using the wide-angle lens of the mobile phone (for example, the focal length is 16 millimeters), "5x" indicates that a preview image is obtained by using the telephoto lens of the mobile phone (for example, the focal length is 125 millimeters), and magnifications larger than "5x" (for example, "25x" and "50x") indicate that the image is currently obtained through digital zoom. For example, the preview image obtained at "50x" is obtained after processing such as cutting is performed at the center of the original framed picture of the telephoto lens of the mobile phone at "5x". Therefore, the framed area at "50x" only occupies 1 / 100 of the framed area of the mobile phone at "5x".

[0089] As shown in FIG. 4(b), the preview interface 402 of the camera application is currently displaying the framed picture at "1x". At the magnification of "1x", the panoramic view of the mountain can be seen. When the shooting target expected by the user is the trees on the mountain top in the dashed box 20 of FIG. 4(b), the shooting magnification of the camera can be adjusted. The user taps the setting icon in the upper menu area 10 of the preview interface 402, and in response to the user's tap operation, the mobile phone enters the camera setting interface 403 shown in FIG. 4(c). The camera setting interface 403 includes a plurality of menu bars, such as Resolution, Geographical location, Add watermark, Master AI, Reference line, Shooting sound, and Smile capture. The functions of the above-mentioned menus will not be described in detail in this embodiment of the present application.

[0090] In a possible implementation, in this embodiment of the present application, a switch for enabling the telephoto shooting function, that is, an auxiliary framed picture, is provided on the camera setting interface 403. For example, as shown in FIG. 4(c), the user taps the auxiliary framed picture switch to turn on the auxiliary framed picture switch (to the "ON" state). That is, the telephoto shooting function provided in this embodiment of the present application is enabled. When the user enables the telephoto shooting function, the preview interface of the camera application is displayed. When the user adjusts and increases the magnification as shown in FIG. 4(d), the auxiliary viewfinder frame 50 is further displayed on the preview interface 404. The auxiliary viewfinder frame 50 may display the framed picture at "5x" in FIG. 4(b), and the image preview display area 40 displays the enlarged framed picture.

[0091] It should be understood that this embodiment of the present application describes the telephoto shooting process of a mobile phone. When the magnification is "5x", the camera enters the telephoto shooting mode, that is, framing is performed by using the telephoto lens. As the magnification increases, framing is performed by using the telephoto lens. Preview images at different magnifications are obtained after performing processes such as cropping on the framed picture of the telephoto lens at "5x". The shooting process and the process of obtaining the preview image at magnifications less than "5x" are not limited in the embodiments of the present application.

[0092] Optionally, when the user enables the auxiliary framing picture switch and the preview interface 404 of the camera application is displayed, the auxiliary viewfinder frame 50 is continuously displayed on the preview interface 404. When the user is not adjusting the magnification, that is, when the magnification is "1x", the auxiliary viewfinder frame 50 and the image preview display area 40 may have the same preview image, which is the framed picture obtained by the main lens of the mobile phone. After the user adjusts the magnification to "50x" and increases it, the auxiliary viewfinder frame 50 may display the framed picture at "5x" in FIG. 4(b), and the image preview display area 40 displays the framed picture enlarged to "50x".

[0093] Optionally, when the user enables the auxiliary framed picture switch and the preview interface 404 of the camera application is displayed, the auxiliary viewfinder frame 50 is not displayed. When the user adjusts and increases the magnification so that it is above a specific threshold value (e.g., "10x"), the auxiliary viewfinder frame 50 is displayed on the preview interface 404. For example, the user enables the auxiliary framed picture switch and the preview interface 404 of the camera application is displayed. When the magnification is currently "1x", the auxiliary viewfinder frame 50 is not displayed. When the user slides the magnification to adjust it to "10x", the auxiliary viewfinder frame 50 is displayed on the preview interface 404. The auxiliary viewfinder frame 50 may display a framed picture at "5x" as shown in FIG. 4(b), and the image preview display area 40 displays a framed picture enlarged to "10x".

[0094] In another possible implementation, the switch for enabling the telephoto shooting function, i.e., the auxiliary framed picture switch, may be set at any position on the preview interface 402 of the camera application. For example, the auxiliary framed picture switch is set in the upper menu area 10. The user does not need to enable the telephoto shooting function by setting a button, but can directly tap the auxiliary framed picture switch in the upper menu area 10 to enable the telephoto shooting function, and the auxiliary viewfinder frame 50 is displayed.

[0095] In another possible implementation, the telephoto shooting function is enabled by default, and the auxiliary framed picture switch is not set in the camera application. When it is determined that the current shooting meets the pre-set conditions, the auxiliary viewfinder frame 50 is automatically displayed on the preview interface 402 of the camera application.

[0096] Optionally, the preset condition may be determined by the user sliding the magnification to adjust it to be "10x" or more. For example, when the user slides the magnification to be equal to "10x", the auxiliary viewfinder frame 50 is automatically displayed on the preview interface 402 of the camera application, and the auxiliary viewfinder frame 50 displays a framed picture at "5x" as shown in FIG. 4(b), and the image preview display area 40 displays a framed picture enlarged to "10x".

[0097] In an embodiment of the present application, the provided auxiliary viewfinder frame 50 may be used to display a framed picture acquired by the telephoto lens of the mobile phone at "5x", and the image preview display area 40 displays a framed picture acquired after the user adjusts the magnification. During telephoto shooting, according to this method, two viewfinder frames may be simultaneously displayed in the image preview display area 40, and the two viewfinder frames provide the user with preview pictures of two different fields of view. For an electronic device having a telephoto prime lens whose lens axis cannot be rotated, this method can make it easier for the user to find the subject of the shooting target in the telephoto shooting process.

[0098] In a possible implementation, the auxiliary viewfinder frame 50 includes a close button 70. The close button 70 may be arranged at the upper right corner of the auxiliary viewfinder frame 50. The user can close the auxiliary viewfinder frame 50 by tapping the close button 70. For example, when the user finishes focusing and the subject of the shooting target is displayed within the image preview area 40, the user may close the auxiliary viewfinder frame 50, whereby there may be a larger image preview area, which is convenient for the user to view the image preview image.

[0099] In a possible implementation, the auxiliary viewfinder frame 50 includes a target area, and the target area is used to determine the subject to be photographed. For example, as shown in FIG. 4(d), the auxiliary viewfinder frame 50 includes a target area 60, and the target area 60 is used to determine the "trees on the mountaintop" that the user expects to photograph. When the user adjusts the magnification to "50x" for telephoto shooting, the user uses the auxiliary viewfinder frame 50 and moves the "trees on the mountaintop" to the target area 60 by adjusting the angle of the lens of the mobile phone or the like. In this way, it can be ensured that the image preview display area 40 presents the trees on the mountaintop enlarged by "50x".

[0100] When the magnification is set to "50x" for shooting, the FOV of the mobile phone is about 0.5 degrees. If the user moves the mobile phone slightly or shakes occur during shooting, the shake and deviation will increase. As a result, the picture in the image preview display area 40 will shift greatly, and the subject to be photographed will deviate from the image preview display area 40. In this case, it is difficult for the user to find the subject to be photographed. By using the auxiliary viewfinder frame 50, the user can intuitively understand and adjust operations such as manually adjusting the angle of the lens of the mobile phone, and can move the "trees on the mountaintop" of the subject to be photographed to the target area 60, so that the "trees on the mountaintop" of the subject to be photographed are displayed within the image preview display area 40. Therefore, this method can improve the operation efficiency.

[0101] Optionally, the auxiliary viewfinder frame 50 is displayed at the lower left corner of the image preview display area 40 of the mobile phone, and the target area 60 can be arranged at the center position of the auxiliary viewfinder frame 50. For example, as shown in FIG. 4(d), the auxiliary viewfinder frame 50 is arranged at the lower left corner of the image preview display area 40, and the target area 60 can be arranged in the central area of the auxiliary viewfinder frame 50. By such a display method, the coverage of the auxiliary viewfinder frame 50 on the image preview display area 40 can be reduced, which is convenient for the user to quickly display "the trees on the mountaintop" within the image preview display area 40.

[0102] In a possible implementation, the auxiliary viewfinder frame 50 may move within the image preview display area 40 based on a user operation. FIGS. 5(a) and 5(b) are schematic diagrams of a graphical user interface of another telephoto shooting process according to an embodiment of the present application. For example, as shown in FIG. 5(a), the user taps on an arbitrary position of the auxiliary viewfinder frame 50 and drags the auxiliary viewfinder frame 50 upward. In response to the user's drag operation, the auxiliary viewfinder frame 50 moves from the lower left corner to the upper left corner of the image preview display area 40.

[0103] According to the above method, the user can move the auxiliary viewfinder frame 50 based on the image currently displayed in the image preview display area 40, and minimize the coverage of the auxiliary viewfinder frame 50 on the image displayed in the image preview display area 40.

[0104] Optionally, the position of the target area 60 within the auxiliary viewfinder frame 50 may also be moved based on user operation. For example, when the user fixes the mobile phone by using a device such as a tripod, the shooting angle of the mobile phone is fixed. Therefore, within the auxiliary viewfinder frame 50, the shooting target is not located in the central area of the auxiliary viewfinder frame 50. As shown in FIG. 5(b), within the auxiliary viewfinder frame 50, the "trees on the mountaintop" of the shooting target are displayed within the lower left area of the auxiliary viewfinder frame 50. In this case, the preview image of the trees on the mountaintop cannot be displayed in the image preview display area 40. The user may perform the operation shown in FIG. 5(b), tap on any position within the target area 60, and drag the target area 60 to the lower left, so that the target area 60 includes the shooting target, that is, the "trees on the mountaintop". In response to the user's drag operation, the position of the target area 60 within the auxiliary viewfinder frame 50 changes. When the target area 60 includes the "trees on the mountaintop", the image preview display area 40 may display the trees on the mountaintop that the user expects to shoot.

[0105] When the image preview area 40 and the auxiliary viewfinder frame 50 are displayed simultaneously, it should be understood that the picture in the image preview area 40 is obtained after enlarging the picture in the target area 60 within the auxiliary viewfinder frame 50. For example, the telephoto shooting at "50x" shown in FIG. 4(d) is used as an example. A picture obtained at "5x" by the telephoto lens of the mobile phone is within the auxiliary viewfinder frame 50. The camera application determines the position of the target area 60 within the auxiliary viewfinder frame 50 in order to determine the image data included in the picture within the target area 60, and may determine the range of the picture circled by the target area 60. The camera application is executed on the processor 110, that is, the processor 110 can learn the position information of the target area 60. The processor 110 transmits the position information of the target area 60 to the ISP module 330, and the ISP module 330 executes a cropping process on the picture obtained at "5x" by the telephoto lens to obtain a new picture, and further transfers the image data of the new image enlarged to "50x" to the HAL and the application layer for display. Finally, the picture obtained after the picture in the target area 60 is enlarged to "50x" is displayed in the image preview area 40. Similarly, regardless of whether the target area 60 is a fixed area or an area that can be manually dragged by the user, the camera application can determine the position information of the target area 60 and further enlarge the picture included in the target area 60, etc. Details are not described in this specification.

[0106] According to the above method, the user can move the target area 60 within the auxiliary viewfinder frame 50 based on the current shooting requirements. As a result, the user can quickly find the shooting target without changing the shooting angle of the mobile phone or the lens.

[0107] As described above, with reference to FIGS. 4(a) to 4(d) and FIGS. 5(a) and 5(b), multiple methods for displaying the auxiliary viewfinder frame 50 on the preview interface 404 of the camera application by enabling the telephoto shooting function have been described. Hereinafter, with reference to FIGS. 6(a), 6(b) and 7, the internal implementation process of telephoto shooting will be described.

[0108] FIGS. 6A and 6B are flowcharts of the implementation of the telephoto shooting process according to an embodiment of the present application. As shown in FIGS. 6A and 6B, the implementation process of method 600 can be divided into three phases: the ISP processing phase, the HAL processing phase, and the application layer processing phase. Referring to the software architecture of FIG. 2 and the control structure of the shooting process of FIG. 3, the ISP processing phase may be executed by the ISP module 330, and the HAL processing phase and the application layer processing phase are executed by the processor 110. The HAL processing phase is correspondingly executed in the HAL, and the application layer processing phase is executed in the application layer. Specifically, method 600 includes the following steps.

[0109] 601: The mobile phone enters the telephoto shooting mode.

[0110] It should be understood that the "telephoto shooting mode" described in this embodiment of the present application can be understood as obtaining the current preview image by the telephoto lens of the mobile phone. For example, when the magnification of the mobile phone is greater than "5x", the original framed picture can be obtained by using the telephoto lens of the mobile phone. The preview image with a magnification such as "25x" or "50x" is obtained after performing processing such as cropping from the center of the original framed picture obtained at "5x".

[0111] It should be further understood that in this embodiment of the present application, the telephoto shooting mode is not limited to the shooting mode or video recording mode of the mobile phone. In other words, the mobile phone may take a photo or record a video in the telephoto shooting mode.

[0112] Optionally, the user may slide the magnification within the magnification adjustment area 30 of the mobile phone. When the magnification reaches the first threshold value (for example, "5x"), the mobile phone automatically switches the lens to the telephoto shooting mode and acquires the original framed picture by using the telephoto lens of the mobile phone. Alternatively, the lens may enter the telephoto shooting mode in another way such as user settings. This is not limited in this embodiment of the present application.

[0113] 602: The ISP module 330 of the mobile phone generates a first preview stream.

[0114] Referring to the related descriptions in FIGS. 2 and 3, the first preview stream may also be referred to as the "original preview stream". It can be understood that the optical signal acquired by the lens 310 is sequentially subjected to algorithm processing of the image sensor 320 and the ISP module 330, and the image data in the RGB space region is output. The image data may be sent in the form of a data stream to the display unit of the mobile phone, for example, to the surface manager and the three-dimensional graphics processing library in the system library of FIG. 2, to complete image rendering, synthesis, layer processing, etc. for the final display in the image preview area of the mobile phone display.

[0115] 603: The ISP module 330 of the mobile phone determines whether digital zoom is currently being executed.

[0116] In this embodiment of the present application, digital zoom can be understood as follows: That is, in the telephoto shooting process, when an image is acquired after performing processing such as cropping on the original framed picture acquired at a specific magnification (for example, "5x"), it should be understood that this process can be understood as a digital zoom process.

[0117] Optionally, the ISP module 330 of the mobile phone may determine whether digital zoom is currently being executed based on whether the current magnification is equal to or greater than a second threshold value. It should be understood that the second threshold value may be equal to or greater than the first threshold value. When the second threshold value is equal to the first threshold value, for example, when both the second threshold value and the first threshold value are "5x", that is, when the mobile phone enters the telephoto shooting mode, the process of acquiring an image is a digital zoom process. When the second threshold value is greater than the first threshold value, for example, when the first threshold value is "5x" and the second threshold value is "10x", that is, when the magnification is "5x", the mobile phone enters the telephoto shooting mode, and when the magnification is "10x", the process of acquiring an image is a digital zoom process.

[0118] 604: If it is determined that the current image acquisition method is not a digital zoom process, the ISP module 330 of the mobile phone uses the first preview stream as the primary preview stream and sends only the first preview stream to the HAL.

[0119] It should be understood that in this specification, the "primary preview stream" can be understood as image data within the RGB spatial region and displayed within the image preview display area 40. Similarly, in this application, image data within the RGB spatial region and displayed within the auxiliary viewfinder frame 50 may be referred to as the "auxiliary preview stream".

[0120] The foregoing steps 601 to 604 are ISP processing procedures completed by the ISP module 330. The ISP module 330 sends the first preview stream to the HAL.

[0121] 605: The HAL of the mobile phone performs image quality optimization on the primary preview stream and sends the processed image data of the primary preview stream to the application layer.

[0122] Specifically, under the control of the processor 110, the HAL of the mobile phone may superimpose an image quality optimization algorithm on the first preview stream. For example, the optimization algorithm may include color temperature adjustment, noise reduction processing, smoothing processing, or white balance processing, etc. The type and method of the optimization algorithm are not limited in this embodiment of the present application.

[0123] 606: The camera application in the application layer of the mobile phone draws the primary preview picture in the image preview area.

[0124] The process of step 606 can be understood as follows: That is, the ISP module 330 of the mobile phone transfers the image data of the first preview stream to the processor 110, and the processor 110 completes image rendering, synthesis, layer processing, etc., and finally controls the surface manager, three-dimensional graphics processing library, etc. in the system library of FIG. 2 to display the image data in the image preview area of the mobile phone.

[0125] 607: The camera application of the mobile phone determines whether the current auxiliary preview conditions are met.

[0126] The determination process of step 607 may be agreed upon by the ISP module 330 and the application layer. When the ISP module 330 determines that the current image acquisition method is not the digital zoom process and the auxiliary preview conditions are not met, the camera application may determine that the auxiliary preview conditions are not met. Alternatively, when the ISP module 330 determines that the current image acquisition method is not the digital zoom process, the camera application may not execute step 607.

[0127] 608: Complete rendering of the image preview interface

[0128] The foregoing steps 601 to 604 are ISP processing procedures completed by the ISP module 330. In other words, when the first preview stream is processed in the HAL processing phase in step 605 and the primary preview picture is displayed in the image preview area in step 606, a visible image can be output to the image preview area of the camera application for the user. The above is the entire process of displaying the preview picture on the mobile phone at "1x".

[0129] 609: When the ISP module 330 of the mobile phone determines in step 603 that the current image acquisition method is a digital zoom process, the ISP module 330 generates a second preview stream.

[0130] Optionally, when the current magnification is equal to or greater than a second threshold, for example, greater than "5x", the ISP module 330 of the mobile phone determines that the current image acquisition method is a digital zoom process.

[0131] The second preview stream may also be referred to as a "digital zoom preview stream", is within the RGB spatial region, and can be understood as output image data corresponding to a framed picture obtained after performing processing such as cropping on the original framed picture acquired at "5x" starting from the center. For example, when the user adjusts the magnification to "10x" for shooting, the second preview stream is output image data corresponding to the "10x" framed picture.

[0132] 610: The ISP module 330 of the mobile phone determines whether the auxiliary preview condition is currently satisfied.

[0133] Optionally, the determination process in step 610 may be to determine whether the user turns on the auxiliary framed picture switch. For example, in the method described in FIGS. 4(b) and 4(c), the user manually turns on the auxiliary framed picture switch, that is, the ISP module 330 of the mobile phone determines that the auxiliary preview condition is currently satisfied.

[0134] Alternatively, the telephoto shooting function may be enabled by default, and the user may not need to manually turn on the auxiliary framed picture switch. When the mobile phone determines that the current shooting meets the preset conditions, the ISP module 330 of the mobile phone determines that the auxiliary preview condition is currently satisfied. For example, the preset condition may be that the mobile phone determines that the current shooting magnification is "10x" or more.

[0135] When any one of the foregoing conditions is satisfied and the ISP module 330 of the mobile phone determines that the auxiliary preview condition is currently satisfied, the auxiliary viewfinder frame 50 is automatically displayed on the preview interface of the camera application, and step 612 is executed. Otherwise, when the ISP module 330 of the mobile phone determines that the auxiliary preview condition is not currently satisfied, the auxiliary viewfinder frame 50 is automatically displayed on the preview interface of the camera application, and step 611 is executed.

[0136] 611: When the ISP module 330 of the mobile phone determines that the auxiliary preview condition is not currently satisfied, the ISP module 330 of the mobile phone uses the second preview stream as the primary preview stream and transmits only the second preview stream.

[0137] Next, steps 605, 606, and 608 are continuously executed. Only the second preview stream is used as the primary preview stream, and image quality optimization is performed on the second preview stream by using the HAL. The processed data stream is transmitted to the display unit of the mobile phone. The primary preview picture is displayed within the image preview area of the camera application in the application layer of the mobile phone. That is, the image visible to the user is output within the image preview area of the camera application. For example, in the case where the user takes a photo at a magnification of "9x", the above is the entire process of displaying the preview picture magnified by "9x" by the mobile phone.

[0138] 612: When the ISP module 330 of the mobile phone determines that the auxiliary preview condition is currently satisfied, the ISP module 330 of the mobile phone uses the second preview stream as the primary preview stream, uses the first preview stream as the auxiliary preview stream, and transmits both the first preview stream and the second preview stream to the HAL.

[0139] It should be understood that when the ISP module 330 of the mobile phone determines that the auxiliary preview condition is currently satisfied, as shown in FIG. 4(d) or FIGS. 5(a) and 5(b), the auxiliary viewfinder frame 50 can be automatically displayed on the preview interface of the camera application. For example, the user executes shooting at a magnification of "50x". As shown in FIG. 4(d), the image preview display area 40 of the mobile phone displays the enlarged preview image at "50x", and the preview picture corresponds to the image data included in the "second preview stream" (or called the "primary preview stream"). The auxiliary viewfinder frame 50 of the mobile phone displays the original framed picture at "5x", and the original framed picture of the auxiliary viewfinder frame 50 corresponds to the image data included in the "first preview stream" (or called the "auxiliary preview stream"). The ISP module 330 of the mobile phone transmits both the first preview stream and the second preview stream to the HAL, that is, reports the image data of the two preview streams. The image data reporting process of the two preview streams may be executed simultaneously. It should be understood that the image data reporting process of the two preview streams is not limited in this embodiment of the present application.

[0140] 613: In the HAL of the mobile phone, perform image quality optimization for the first preview stream and the second preview stream. For the process, refer to the relevant description in step 605. Details are not described again here.

[0141] 606: The camera application in the application layer of the mobile phone draws the primary preview picture in the image preview area.

[0142] 607: The camera application of the mobile phone determines whether the auxiliary preview condition is currently satisfied.

[0143] For the determination process of step 607, refer to the determination process of ISP module 330 in step 610. The determination process may be agreed upon by the ISP module 330 and the application layer, and is shown using the dashed boxes in FIGS. 6A and 6B. It should be understood that step 607 may coincide with step 610, and the camera application may not need to execute step 607.

[0144] For example, if the ISP module 330 determines in step 610 that the auxiliary preview condition is currently satisfied, the camera application can also draw the primary preview picture based on the processed image data of the second preview stream sent to the application layer by using step 606, that is, display the preview picture enlarged by "50x" within the image preview display area 40, and draw the auxiliary preview picture based on the processed image data of the first preview stream sent to the application layer by using step 614, that is, know that the auxiliary preview condition is currently satisfied so as to display the original framed picture in the auxiliary viewfinder frame 50 by "5x".

[0145] Alternatively, if the ISP module 330 determines in step 610 that the auxiliary preview condition is not currently satisfied, the camera application can also know that the auxiliary preview condition is not currently satisfied, and draw the primary preview picture based on the processed image data of the second preview stream sent to the application layer by using step 606, that is, display the enlarged preview picture by "50x" within the image preview display area 40, and not display the auxiliary viewfinder frame 50.

[0146] According to the processes of steps 601-603, 609 and 610, 612 and 613, 606, 607, 614, and 608 described above, the primary preview picture enlarged to "50x" may be displayed within the image preview area, and the original framed picture may be displayed within the auxiliary viewfinder frame 50 at "5x". For example, as shown in FIG. 4(d), the auxiliary viewfinder frame 50 displays the original framed picture obtained by the telephoto lens of the mobile phone at "5x", that is, it is used to display the entire mountain, and the image preview display area 40 displays the framed picture obtained after the user adjusts the magnification to "50x", that is, it displays the trees on the mountaintop. During telephoto shooting, according to this method, two viewfinder frames may be simultaneously displayed within the image preview display area 40, and the two viewfinder frames provide the user with preview pictures of two different fields of view. For an electronic device having a telephoto prime lens and whose lens axis cannot be rotated, this method can make it easier for the user to find the subject of the shooting target during the telephoto shooting process.

[0147] The display of the target area 60 within the auxiliary viewfinder frame 50 may be controlled by the camera application. When it is detected that the subject of the shooting target within the auxiliary viewfinder frame 50 is deviated from the central area, the mobile phone may automatically display the target area 60. As a result, the user adjusts the angle of the lens of the mobile phone, the subject of the shooting target is moved to the target area 60, and the subject of the shooting target can be found more easily.

[0148] In addition, the position coordinates of the auxiliary viewfinder frame 50 on the display may be determined in multiple ways.

[0149] FIG. 7 is a schematic diagram of coordinates on the interface of a mobile phone according to an embodiment of the present application. As shown in FIG. 7, on the display of the mobile phone, the starting point O0 at the upper left corner of the display is used as the origin of the coordinates, and the pixels in the horizontal direction (X-axis direction) and the vertical direction (Y-axis direction) are used to represent the size of the display. The size of the display of the mobile phone is 640×960, which indicates that the display includes 640 pixels in the X-axis direction and 960 pixels in the Y-axis direction. In the subsequent description of the coordinates, the numbers are the position coordinates of the pixels. It should be understood that a larger amount of pixels occupied in a certain direction indicates a more sophisticated and delicate display effect.

[0150] In a possible embodiment, the position coordinates of the auxiliary viewfinder frame 50 on the display may be the coordinates preset in the camera application. For example, the mobile phone may specify the initial vertex coordinates O, the amount of pixels included in the X-axis direction x, and the amount of pixels included in the Y-axis direction y of the auxiliary viewfinder frame 50. For example, after the initial vertex coordinates O(0, 320), the amount of pixels included in the X-axis direction 100, and the amount of pixels included in the Y-axis direction 150 are specified, as shown in FIG. 4(d), the auxiliary viewfinder frame 50 may be displayed at the lower right corner of the image preview area 40 of the display.

[0151] Optionally, the mobile phone 100 may determine the coordinates and size of the auxiliary viewfinder frame 50 displayed in the image preview area 40 based on the picture currently displayed in the image preview area 40 of the camera application of the mobile phone. For example, when the mobile phone detects that the shooting target of the framed picture in the image preview area 40, that is, the trees on the mountain top, is closer to the right side of the mobile phone, the blank area on the left other than the shooting target is larger than the area on the right, and the auxiliary viewfinder frame 50 is first displayed at the upper left corner shown in FIG. 5(a). In such a display method, the magnification adjustment area 30 on the right may not be covered, facilitating user operation.

[0152] In the method described with reference to Fig. 5(a), it should be understood that the auxiliary viewfinder frame 50 of the mobile phone in this specification can receive a drag operation from the user and move within the image preview display area 40. After the auxiliary viewfinder frame 50 moves, the camera application can re-determine the new coordinates of the auxiliary viewfinder frame 50 and update the coordinate information of the auxiliary viewfinder frame 50, ensuring that the image data included in the first preview stream is accurately displayed within the auxiliary viewfinder frame 50.

[0153] Similarly, as shown in Fig. 5(b), the target area 60 within the auxiliary viewfinder frame 50 can also receive a drag operation from the user, and both the changed coordinate information of the target area 60 and the surrounded subject of the shooting target within the target area 60 can be acquired by the camera. Therefore, in the digital zoom process, when processing such as cropping is performed on the acquired original framed picture, the surrounded subject of the shooting target within the target area 60 is accurately processed, and a second preview stream is further generated. Details are not described again here.

[0154] According to the above method, the user can move the target area 60 within the auxiliary viewfinder frame 50 based on the current shooting requirements, and as a result, the user can quickly find the shooting target without changing the shooting angle of the mobile phone or the lens.

[0155] To implement the foregoing functions, it can be understood that the electronic device includes corresponding hardware and / or software modules for executing the functions. The example algorithm steps described in connection with the embodiments disclosed herein can be implemented in the form of hardware or in combination with hardware and computer software in this application. Whether a function is executed by hardware or by hardware driven by computer software depends on the specific application and the design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application with reference to the embodiments, but such implementation should not be considered as exceeding the scope of this application.

[0156] In an embodiment, the electronic device may be divided into function modules based on the examples in the foregoing method. For example, each function module such as a detection unit, a processing unit, or a display unit corresponding to each function may be obtained through division, or two or more functions may be integrated into one processing module. The integrated module may be implemented in the form of hardware. It should be noted that the division into modules in the embodiment is only an example and is merely a division of logical functions. There may be other division methods during actual implementation.

[0157] It should be noted that all relevant contents of the steps in the embodiments of the foregoing method may be cited in the function descriptions of the corresponding function modules. Details are not described again here.

[0158] The electronic device provided in this embodiment is configured to execute a telephoto shooting method. Therefore, the same effects as the above-described implementation method can be achieved.

[0159] When an integrated unit is used, the electronic device may alternatively include a processing module, a memory module, and a communication module. The processing module may be configured to control and manage the operation of the electronic device. The memory module may be configured to support the electronic device by storing program code, data, and the like. The communication module may be configured to support communication between the electronic device and another device.

[0160] The processing module may be a processor or a controller. The processing module may implement or execute various exemplary logic blocks, modules, and circuits described in connection with the content disclosed in this application. The processor may alternatively be a combination for implementing computing functions, such as a combination including one or more microprocessors or a combination of digital signal processing (DSP) and a microprocessor. The memory module may be a memory. The communication module may specifically be a device that interacts with another electronic device, such as a radio frequency circuit, a Bluetooth (registered trademark) chip, or a Wi-Fi chip.

[0161] In one embodiment, when the processing module is a processor and the memory module is a memory, the electronic device of this embodiment may be a device having the structure shown in FIG. 1.

[0162] The embodiment further provides a computer storage medium. The computer storage medium stores computer instructions. When the computer instructions are executed on the electronic device, the electronic device can execute the relevant method steps and implement the long-focus shooting method in the foregoing embodiments.

[0163] The embodiment further provides a computer program product. When the computer program product is executed on a computer, the computer can execute the foregoing relevant steps and implement the long-focus shooting method in the foregoing embodiments.

[0164] In addition, embodiments of the present application further provide an apparatus. The apparatus can be, in particular, a chip, a component or a module. The apparatus may include a connected processor and a memory. The memory is configured to store computer-executable instructions, and when the apparatus executes, the processor can execute the computer-executable instructions stored in the memory. As a result, the chip can execute the long-focus shooting method in the embodiments of the above-described method.

[0165] All of the electronic device, computer storage medium, computer program product and chip provided by the embodiments are configured to execute the corresponding method provided above. Therefore, for the beneficial effects that can be achieved by the electronic device, computer storage medium, computer program product and chip, reference is made to the beneficial effects of the corresponding method described above. Details are not described again here.

[0166] The foregoing description of the implementation enables those skilled in the art to understand that the above division into functional modules is used as an example for explanation for the sake of convenience and concise description. In actual applications, the above functions can be assigned to different modules for implementation according to requirements, that is, the internal structure of the apparatus is divided into different functional modules to implement all or part of the above functions.

[0167] In some embodiments provided by this application, it should be understood that the disclosed devices and methods may be implemented in other ways. For example, the described device embodiments are merely examples. For example, the division into modules or units is merely a logical function division, and in actual implementation, other divisions may be possible. For example, multiple units or components may be combined or integrated into another device, or some features may be ignored or not executed. Additionally, the disclosed couplings, direct couplings, or communication connections may be implemented via some interfaces. The indirect couplings or communication connections between devices or units may be implemented in electronic, mechanical, or other forms.

[0168] The units described as separate parts may or may not be physically separated, and the parts shown as units may be one or more physical units. In other words, they may be located in one place or dispersed in different places. Some or all of the units may be selected according to actual requirements to achieve the purpose of the solution in the embodiments.

[0169] In addition, the functional units in the embodiments of this application may be integrated into one processing unit, each unit may exist physically alone, or two or more units may be integrated into one unit. The integrated unit may be implemented in the form of hardware or in the form of a software functional unit.

[0170] When the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, the integrated unit may be stored in a readable storage medium. Based on such understanding, essentially the technical solution of the embodiments of the present application, the part contributing to the prior art, or all or part of the technical solution may be implemented in the form of a software product. The software product is stored in a storage medium and includes several instructions for instructing an apparatus (which may be a single-chip microcomputer, a chip, etc.) or a processor to execute all or part of the steps of the method described in the embodiments of the present application. The aforementioned storage medium includes any medium that can store program codes, such as a USB flash drive, a removable hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0171] The foregoing description is merely a specific implementation of the present application, but is not intended to limit the protection scope of the present application. In the technical scope disclosed in the present application, changes or substitutions that can be easily understood by those skilled in the art shall be included in the protection scope of the present application. Therefore, the protection scope of the present application shall follow the protection scope of the claims.

Claims

1. A telephoto shooting method executed by an electronic device including a lens, the method comprising: displaying a shooting interface of a camera of the electronic device, the shooting interface including an image preview area, the image preview area displaying a first preview stream and a magnification adjustment area, the first preview stream being a framed stream at a first magnification; detecting a first operation, the first operation being a magnification adjustment operation performed by a user on the magnification adjustment area displayed on the image preview area to adjust the first magnification of the first preview stream; in response to the first magnification being adjusted to be equal to or greater than a first threshold by the first operation, displaying an auxiliary preview window together with the image preview area on the shooting interface, the auxiliary preview window displaying a second preview stream; including the second preview stream being a framed stream at a second magnification, the first preview stream being obtained by cropping the second preview stream, the second magnification being smaller than the adjusted first magnification; a method.

2. The image preview area and the auxiliary preview window at least a part of the auxiliary preview window overlapping the image preview area, the auxiliary preview window being displayed at a position outside the image preview area, or the auxiliary preview window being arranged at the lower left corner of the image preview area, The method according to claim 1, wherein the method is displayed in any one of the above ways.

3. The auxiliary preview window further includes a close button. After the electronic device displays the auxiliary preview window on the shooting interface, the method further includes: when the electronic device detects a user operation on the close button, closing the auxiliary preview window by the electronic device; The method according to claim 1 or 2, further including.

4. The auxiliary preview window further includes a target area, and the image of the first preview stream is obtained by processing the image within the target area. The target area is a fixed area within the auxiliary preview window, or the target area is an arbitrary area within the auxiliary preview window. The method according to any one of claims 1 to 3.

5. The method further includes detecting a drag operation on the auxiliary preview window and moving the auxiliary preview window from a first position to a second position in response to the drag operation. The method according to any one of claims 1 to 4, further comprising the above.

6. An electronic device, the electronic device A lens configured to obtain a picture to be taken, One or more processors, a memory, a plurality of applications, and one or more programs, wherein the one or more programs are stored in the memory, and when the one or more programs are executed by the processor, the electronic device Displaying a camera shooting interface, the shooting interface including an image preview area, the image preview area displaying a first preview stream and a magnification adjustment area, the first preview stream being a framed stream at a first magnification. Detecting a first operation, the first operation being a magnification adjustment operation performed by a user on the magnification adjustment area displayed on the image preview area to adjust the first magnification of the first preview stream. In response to the first magnification being adjusted to be equal to or greater than a first threshold value by the first operation, displaying an auxiliary preview window together with the image preview area on the shooting interface, the auxiliary preview window displaying a second preview stream. It becomes possible to execute The second preview stream is a framed stream at a second magnification, the first preview stream is obtained by cropping the second preview stream, and the second magnification is smaller than the adjusted first magnification. Electronic device.

7. The image preview area and the auxiliary preview window at least a part of the auxiliary preview window overlapping with the image preview area, the auxiliary preview window being displayed at a position outside the image preview area, or the auxiliary preview window being arranged at the lower left corner of the image preview area, The electronic device according to claim 6, which is displayed in any one of the above ways.

8. The auxiliary preview window further includes a close button, and when the one or more programs are executed by the processor, the electronic device closes the auxiliary preview window when detecting a user operation on the close button. The electronic device according to claim 6 or 7, which is capable of executing.

9. The auxiliary preview window further includes a target area, and the image of the first preview stream is obtained by processing the image within the target area, the target area being a fixed area within the auxiliary preview window or the target area being an arbitrary area within the auxiliary preview window, The electronic device according to any one of claims 6 to 8.

10. When the one or more programs are executed by the processor, the electronic device detects a drag operation on the auxiliary preview window and moves the auxiliary preview window from a first position to a second position in response to the drag operation. The electronic device according to any one of claims 6 to 9, which is capable of executing.

11. A computer storage medium comprising computer instructions, wherein when the computer instructions are executed on an electronic device, the electronic device is capable of executing the telephoto shooting method according to any one of claims 1 to 5.

12. A computer program that, when executed on a computer, enables the computer to execute the telephoto shooting method according to any one of claims 1 to 5.

Images