Zoom method, intelligent terminal and readable storage medium

Abstract

The invention provides a zooming method, an intelligent terminal and a readable storage medium, and the method comprises the following steps: S10, obtaining a photosensitive image captured by a photosensitive chip of a camera in response to a preset operation, and cutting the photosensitive image according to a focal length multiple; and S20, according to a preset strategy, carrying out image quality adjustment processing on the cut image. According to the invention, lossless zooming can be realized, the definition of a zoom shooting picture is improved, and the user experience is improved.

Description

Technical Field

[0001] The present application relates to the field of image processing technology, and in particular to a zoom method, an intelligent terminal and a readable storage medium. Background Art

[0002] Generally, an important indicator of the shooting function of a terminal device is the clarity of the image. The camera configuration on low-end mobile phones and other devices is relatively low. The camera interface of such products is usually 1X main camera, 2X digital crop telephoto, no optical zoom lens, and the image quality taken after digital zoom is blurred. In addition, although the full-size output mode of the traditional solution may achieve the resolution of this proposal, the traditional solution has a large amount of data and cannot be superimposed with the MFNR algorithm to improve the image quality. The image quality is poor, especially in terms of noise and clarity.

[0003] The preceding description is intended to provide general background information and does not necessarily constitute prior art. Summary of the invention

[0004] In response to the above technical problems, the present application provides a zoom method, an intelligent terminal and a readable storage medium, so that users can achieve lossless zoom, improve the clarity of the captured image, and operate simply and conveniently.

[0005] In order to solve the above technical problems, the present application provides a zoom method, comprising:

[0006] S10: In response to a preset operation, a photosensitive image captured by a camera photosensitive chip is acquired, and the photosensitive image is cropped according to a focal length multiple;

[0007] S20: According to a preset strategy, the image quality of the cropped image is adjusted.

[0008] Optionally, the cropping of the photosensitive image according to the focal length multiple specifically includes at least one of the following:

[0009] Cut out 1 / N with the target point as the center 2 The photosensitive image of, N is the focal length multiple and is a positive integer greater than 1;

[0010] Cut out 1 / N with the target point as the corner point 2 The photosensitive image, N is the focal length multiple and is a positive integer greater than 1.

[0011] Optionally, the target point includes at least one of the following:

[0012] The target point is any preset point located in the photosensitive image;

[0013] The target point is the geometric center point of the photosensitive image;

[0014] The target point is a geometric corner point of the photosensitive image;

[0015] The target point is the geometric center point of the target element area in the photosensitive image.

[0016] Optionally, the preset strategy includes at least one of the following:

[0017] Performing color pixel arrangement conversion on the image after the cropping process;

[0018] Performing MFNR processing on the image after the color pixel arrangement conversion;

[0019] Perform YUV color conversion on the image after the MFNR processing.

[0020] Optionally, the color pixels of the photosensitive image are arranged in a TETRA or QPD mode, and the image after the color pixel arrangement conversion is arranged in a Bayer mode.

[0021] Optionally, the preset operation includes at least one of the following:

[0022] Zoom in operation;

[0023] Target area selection operation;

[0024] Image capture operation;

[0025] Camera mode change operation.

[0026] Optionally, at least one of the following is also included:

[0027] Displaying the image after the cropping process and / or the image quality adjustment process on a preview screen;

[0028] The image after the cropping process and / or the image quality adjustment process is captured.

[0029] Optionally, before the step S10, the following steps are included:

[0030] The zoom range of the current shooting device is obtained, and when the zoom range is within a preset range, the step S10 is executed.

[0031] The present application also provides a smart terminal, which includes: a camera memory and a processor, wherein a zoom program is stored in the memory, and when the zoom program is executed by the processor, the steps of the zoom method described in any one of the above are implemented.

[0032] The present application also provides a readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the zoom method as described in any one of the above are implemented.

[0033] As described above, the zoom method of the present application includes the following steps: S10: in response to a preset operation, obtaining a photosensitive image captured by a camera photosensitive chip, and cropping the photosensitive image according to the focal length multiple; S20: adjusting the image quality of the cropped image according to a preset strategy. Through the above technical solution, lossless zoom can be achieved, the clarity and resolution of the captured image can be improved, and the problem of low-definition pixels and poor image zoom can be solved, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] The drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present application, and are used together with the specification to explain the principles of the present application. In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative labor.

[0035] Figure 1 A schematic diagram of the hardware structure of a smart terminal for implementing each embodiment of the present application;

[0036] Figure 2 A communication network system architecture diagram provided for an embodiment of the present application;

[0037] Figure 3 is a flowchart of a zoom method according to the first embodiment;

[0038] Figure 4 is a schematic diagram of TETRA / QPD color pixel arrangement conversion according to the zoom method shown in the first embodiment;

[0039] Figure 5 FIG. 1 is a flowchart of a zoom method according to the first embodiment.

[0040] Figure 6 It is a schematic diagram of the procedure of zooming 2X, 3X, 4X according to the first embodiment.

[0041] The realization of the purpose, functional features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. The above-mentioned drawings have shown clear embodiments of this application, which will be described in more detail later. These drawings and textual descriptions are not intended to limit the scope of the concept of this application in any way, but to illustrate the concept of this application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0042] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0043] It should be noted that, in this article, the terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "includes a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element. In addition, components, features, and elements with the same name in different embodiments of the present application may have the same meaning or different meanings, and their specific meanings need to be determined by their explanation in the specific embodiment or further combined with the context of the specific embodiment.

[0044] It should be understood that, although the terms first, second, third, etc. may be used to describe various information in this article, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of this article, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein can be interpreted as "at the time of" or "when" or "in response to determination". Furthermore, as used in this article, the singular forms "one", "one" and "the" are intended to also include plural forms, unless there is an opposite indication in the context. It should be further understood that the terms "comprising" and "including" indicate that there are the described features, steps, operations, elements, components, projects, kinds, and / or groups, but do not exclude the existence, occurrence or addition of one or more other features, steps, operations, elements, components, projects, kinds, and / or groups. The terms "or", "and / or", "including at least one of the following" etc. used in this application can be interpreted as inclusive, or mean any one or any combination. For example, “comprising at least one of the following: A, B, C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”, and for another example, “A, B or C” or “A, B and / or C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”. An exception to this definition will only occur when a combination of elements, functions, steps or operations are inherently mutually exclusive in some manner.

[0045] It should be understood that, although the various steps in the flowchart in the embodiment of the present application are displayed in sequence according to the indication of the arrows, these steps are not necessarily performed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and it can be performed in other orders. Moreover, at least a portion of the steps in the figure may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and their execution order is not necessarily performed in sequence, but can be performed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.

[0046] As used herein, the words "if" and "if" may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to determining" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)", depending on the context.

[0047] It should be noted that in this article, step codes such as S10 and S20 are used for the purpose of expressing the corresponding content more clearly and concisely, and do not constitute a substantial limitation on the sequence. When implementing the step, those skilled in the art may execute S20 first and then S10, etc., but these should all be within the scope of protection of this application.

[0048] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0049] In the subsequent description, the suffixes such as "module", "component" or "unit" used to represent elements are only used to facilitate the description of the present application, and have no specific meanings. Therefore, "module", "component" or "unit" can be used in a mixed manner.

[0050] The smart terminal may be implemented in various forms. For example, the smart terminal described in this application may include smart terminals such as mobile phones, tablet computers, laptop computers, PDAs, portable media players (PMPs), navigation devices, wearable devices, smart bracelets, pedometers, etc., as well as fixed terminals such as digital TVs and desktop computers.

[0051] The following description will be made by taking a mobile terminal as an example, and those skilled in the art will understand that, in addition to components specifically used for mobile purposes, the construction according to the embodiments of the present application can also be applied to fixed-type terminals.

[0052] See also Figure 1 , which is a schematic diagram of the hardware structure of a mobile terminal (or smart terminal) for implementing various embodiments of the present application. The mobile terminal 100 may include: an RF (Radio Frequency) unit 101, a WiFi module 102, an audio output unit 103, an A / V (audio / video) input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, a processor 110, and a power supply 111. Those skilled in the art can understand that Figure 1 The structure of the mobile terminal shown in the figure does not constitute a limitation on the mobile terminal. The mobile terminal may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0053] Combine the following Figure 1 The following is a detailed introduction to the various components of the mobile terminal:

[0054] The radio frequency unit 101 can be used for receiving and sending signals during information transmission or communication. Specifically, after receiving the downlink information of the base station, it is sent to the processor 110 for processing; in addition, the uplink data is sent to the base station. Generally, the radio frequency unit 101 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, etc. In addition, the radio frequency unit 101 can also communicate with the network and other devices through wireless communication. The above-mentioned wireless communications can use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution), TDD-LTE (Time Division Duplexing-Long Term Evolution) and 5G, etc.

[0055] WiFi is a short-range wireless transmission technology. Mobile terminals can help users send and receive emails, browse web pages, and access streaming media through WiFi module 102. It provides users with wireless broadband Internet access. Figure 1 The WiFi module 102 is shown, but it is understandable that it is not an essential component of the mobile terminal and can be omitted as needed without changing the essence of the invention.

[0056] The audio output unit 103 can convert the audio data received by the RF unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output it as sound when the mobile terminal 100 is in a call signal reception mode, a talk mode, a recording mode, a voice recognition mode, a broadcast reception mode, etc. Moreover, the audio output unit 103 can also provide audio output related to a specific function performed by the mobile terminal 100 (for example, a call signal reception sound, a message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, etc.

[0057] The A / V input unit 104 is used to receive audio or video signals. The A / V input unit 104 may include a graphics processor (GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The processed image frame can be displayed on the display unit 106. The image frame processed by the graphics processor 1041 can be stored in the memory 109 (or other storage medium) or sent via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 can receive sound (audio data) via the microphone 1042 in a telephone call mode, a recording mode, a voice recognition mode, and other operating modes, and can process such sound into audio data. The processed audio (voice) data can be converted into a format output that can be sent to a mobile communication base station via the radio frequency unit 101 in the case of a telephone call mode. The microphone 1042 can implement various types of noise elimination (or suppression) algorithms to eliminate (or suppress) noise or interference generated in the process of receiving and sending audio signals.

[0058] The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Optionally, the light sensor includes an ambient light sensor and a proximity sensor. Optionally, the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 1061 and / or the backlight when the mobile terminal 100 is moved to the ear. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors that can be configured on the mobile phone, such as fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be repeated here.

[0059] The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061, which may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

[0060] The user input unit 107 can be used to receive input digital or character information, and to generate key signal input related to the user settings and function control of the mobile terminal. Optionally, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also known as a touch screen, can collect the user's touch operation on or near it (such as the user's operation on the touch panel 1071 or near the touch panel 1071 using any suitable object or accessory such as a finger, stylus, etc.), and drive the corresponding connection device according to a pre-set program. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Optionally, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the touch point coordinates, and then sends it to the processor 110, and can receive and execute the command sent by the processor 110. In addition, the touch panel 1071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may further include other input devices 1072. Optionally, the other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, a function key (such as a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, etc., which are not specifically limited here.

[0061] Optionally, the touch panel 1071 may cover the display panel 1061. When the touch panel 1071 detects a touch operation on or near it, it transmits the information to the processor 110 to determine the type of touch event. Then, the processor 110 provides corresponding visual output on the display panel 1061 according to the type of touch event. Figure 1 In the figure, the touch panel 1071 and the display panel 1061 are used as two independent components to implement the input and output functions of the mobile terminal. However, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated to implement the input and output functions of the mobile terminal, which is not limited here.

[0062] The interface unit 108 serves as an interface through which at least one external device can be connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, etc. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal 100 and an external device.

[0063] The memory 109 can be used to store software programs and various data. The memory 109 can mainly include a program storage area and a data storage area. Optionally, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the memory 109 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0064] The processor 110 is the control center of the mobile terminal. It uses various interfaces and lines to connect various parts of the entire mobile terminal. It executes various functions of the mobile terminal and processes data by running or executing software programs and / or modules stored in the memory 109, and calling data stored in the memory 109, so as to monitor the mobile terminal as a whole. The processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor and a modem processor. Optionally, the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 110.

[0065] The mobile terminal 100 may also include a power supply 111 (such as a battery) for supplying power to various components. Preferably, the power supply 111 may be logically connected to the processor 110 via a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system.

[0066] although Figure 1 Not shown, the mobile terminal 100 may further include a Bluetooth module, etc., which will not be described in detail here.

[0067] In order to facilitate understanding of the embodiments of the present application, the communication network system on which the mobile terminal of the present application is based is described below.

[0068] See also Figure 2 , Figure 2 A communication network system architecture diagram is provided for an embodiment of the present application, wherein the communication network system is an LTE system of universal mobile communication technology, and the LTE system includes a UE (User Equipment) 201, an E-UTRAN (Evolved UMTS Terrestrial Radio Access Network) 202, an EPC (Evolved Packet Core) 203 and an operator's IP service 204, which are connected in sequence for communication.

[0069] Optionally, UE201 may be the above-mentioned terminal 100, which will not be described in detail here.

[0070] E-UTRAN 202 includes eNodeB 2021 and other eNodeBs 2022 , etc. Optionally, eNodeB 2021 may be connected to other eNodeBs 2022 via a backhaul (eg, an X2 interface), and eNodeB 2021 is connected to EPC 203 , and eNodeB 2021 may provide UE 201 with access to EPC 203 .

[0071] EPC203 may include MME (Mobility Management Entity) 2031, HSS (Home Subscriber Server) 2032, other MMEs 2033, SGW (Serving Gate Way) 2034, PGW (PDN Gate Way) 2035 and PCRF (Policy and Charging Rules Function) 2036, etc. Optionally, MME 2031 is a control node that processes signaling between UE 201 and EPC 203, and provides bearer and connection management. HSS 2032 is used to provide some registers to manage functions such as home location register (not shown in the figure), and store some user-specific information such as service features and data rates. All user data can be sent through SGW2034, PGW2035 can provide IP address allocation and other functions for UE 201, PCRF2036 is the policy and charging control policy decision point for service data flow and IP bearer resources, which selects and provides available policy and charging control decisions for the policy and charging execution function unit (not shown in the figure).

[0072] The IP service 204 may include the Internet, an intranet, an IMS (IP Multimedia Subsystem) or other IP services.

[0073] Although the above introduction takes the LTE system as an example, those skilled in the art should know that the present application is not only applicable to the LTE system, but also to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA and future new network systems (such as 5G), etc., without limitation here.

[0074] Based on the above-mentioned mobile terminal hardware structure and communication network system, various embodiments of the present application are proposed.

[0075] First embodiment

[0076] S10: In response to a preset operation, a photosensitive image captured by a camera photosensitive chip is obtained, and the photosensitive image is cropped according to a focal length multiple.

[0077] Specifically, the zoom method provided in this embodiment is configured in a terminal with a camera function. It should be noted that there are many types of terminals, which can be selected according to application needs, such as mobile phones, tablet computers, etc.

[0078] Photosensitive chips play a vital role in digital cameras. They are the core components of cameras for capturing images. Photosensitive chips are mainly divided into two types: CCD (charge-coupled device) and CMOS (metal oxide semiconductor device). The working principle of photosensitive chips is to convert light signals into electrical signals through photoelectric conversion, thereby capturing and recording images. Specifically, when light shines on the photosensitive elements on the chip, the light signals are converted into electrical signals, which are then processed and stored to eventually form the image you see. Among them, the photosensitive image is the original image data obtained by the camera.

[0079] Focal length is a measure of the convergence or divergence of light in an optical system. It refers to the distance from the optical center of the lens to the focus of light when parallel light is incident.

[0080] Optionally, the preset operation includes at least one of the following: a zoom-in operation; a target area selection operation; an image capturing operation; or a camera mode changing operation.

[0081] The zoom magnification operation is an operation of magnifying the preview image or selecting a zoom ratio in the photo mode; the target area selection operation can be a click operation or a frame selection operation on the preview image; the image capture operation is a capture operation at a specific zoom ratio; the camera mode change operation can be changing the camera mode from standard mode (digital zoom is not possible in standard mode) to digital zoom mode.

[0082] It should be noted that the preset operation may also be a digital zoom operation instruction. After the terminal device receives the digital zoom instruction, the photosensitive image acquired by the photosensitive chip is digitally zoomed.

[0083] In the process of taking pictures, in order to meet the actual application needs of users, the zoom function on the terminal can be used to zoom. In this embodiment, zooming is achieved by cropping, and the cropping process is digital cropping. Digital cropping is a technology for cropping the picture taken by optical zoom. The captured image can be enlarged by digital cropping, but it is not a real zoom, because it does not change the focal length of the lens, but achieves the effect of magnification by cropping part of the picture. Digital cropping refers to using an optical zoom lens to capture the complete picture when shooting, and then cropping and enlarging the required part of the picture through software processing, so as to achieve a larger multiple of "zoom" effect without changing the physical focal length. It is usually used in the camera function of digital cameras and smart phones, especially when there is a lack of sufficient optical zoom capability, digital cropping can be used as a supplementary means. It should be noted that, for conventional digital cropping technology, taking a 50M photosensitive chip as an example, the resolution of the output image of conventional shooting at 1X is 12.5M. After digital cropping, the resolution of the image captured at 2X telephoto will be reduced to 3M, resulting in low image quality.

[0084] When zooming, or when a shooting command is received after zooming and image output is required, the photosensitive image acquired by the photosensitive chip is obtained, and then the photosensitive image is cropped to crop some pixels (these some pixels can be pixels in the area displayed on the display screen or the central area, etc.) in the pixels of the photosensitive image at a specific ratio (the ratio can be automatically adjusted according to the actual scene).

[0085] In another embodiment, the photosensitive image can be cropped according to the zoom factor, the display screen size or the output image size to crop pixels of a specific ratio. Generally speaking, when the area included in the photosensitive image is the same and the zoom factor remains unchanged, the larger the display screen / output image size is, the larger the cropped area is.

[0086] Optionally, the cropping of the photosensitive image according to the focal length multiple specifically includes at least one of the following: cropping 1 / N pixels with the target point as the center. 2 The photosensitive image, N is the focal length multiple and is a positive integer greater than 1; 1 / N is cut out with the target point as the corner point 2 The photosensitive image, N is the focal length multiple and is a positive integer greater than 1.

[0087] Specifically, the corner points may be the upper left corner, the upper right corner, the lower left corner, and the lower right corner of the photosensitive image.

[0088] When the zoom magnification of the photosensitive image is 1, if the zoom magnification of the image needs to be adjusted to 2, 1 / 4 of the area is cropped from the photosensitive image; if the zoom magnification of the image needs to be adjusted to 3, 1 / 9 of the area is cropped from the photosensitive image; the subsequent zoom magnifications can be deduced in the same way, but generally speaking, this embodiment only applies to zoom magnifications less than or equal to 3.

[0089] Optionally, the target point includes at least one of the following: the target point is any preset point located in the photosensitive image; the target point is the geometric center point of the photosensitive image; the target point is a geometric corner point of the photosensitive image; the target point is the geometric center point of the target element area in the photosensitive image.

[0090] The target element area can be customized by the user and can be presented through the preview interface, and it can also be customized by the system.

[0091] Specifically, the target point is any preset point located in the photosensitive image, that is, the target point is a point selected by a user on the photosensitive image; in this case, the area where the selected point is located is the zoom area, and the photosensitive image can be adaptively cropped based on the selected point. The target point is the geometric center point of the photosensitive image, and in this case, the area centered on the geometric center point is the area to be zoomed in.

[0092] Exemplarily, when the target point is located at the upper left corner of the photosensitive image, the pixels in the upper left area of ​​the photosensitive image are cropped at a specific ratio; when the target point is located at the middle area of ​​the photosensitive image, the pixels in the middle area of ​​the photosensitive image are cropped at a specific ratio; when the target point is located at the upper right corner of the photosensitive image, the pixels in the upper right corner area of ​​the photosensitive image are cropped at a specific ratio; when the target point is located at the lower left corner of the photosensitive image, the pixels in the lower left corner area of ​​the photosensitive image are cropped at a specific ratio; when the target point is located at the lower right corner of the photosensitive image, the pixels in the lower right corner area of ​​the photosensitive image are cropped at a specific ratio. In other embodiments, pixels in the top central area, bottom central area, left central area, and right central area of ​​the photosensitive image may also be cropped at a specific ratio.

[0093] S20: According to a preset strategy, the image quality of the cropped image is adjusted.

[0094] Optionally, the preset strategy includes at least one of the following: performing color pixel arrangement conversion on the image after the cropping process; performing MFNR processing on the image after the color pixel arrangement conversion; and performing YUV color conversion on the image after the MFNR process.

[0095] MFNR (Multiple Frame Noise Reduction) is an algorithm used in image processing, mainly used to reduce noise in images. YUV color conversion is to convert images from RGB format to YUV format.

[0096] Optionally, the color pixels of the photosensitive image are arranged in a TETRA or QPD mode, and the image after the color pixel arrangement conversion is arranged in a Bayer mode.

[0097] Specifically, the original pixels of the photosensitive image acquired by the photosensitive chip are arranged in TETRA or QPD mode. In order to adjust the pixel arrangement of the photosensitive image to the preset Bayer mode arrangement, it is necessary to convert the color pixel arrangement of the photosensitive image through the remosaic algorithm. The remosaic algorithm is an algorithm for processing image sensors. Its main function is to convert the image data of the non-Bayer array into the Bayer array for subsequent image processing. It should be noted that if the pixel arrangement of the photosensitive image acquired by the photosensitive chip is a Bayer mode arrangement, there is no need to perform color pixel arrangement conversion.

[0098] Specifically, when the color pixel arrangement of an image is converted, it is necessary to convert and change the pixel arrangement of the cropped image without changing the pixel size of the photosensitive image to avoid reducing the image quality and resolution.

[0099] For example, the pixels of the photosensitive image of the 50M Tetra or QPD pixel arrangement acquired by the photosensitive chip are 4 R, 4 G (G includes Gr and Gb), 4 B combination (for example, in the usual mode, the pixels are 4 R, 4 G, 4 B arrangement combinations of upper left, upper right, lower left, and lower right, see Figure 4 ). After the photosensitive image is cropped, the original 4 R, G and B pixels are converted respectively, so that the original 4 R pixels are converted into the upper left R pixel, the upper right G pixel (Gr), the lower left G pixel (Gb) and the lower right B pixel; the 4 G (including the upper right and lower left) pixels are also converted into the upper left R, the upper right G, the lower left G and the lower right B; the 4 B pixels are also converted into the upper left R, the upper right G, the lower left G and the lower right B (see Figure 4 ), and the conversion of pixels at other positions of the subsequent image is taken as an example. It should be noted that when the color pixel arrangement conversion is performed, the order / orientation of each pixel in R, G and B does not change. Figure 4It can be seen that R1, R2, R3 and R4 are arranged as follows before color pixel conversion: upper left R1, upper right R2, lower left R3 and lower right R4. After the color pixel arrangement conversion is performed and the pixels are shuffled and rearranged, the relative order and relative positions of R1, R2, R3 and R4 (excluding the influence of other pixels) are still: upper left R1, upper right R2, lower left R3 and lower right R4; the conversion of other pixels (such as G and B) can refer to the conversion of pixel R.

[0100] In other embodiments, after the photosensitive image is cropped, the pixel arrangement of the cropped upper left corner (or other positions, such as the upper right corner, lower left corner, etc.) is obtained, and then the four adjacent upper left, upper right, lower left and lower right pixels of the area are rearranged to adjust them to upper left R, upper right G, lower left G and lower right B; then the upper left, upper right, lower left and lower right pixels at the next adjacent position are converted (the pixel adjustment method is not limited to the above method, and the pixel adjustment on the image can also be performed simultaneously).

[0101] As described before, the CIS chip applicable to this embodiment has a 4-in-1 TETRA or QPD pixel arrangement, and the pixel density is also applicable to other specifications of photosensitive chips such as 32M, 50M, or 64M (M represents resolution). After receiving the 2X zoom command, the CIS chip cuts the center of the pattern / area to be zoomed in the 50M TETRA (QPD) arrangement into pixels of the 12.5M TETRA (QPD) arrangement, and then uses the remosaic algorithm to convert the 12.5M TETRA pattern into a 12.5M Bayer arrangement pattern. Subsequently, the 12.5M Bayer pattern is optimized by the MFNR algorithm, and finally a successfully zoomed and optimized image is output through raw to Jpeg conversion (see Figure 5 ).

[0102] In addition, if you need to get 3X, 4X, 5X images, when zooming in through shooting, the image processing flow of cropping is the same as above, except that in the initial stage, 50M TETRA is cropped into 5.6M TETRA (3X) and 3M TETEA (4X), etc. The larger the zoom factor, the smaller the cropped resolution. Generally speaking, the larger the initial resolution of the photosensitive image obtained by the photosensitive chip, the larger the zoom factor. Figure 6 .

[0103] Optionally, at least one of the following is further included: displaying the image after the cropping process and / or the image quality adjustment process on a preview screen; and photographing the image after the cropping process and / or the image quality adjustment process.

[0104] Optionally, before the step S10, the method includes: acquiring a zoom range of a current shooting device, and executing the step S10 when the zoom range is within a preset range.

[0105] Specifically, when it is detected that the photographing device has five optical zoom lenses and its zoom range is within a zoom range such as 2X-4X, step S10 is executed.

[0106] In other embodiments, the photographing device may also be tested to confirm whether the photographing device has an optical zoom function. If it has an optical zoom, step S10 is not performed; if it does not have an optical zoom, step S10 is performed. Or if it is detected that the zoom factor supported by the optical zoom is less than the magnification factor (e.g., the optical zoom supports 5 times, but the image is magnified by 6 times; the optical zoom supports 10 times, but the image is magnified by 12 times, etc.), step S10 is performed. It should be noted that when the photographing device has an optical zoom function, the photosensitive image needs to be cropped according to the optical zoom support factor and the actual zoom magnification factor, and the cropping range is not limited to 1 / N centered on the target point. 2 Specifically, by obtaining the zoom multiple instruction of the camera sensor of the current shooting device in the shooting state; judging whether the zoom multiple corresponding to the zoom multiple instruction is greater than or equal to a threshold value (i.e., the multiple supported by the optical zoom of the device); when it is detected that the zoom multiple is greater than or equal to the threshold value, switching the image output mode; and cropping the photosensitive image based on the photosensitive image obtained by the optical zoom to enlarge the photosensitive image so that the output image is the zoom multiple corresponding to the zoom multiple instruction.

[0107] The zoom method of this embodiment crops the photosensitive image obtained by the photosensitive chip according to the focal length multiple, and then converts the color pixel arrangement of the cropped image without changing the pixel area size, and then performs MFNR processing and YUV color conversion and other image quality adjustment processing on the converted image, thereby achieving lossless zoom of the image and improving the clarity of the captured image.

[0108] The present application also provides an intelligent terminal, which includes a memory and a processor. The memory stores a zoom program, and when the zoom program is executed by the processor, the steps of the zoom method in any of the above embodiments are implemented.

[0109] The present application also provides a computer-readable storage medium, on which a zoom program is stored. When the zoom program is executed by a processor, the steps of the zoom method in any of the above embodiments are implemented.

[0110] In the embodiments of the smart terminal and computer-readable storage medium provided in the present application, all technical features of any of the above-mentioned zoom method embodiments may be included, and the expanded and explained contents of the specification are basically the same as those of the embodiments of the above-mentioned methods, and will not be repeated here.

[0111] The embodiment of the present application further provides a computer program product, which includes a computer program code. When the computer program code runs on a computer, the computer executes the methods in the above various possible implementation modes.

[0112] An embodiment of the present application also provides a chip, including a memory and a processor, the memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that a device equipped with the chip executes the methods in various possible implementation modes as described above.

[0113] It is understood that the above scenarios are only examples and do not constitute a limitation on the application scenarios of the technical solutions provided in the embodiments of the present application. The technical solutions of the present application can also be applied to other scenarios. For example, it is known to those skilled in the art that with the evolution of the system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0114] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0115] The steps in the method of the embodiment of the present application can be adjusted in order, combined and deleted according to actual needs.

[0116] The units in the device of the embodiment of the present application can be merged, divided and deleted according to actual needs.

[0117] In the present application, the same or similar terminology concepts, technical solutions and / or application scenario descriptions are generally described in detail only the first time they appear. When they appear again later, they are generally not repeated for the sake of brevity. When understanding the technical solutions and other contents of the present application, for the same or similar terminology concepts, technical solutions and / or application scenario descriptions that are not described in detail later, reference can be made to the previous related detailed descriptions.

[0118] In the present application, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0119] The various technical features of the technical solution of the present application can be arbitrarily combined. In order to make the description concise, not all possible combinations of the various technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of the present application.

[0120] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as above, and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, a controlled terminal, or a network device, etc.) to execute the method of each embodiment of the present application.

[0121] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loading and executing computer program instructions on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, a computer, a server or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server, a data center, etc. that contains one or more available media integrated. The available medium can be a magnetic medium, (e.g., a floppy disk, a storage disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state storage disk Solid State Disk (SSD)), etc.

[0122] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A zoom method, characterized in that: The method comprises the following steps: S10: In response to a preset operation, a photosensitive image captured by a camera photosensitive chip is acquired, and the photosensitive image is cropped according to a focal length multiple; S20: According to a preset strategy, the image quality of the cropped image is adjusted.

2. The method according to claim 1, characterized in that The cropping of the photosensitive image according to the focal length multiple specifically includes at least one of the following: Cut out 1 / N with the target point as the center 2 The photosensitive image of, N is the focal length multiple and is a positive integer greater than 1; Cut out 1 / N with the target point as the corner point 2 The photosensitive image, N is the focal length multiple and is a positive integer greater than 1.

3. The method according to claim 2, characterized in that The target point includes at least one of the following: The target point is any preset point located in the photosensitive image; The target point is the geometric center point of the photosensitive image; The target point is a geometric corner point of the photosensitive image; The target point is the geometric center point of the target element area in the photosensitive image.

4. The method according to claim 1, characterized in that The preset strategy includes at least one of the following: Performing color pixel arrangement conversion on the image after the cropping process; Performing MFNR processing on the image after the color pixel arrangement conversion; Perform YUV color conversion on the image after the MFNR processing.

5. The method according to claim 4, characterized in that The color pixels of the photosensitive image are arranged in a TETRA or QPD mode, and the image after the color pixel arrangement conversion is arranged in a Bayer mode.

6. The method according to any one of claims 1 to 5, characterized in that: The preset operation includes at least one of the following: Zoom in operation; Target area selection operation; Image capture operation; Camera mode change operation.

7. The method according to claim 6, characterized in that Also includes at least one of the following: Displaying the image after the cropping process and / or the image quality adjustment process on a preview screen; The image after the cropping process and / or the image quality adjustment process is captured.

8. The method according to any one of claims 1 to 5, characterized in that Before the step S10, the process includes: The zoom range of the current shooting device is obtained, and when the zoom range is within a preset range, the step S10 is executed.

9. An intelligent terminal, characterized in that: The smart terminal comprises: a camera memory and a processor, wherein a zoom program is stored in the memory, and when the zoom program is executed by the processor, the steps of the zoom method according to any one of claims 1 to 8 are implemented.

10. A readable storage medium, characterized in that: The readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the zoom method according to any one of claims 1 to 8 are implemented.

Images