Processing method, intelligent terminal and storage medium

Abstract

The invention provides a processing method, an intelligent terminal and a storage medium, and the method comprises the steps: responding to a first operation, adjusting a shooting parameter for at least a part of region in a preview image, and recognizing a target element in the adjusted preview image when the adjustment degree reaches a preset adjustment amplitude. According to the technical scheme, the shooting parameters are adjusted for at least part of the area in the preview image in response to the first operation, the target element in the adjusted preview image is recognized when the adjustment degree reaches the preset adjustment amplitude, the operation mode is simple, and the image processing flexibility is improved.

Description

Technical Field

[0001] The present application relates to the field of image technology, and in particular to a processing method, an intelligent terminal and a storage medium. Background Art

[0002] As the functions of smart terminals such as mobile phones and tablets continue to improve, they have gradually become one of the commonly used tools in people's daily life and work.

[0003] In the process of conceiving and implementing the present application, the inventors found that there are at least the following problems: the operation of image processing is cumbersome and not very flexible. Summary of the invention

[0004] In response to the above technical problems, the present application provides a processing method, an intelligent terminal and a storage medium to improve the flexibility of image processing.

[0005] To achieve the above purpose, the technical solution of this application is implemented as follows: In a first aspect, an embodiment of the present application provides a processing method, which is applied to a terminal, including: S1, in response to a first operation, adjusting shooting parameters for at least a partial area in a preview image, and when the adjustment degree reaches a preset adjustment range, identifying a target element in the adjusted preview image.

[0006] As one implementation manner, at least a portion of the area in the preview screen includes at least one of the following: The text area in the preview screen; The picture area in the preview screen; The QR code area in the preview screen; The character area in the preview image; The face area in the preview image; an object selected by the first operation in the preview screen; The preview screen as a whole.

[0007] As one implementation manner, the shooting parameter includes at least one of the following: a focal length parameter, an exposure parameter, and a white balance parameter.

[0008] As one implementation manner, the processing method further includes S2, displaying element content corresponding to the target element in the preview screen; S3, in response to the second operation, capturing a captured image according to the adjusted capturing parameters, and superimposing the element content corresponding to the target element on the captured image.

[0009] As one implementation manner, the element content includes at least one of the following: Element category, element name, element annotation, and element related links.

[0010] As one implementation manner, the processing method further includes S4, when the adjustment degree does not reach the preset adjustment range, identifying the target element in the preview image before the adjustment.

[0011] As one implementation mode, S5, restoring the preview screen before adjustment, and displaying the element content corresponding to the target element in the preview screen; S6, in response to the third operation, capturing a captured image according to the captured parameters before adjustment, and superimposing the element content corresponding to the target element on the captured image.

[0012] As one implementation manner, during the process of identifying the target element, an identifying interface is displayed.

[0013] In a second aspect, the present application further provides an intelligent terminal, comprising: a memory and a processor, wherein a processing program is stored in the memory, and when the processing program is executed by the processor, the steps of the processing method described in the first aspect are implemented. In a third aspect, an embodiment of the present application provides a storage medium storing a computer program, which, when executed by a processor, implements the processing method described in the first aspect. The processing method, intelligent terminal and storage medium provided by the embodiments of the present application include: in response to a first operation, adjusting the shooting parameters for at least a part of the preview screen, and identifying the target element in the adjusted preview screen when the adjustment degree reaches a preset adjustment range. The technical solution of the present application adjusts the shooting parameters for at least a part of the preview screen in response to the first operation, and identifies the target element in the adjusted preview screen when the adjustment degree reaches a preset adjustment range. The operation method of the present application is simple, and the flexibility of image processing is improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] The drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present application, and are used together with the specification to explain the principles of the present application. In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative labor.

[0015] Figure 1 A schematic diagram of the hardware structure of a mobile terminal for implementing various embodiments of the present application; Figure 2 A communication network system architecture diagram provided for an embodiment of the present application; Figure 3 A schematic diagram of a processing method provided in an embodiment of the present application Figure 1 ; Figure 4 A schematic diagram of a processing method provided in an embodiment of the present application Figure 2 ; Figure 5 A schematic diagram of a processing method provided in an embodiment of the present application Figure 3 ; Figure 6 A schematic diagram of a specific process of a processing method provided in an embodiment of the present application; Figure 7 This is an interface display diagram provided for an embodiment of the present application.

[0016] The realization of the purpose, functional features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. The above-mentioned drawings have shown clear embodiments of this application, which will be described in more detail later. These drawings and textual descriptions are not intended to limit the scope of the concept of this application in any way, but to illustrate the concept of this application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0017] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0018] It should be noted that, in this article, the terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "includes a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element. In addition, components, features, and elements with the same name in different embodiments of the present application may have the same meaning or different meanings, and their specific meanings need to be determined by their explanation in the specific embodiment or further combined with the context of the specific embodiment.

[0019] It should be understood that, although the terms first, second, third, etc. may be used to describe various information in this article, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of this article, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein can be interpreted as "at the time of" or "when" or "in response to determination". Furthermore, as used in this article, the singular forms "one", "one" and "the" are intended to also include plural forms, unless there is an opposite indication in the context. It should be further understood that the terms "comprising" and "including" indicate that there are the described features, steps, operations, elements, components, projects, kinds, and / or groups, but do not exclude the existence, occurrence or addition of one or more other features, steps, operations, elements, components, projects, kinds, and / or groups. The terms "or", "and / or", "including at least one of the following" etc. used in this application can be interpreted as inclusive, or mean any one or any combination. For example, “comprising at least one of the following: A, B, C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”, and for another example, “A, B or C” or “A, B and / or C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”. An exception to this definition will only occur when a combination of elements, functions, steps or operations are inherently mutually exclusive in some manner.

[0020] It should be understood that, although the various steps in the flowchart in the embodiment of the present application are displayed in sequence according to the indication of the arrows, these steps are not necessarily performed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and it can be performed in other orders. Moreover, at least a portion of the steps in the figure may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and their execution order is not necessarily performed in sequence, but can be performed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.

[0021] As used herein, the words "if" and "if" may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to determining" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)", depending on the context.

[0022] It should be noted that, in this article, step codes such as S101, S102, etc. are used for the purpose of expressing the corresponding content more clearly and concisely, and do not constitute a substantial limitation on the sequence. When implementing the step, those skilled in the art may execute S102 first and then S101, etc., but these should all be within the scope of protection of this application.

[0023] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0024] In the subsequent description, the suffixes such as "module", "component" or "unit" used to represent elements are only used to facilitate the description of the present application, and have no specific meanings. Therefore, "module", "component" or "unit" can be used in a mixed manner.

[0025] The smart terminal may be implemented in various forms. For example, the smart terminal described in this application may include smart terminals such as mobile phones, tablet computers, laptop computers, PDAs, digital cameras, etc., as well as fixed terminals such as digital TVs and desktop computers.

[0026] The following description will be made by taking a mobile terminal as an example, and those skilled in the art will understand that, in addition to components specifically used for mobile purposes, the construction according to the embodiments of the present application can also be applied to fixed-type terminals.

[0027] See also Figure 1 , which is a schematic diagram of the hardware structure of a mobile terminal for implementing various embodiments of the present application, the mobile terminal 100 may include: RF (Radio Frequency, radio frequency) unit 101, WiFi module 102, audio output unit 103, A / V (audio / video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111 and other components. Those skilled in the art can understand that Figure 1 The structure of the mobile terminal shown in the figure does not constitute a limitation on the mobile terminal. The mobile terminal may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0028] Combine the following Figure 1 The following is a detailed introduction to the various components of the mobile terminal: The radio frequency unit 101 can be used for receiving and sending signals during information transmission or communication. Specifically, after receiving the downlink information of the base station, it is sent to the processor 110 for processing; in addition, the uplink data is sent to the base station. Generally, the radio frequency unit 101 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, etc. In addition, the radio frequency unit 101 can also communicate with the network and other devices through wireless communication. The above-mentioned wireless communications may use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing- Long Term Evolution), TDD-LTE (Time Division Duplexing- Long Term Evolution), 5G and 6G, etc.

[0029] WiFi is a short-range wireless transmission technology. Mobile terminals can help users send and receive emails, browse web pages, and access streaming media through WiFi module 102. It provides users with wireless broadband Internet access. Figure 1 The WiFi module 102 is shown, but it is understandable that it is not an essential component of the mobile terminal and can be omitted as needed without changing the essence of the invention.

[0030] The audio output unit 103 can convert the audio data received by the RF unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output it as sound when the mobile terminal 100 is in a call signal reception mode, a talk mode, a recording mode, a voice recognition mode, a broadcast reception mode, etc. Moreover, the audio output unit 103 can also provide audio output related to a specific function performed by the mobile terminal 100 (for example, a call signal reception sound, a message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, etc.

[0031] The A / V input unit 104 is used to receive audio or video signals. The A / V input unit 104 may include a graphics processor (GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The processed image frame can be displayed on the display unit 106. The image frame processed by the graphics processor 1041 can be stored in the memory 109 (or other storage medium) or sent via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 can receive sound (audio data) via the microphone 1042 in a telephone call mode, a recording mode, a voice recognition mode, and the like, and can process such sound into audio data. The processed audio (voice) data can be converted into a format output that can be sent to a mobile communication base station via the radio frequency unit 101 in the case of a telephone call mode. The microphone 1042 can implement various types of noise elimination (or suppression) algorithms to eliminate (or suppress) noise or interference generated in the process of receiving and sending audio signals.

[0032] The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Optionally, the light sensor includes an ambient light sensor and a proximity sensor. Optionally, the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 1061 and / or the backlight when the mobile terminal 100 is moved to the ear. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors that can also be configured on the mobile phone, such as fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be repeated here.

[0033] The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061, which may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

[0034] The user input unit 107 can be used to receive input digital or character information, and generate key signal input related to user settings and function control of the mobile terminal. Optionally, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also known as a touch screen, can collect user touch operations on or near it (such as operations performed by users using fingers, styluses, or any other suitable objects or accessories on or near the touch panel 1071), and drive corresponding connection devices according to a pre-set program. The touch panel 1071 may include a touch detection device and a touch controller. Optionally, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into touch point coordinates, and then sends it to the processor 110, and can receive and execute commands sent by the processor 110. In addition, the touch panel 1071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 1071, the user input unit 107 may also include other input devices 1072. Optionally, the other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, a function key (such as a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, etc., which are not specifically limited here.

[0035] Optionally, the touch panel 1071 may cover the display panel 1061. When the touch panel 1071 detects a touch operation on or near it, it transmits the information to the processor 110 to determine the type of touch event. Then, the processor 110 provides corresponding visual output on the display panel 1061 according to the type of touch event. Figure 1 In the figure, the touch panel 1071 and the display panel 1061 are used as two independent components to implement the input and output functions of the mobile terminal. However, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated to implement the input and output functions of the mobile terminal, which is not limited here.

[0036] The interface unit 108 serves as an interface through which at least one external device can be connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, etc. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal 100 and an external device.

[0037] The memory 109 can be used to store software programs and various data. The memory 109 can mainly include a program storage area and a data storage area. Optionally, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the memory 109 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0038] The processor 110 is the control center of the mobile terminal. It uses various interfaces and lines to connect various parts of the entire mobile terminal. It executes various functions of the mobile terminal and processes data by running or executing software programs and / or modules stored in the memory 109, and calling data stored in the memory 109, so as to monitor the mobile terminal as a whole. The processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor and a modem processor. Optionally, the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 110.

[0039] The mobile terminal 100 may further include a power supply 111 (such as a battery) for supplying power to various components. Preferably, the power supply 111 may be logically connected to the processor 110 via a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system.

[0040] although Figure 1 Not shown, the mobile terminal 100 may further include a Bluetooth module, etc., which will not be described in detail here.

[0041] In order to facilitate understanding of the embodiments of the present application, the communication network system on which the mobile terminal of the present application is based is described below.

[0042] See also Figure 2 , Figure 2 A communication network system architecture diagram is provided for an embodiment of the present application, wherein the communication network system is an LTE system of universal mobile communication technology, and the LTE system includes a UE (User Equipment) 201, an E-UTRAN (Evolved UMTS Terrestrial Radio Access Network) 202, an EPC (Evolved Packet Core) 203 and an operator's IP service 204, which are connected in sequence for communication.

[0043] Optionally, UE201 may be the above-mentioned terminal 100, which will not be described in detail here.

[0044] E-UTRAN 202 includes eNodeB 2021 and other eNodeBs 2022 , etc. Optionally, eNodeB 2021 may be connected to other eNodeBs 2022 via a backhaul (eg, an X2 interface), and eNodeB 2021 is connected to EPC 203 , and eNodeB 2021 may provide UE 201 with access to EPC 203 .

[0045] EPC203 may include MME (Mobility Management Entity) 2031, HSS (Home Subscriber Server) 2032, other MMEs 2033, SGW (Serving GateWay) 2034, PGW (PDN Gate Way) 2035, and PCRF (Policy and Charging Rules Function) 2036. Optionally, MME 2031 is a control node that processes signaling between UE 201 and EPC 203, and provides bearer and connection management. HSS 2032 is used to provide some registers to manage functions such as a home location register (not shown in the figure), and store some user-specific information such as service features and data rates. All user data can be sent through SGW2034. PGW2035 can provide IP address allocation and other functions for UE 201. PCRF2036 is the policy and charging control policy decision point for service data flow and IP bearer resources. It selects and provides available policy and charging control decisions for the policy and charging execution function unit (not shown in the figure).

[0046] The IP service 204 may include the Internet, an intranet, an IMS (IP Multimedia Subsystem) or other IP services.

[0047] Although the above introduction takes the LTE system as an example, those skilled in the art should know that the present application is not only applicable to the LTE system, but also to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, 5G and future new network systems (such as 6G), etc., without limitation here.

[0048] Based on the above-mentioned mobile terminal hardware structure and communication network system, various embodiments of the present application are proposed.

[0049] First embodiment Reference Figure 3 , Figure 3 A flowchart of a processing method provided in an embodiment of the present application is provided. The processing method in an embodiment of the present application can be applied to a smart terminal (such as a mobile phone), including the following steps: S1, in response to a first operation, adjusting shooting parameters for at least a partial area in a preview image, and when the adjustment degree reaches a preset adjustment range, identifying a target element in the adjusted preview image.

[0050] In one embodiment, the first operation includes at least one of the following: Selection operation for the preview screen; Select the target element; Selection operation for preview stream; Mode switching operation; Enter the operation of intelligent recognition mode.

[0051] Among them, in one embodiment, the selection operation of the preview screen can be a single click, double click, or continuous selection operation performed by the user on the preview screen by touching the screen or using an input device such as a mouse. In one embodiment, the selection operation of the target element may include an operation performed on the target element based on the position and area of ​​the target element in the preview screen, and may also include voice input performed based on the name of the target element in the preview screen. In one embodiment, the selection operation of the preview stream is an operation performed on a certain frame of the preview screen in the real-time preview stream of the video screen or the camera. The mode switching operation includes an operation implemented based on specific buttons, menu options, selection operations, gesture recognition, voice recognition and other instructions for switching the current mode to another mode.

[0052] Among them, the intelligent recognition mode may be a mode in which the recognition area is different from that of the ordinary recognition mode, and / or a mode in which the type of recognition algorithm is different from that of the ordinary recognition mode, and / or a mode in which the number of recognition algorithms is different from that of the ordinary recognition mode, and / or a mode in which the target object to be recognized is different from that of the ordinary recognition mode, and / or a mode including the ordinary recognition mode, etc. Specifically, entering the intelligent recognition mode may be switching from other modes to the intelligent recognition mode, or may be directly entering the intelligent recognition mode.

[0053] Wherein, at least a portion of the area in the preview image includes at least one of the following: The text area in the preview screen; The image area in the preview screen; The identification code area in the preview screen; Preview the character area in the screen; Preview the face area in the picture; The object selected by the first operation in the preview screen; Preview the entire screen.

[0054] Among them, the text area in the preview screen includes a text prompt for scanning in the preview screen, and the text prompt here can be a keyword prompt, such as "identify", "scan", "QR code", "barcode", etc., which are not limited here. The identification code in the preview screen includes a QR code, a barcode, an identifier, etc. The object selected by the first operation in the preview screen includes determining, in response to a click or other selection operation, that the object corresponding to the selection operation is selected in the preview screen. The object selected by the first operation can include text, objects, identification codes, people, faces, etc., or it can also be a link object or an item, etc.

[0055] In one embodiment, after determining the text, picture, identification code, person, face, and object selected by the first operation in the preview screen, the area in the preview screen where the text, picture, identification code, person, face, and object selected by the first operation are located can be determined as a partial area for adjusting shooting parameters based on a preset size. Alternatively, the area within a preset range can be determined as a partial area for adjusting shooting parameters with the text, picture, identification code, person, face, and object selected by the first operation as the center.

[0056] In one embodiment, the shooting parameters include at least one of the following: focal length parameter, exposure parameter, and white balance parameter. In other embodiments, the shooting parameters may also include other parameters that can affect the clarity of the image quality, such as photosensitivity parameters. In one embodiment, the step S1 adjusts the shooting parameters for at least a portion of the preview image, including at least one of the following: focusing at least a portion of the preview image based on the focal length parameter; adjusting the preview light of the preview image based on the exposure parameter condition to improve the image quality of the preview image; adjusting the color temperature in the preview image based on the white balance parameter to match the color performance under different light sources.

[0057] Optionally, adjusting the shooting parameters for at least part of the area in the preview screen in step S1 may include: adjusting the shooting parameters of the area in sequence based on multiple shooting parameters, or directly performing image quality processing on at least part of the area in the preview screen based on the 3A algorithm, so that the image quality of at least part of the area in the preview screen is clearer, so that the target element of at least part of the area in the preview screen can be clearly identified. In this way, when it is detected that the change rate of at least part of the area in the preview screen exceeds a preset threshold, it is determined that the adjustment degree reaches the preset adjustment amplitude, and the target element in the preview screen is further identified.

[0058] In one embodiment, the shooting parameters of at least a portion of the preview image may be adjusted based on the preset optimal shooting parameters. Thus, when it is detected that the difference between the adjustment parameters of at least a portion of the preview image and the optimal shooting parameters is within the allowable error range, it is determined that the adjustment degree reaches the preset range.

[0059] In one embodiment, the target element may be an object with preset features such as a person, text, link, object, identification code, etc. The identification code may be, for example, a barcode or a QR code, etc. In one embodiment, the target element in the adjusted preview screen may be identified based on image recognition technology, template matching, feature point matching, deep learning target detection algorithm, etc.

[0060] In summary, in the processing method provided in this embodiment, the user can quickly trigger the scanning / object recognition mode by double-clicking anywhere on the preview interface, and at the same time give the recognition results and recommended information, which improves the flexibility of image processing and the convenience of image recognition.

[0061] Second embodiment Based on the same inventive concept as the above embodiments, refer to Figure 4 , the processing method provided in this embodiment includes: S1, in response to a first operation, adjusting shooting parameters for at least a partial area in a preview image, and when the adjustment degree reaches a preset adjustment range, identifying a target element in the adjusted preview image.

[0062] In one embodiment, the processing method further comprises at least one of the following: S2, displaying the element content corresponding to the target element in the preview screen.

[0063] S3, in response to the second operation, capturing a captured image according to the adjusted capturing parameters, and superimposing element content corresponding to the target element on the captured image.

[0064] In one embodiment, the element content includes at least one of the following: Element category, element name, element annotation, and element related links.

[0065] In one embodiment, the element category may be information for classifying the target element, such as "car", "pedestrian" or "building". In one embodiment, the element name is a specific identifier assigned to the target element, which may be represented in the form of text. In one embodiment, the element annotation may provide additional information about the target element, including text description, numerical data, identification code icon or other forms of metadata. In one embodiment, the element-related link may be a pointer to a resource with more information about the target element, including a web link, a database record or the address of other online resources. In this way, more in-depth information may be obtained through the element-related links, such as detailed product specifications, user reviews or related websites.

[0066] Optionally, step S2, displaying the element content corresponding to the target element in the preview screen, may include: identifying the target element in the preview screen. In one embodiment, identifying the target element in the preview screen may also include, but is not limited to, at least one of the following: determining that the adjustment degree does not reach a preset adjustment range; identifying the target element in the preview screen; and displaying an interface or animation obtained by identification in the preview screen.

[0067] Specifically, identifying the target element in the preview screen may include: first, detecting the outer contour of the target element in the preview screen by using the Sobel algorithm or the Canny algorithm to determine the contour information of the target element. Secondly, extracting the feature information of the target element based on any one of the scale-invariant feature transform (SIFT), speeded-up robust features (SURF), neural network models, or fast rotation-invariant binary descriptor (ORB) algorithms. Finally, based on the encoding rules of the target element, converting the identified feature information into corresponding numbers or characters, and determining it as the element content of the target element.

[0068] In one embodiment, the second operation includes at least one of the following: Receive a selection operation on the target element; Receiving an identification instruction; Receiving a focus area update instruction; Received a processing strategy update instruction.

[0069] Among them, in one embodiment, the selection operation of the target element can be that the user selects the target element in the preview screen when the user interacts with the system through the interface, including the element selected by the user using a mouse click, a touch screen gesture or a voice command. In one embodiment, the focus area update instruction can be that on the premise that the focus area of ​​the preview screen has been determined, in response to receiving an instruction of a focus area different from the previous one again, the focus area is re-determined accordingly. Here, the focus area update instruction can be determined by updating iterations based on multiple selection operations of the user. In one embodiment, the processing strategy update instruction can be that on the premise that the processing strategy has been received, a processing strategy different from the previous one is received again, and then the processing is performed accordingly based on the updated processing strategy. In one embodiment, when the focus area update instruction is received, or the processing strategy update instruction is received, since the received instruction is updated and changed, based on the received instruction, the image recognition method is updated accordingly, the layout of the user interface is adjusted, etc.

[0070] In one embodiment, the captured image may be captured by collecting the adjusted shooting parameters based on the determined focal length parameters, exposure parameters, and white balance parameters. In other embodiments, the captured image may be captured by collecting the adjusted shooting parameters based on other determined parameters that may affect the clarity of the image quality, such as photosensitivity parameters. Specifically, in one embodiment, the captured image captured by the adjusted shooting parameters may be an image obtained by adjusting the shooting parameters for at least a portion of the preview screen in response to the first operation. For example, it may be an image adjusted based on the preview screen selected by the first operation, or it may be a real-time image captured based on the adjusted shooting parameters selected by the second operation.

[0071] Optionally, after the adjusted shooting parameters capture the captured image, the element content corresponding to the target element is superimposed on the captured image. In one embodiment, when the element content corresponding to the target element is superimposed on the captured image, it is generally achieved by popping up a user interface (UI) corresponding to the identified content of the target element. In one embodiment, the pop-up UI can be represented as an information box, a dialog box, or an interactive panel to provide detailed information about the identified element or other relevant operation information. In other embodiments, further operation options can be executed based on different target elements and based on the element content corresponding to the superimposed target element, such as viewing details, editing properties, or executing other commands.

[0072] In summary, in the processing method provided in this embodiment, the user can quickly trigger the scanning / object recognition mode by double-clicking anywhere on the preview interface, and at the same time give the recognition results and recommended information, which improves the flexibility of image processing and the convenience of image recognition.

[0073] Third embodiment Based on the same inventive concept as the above embodiments, refer to Figure 5 , the processing method provided in this embodiment includes: S1, in response to a first operation, adjusting shooting parameters for at least a partial area in a preview image, and when the adjustment degree reaches a preset adjustment range, identifying a target element in the adjusted preview image.

[0074] S4, when the adjustment degree does not reach the preset adjustment range, identifying the target element in the preview image before the adjustment.

[0075] In this embodiment, the processing method may further include at least one of the following: S5, restoring the preview screen before adjustment, and displaying the element content corresponding to the target element in the preview screen.

[0076] S6, in response to the third operation, capturing a captured image according to the captured parameters before adjustment, and superimposing the element content corresponding to the target element on the captured image.

[0077] Wherein, when the adjustment degree does not reach the preset adjustment range in step S4, it may include: setting a change threshold as a standard for judging whether the adjustment degree reaches the preset adjustment range. In this way, if the detected image change value exceeds the change threshold, it is determined that the adjustment degree reaches the preset adjustment range; if the detected image change value does not exceed the change threshold, it is determined that the adjustment degree does not reach the preset adjustment range.

[0078] In other embodiments, whether the preset adjustment range is reached can also be determined based on the preset optimal shooting parameters. In this way, if it is detected that the difference between the adjusted shooting parameters and the optimal shooting parameters is within the allowable error range, it is determined that the adjustment degree reaches the preset adjustment range; if it is detected that the difference between the adjusted shooting parameters and the optimal shooting parameters exceeds the error range, it is determined that the adjustment degree does not reach the preset adjustment range.

[0079] In one embodiment, step S5, restoring the preview screen before adjustment and displaying the element content corresponding to the target element in the preview screen, includes: if the target element in the preview screen before adjustment is not identified, restoring the preview screen before adjustment and displaying the element content corresponding to the target element in the preview screen.

[0080] Optionally, in step S5, restoring the preview image before adjustment can be canceled based on adjusting the shooting parameters to return to the preview image and shooting parameters before adjustment. Alternatively, the preview image before adjustment can be directly used as the current preview image. In this way, the element content corresponding to the target element is determined based on the current preview image.

[0081] In one embodiment, the third operation includes at least one of the following: Determine the target element in the preview image before adjustment; Identify the target elements in the preview image before adjustment; Determine the coordinate position of the target element in the preview image before adjustment.

[0082] Optionally, the position of the target element in the preview image can be detected by determining the bounding box or centroid of the target element. In one embodiment, the coordinate position of the target element can be represented by a pixel coordinate system, where the position of each pixel can be calculated relative to the (0,0) point in the upper left corner of the image. In this way, the specific position of the target element in the preview image can be accurately located.

[0083] In one embodiment, the captured image is captured according to the captured image parameters before adjustment in step S6, and the captured image can be captured according to the captured image parameters after adjustment based on the determined focal length parameter, exposure parameter, and white balance parameter. In other embodiments, the captured image can also be captured according to the captured image parameters after adjustment based on other determined parameters that can affect the image quality clarity, such as photosensitivity parameters.

[0084] In one embodiment, before superimposing the element content corresponding to the target element on the captured image in step S6, the target element needs to be identified in the preview screen, specifically including: first, detecting the outer contour of the target element in the preview screen by the Sobel algorithm or the Canny algorithm to determine the contour information of the target element. Secondly, extracting the feature information of the target element based on any one of the scale-invariant feature transform (SIFT), speeded-up robust features (SURF), neural network models, or fast rotation-invariant binary descriptors (ORB) algorithms. Finally, based on the encoding rules of the target element, the identified feature information is converted into corresponding numbers or characters, and determined as the element content of the target element.

[0085] As one implementation method, during the process of identifying the target element, an identifying interface is displayed.

[0086] Optionally, the display of the identifying interface may include at least one of an identifying prompt interface, a progress bar loading interface, an error prompt interface, an identification completion prompt interface, and a identification result preview interface.

[0087] Among them, in one embodiment, the recognition prompt interface can display basic prompt information for identifying the target element, such as "The recognition process is starting, please wait...", to inform the user that the recognition work is in progress. In one embodiment, the progress bar loading interface is a progress bar or loading animation displayed on the interface during the recognition process to identify the target element, so as to intuitively show the progress of the recognition process and let the user know how long it will take to wait. For example, the progress bar may gradually fill up as the recognition process proceeds, or the loading animation may be displayed in a loop. In one embodiment, the error prompt interface may be an error or warning message displayed on the interface in a timely manner if any problem or abnormal situation is encountered during the recognition process. For example, if a step fails or times out, the corresponding error message will be displayed, and possible solutions or suggestions will be provided. In one embodiment, the recognition completion prompt interface may be a completion prompt displayed on the interface after the recognition process is completed. This prompt may include "Recognition completed!" or a similar message to inform the user that the entire process has ended successfully. In one embodiment, after the recognition is completed, a user interface (UI) corresponding to the recognition result pops up to preview the recognition result. In one implementation, the pop-up UI may be represented as an information box, a dialog box, or an interactive panel to provide detailed information about the identified element or other relevant operation information.

[0088] In summary, in the processing method provided in this embodiment, by responding to the first operation, the shooting parameters are adjusted for at least a partial area in the preview screen. When the adjustment degree reaches a preset adjustment range, the target element in the adjusted preview screen is identified. The operation method is simple and the flexibility of image processing is improved.

[0089] Fourth embodiment Based on the same inventive concept as the above embodiments, this embodiment describes the technical solution of the above embodiments in detail through specific examples. Figure 6 Taking the target element as a barcode / QR code as an example, the processing method provided in this embodiment includes: Step S301: Acquire a first image.

[0090] Optionally, the camera is turned on and enters a normal photo / video mode to obtain a real-time preview stream of the camera. In one embodiment, in response to the first operation, the user can double-click an instruction anywhere on the screen preview interface to respond, and a screenshot of the preview stream is taken at the moment of receiving the first operation to obtain a preview screen, i.e., a first image.

[0091] Step S302: adjust at least a portion of the first image to determine whether the rate of change exceeds a preset threshold.

[0092] Optionally, the response position of the first operation is determined and converted into image coordinates, and image information of at least a portion of the area containing the image coordinates is determined and used as the initial second image. In one embodiment, the shooting parameters of the second image are adjusted, including: focal length parameters, exposure parameters, white balance parameters, etc. In one embodiment, the change rate of the adjusted second image and the initial second image before adjustment is compared to determine whether the change rate exceeds a preset threshold.

[0093] If it exceeds the preset threshold, step S303 is executed to obtain the second image, that is, the adjusted second image is determined as the final second image.

[0094] If it does not exceed the preset threshold, step S304 is executed to perform barcode / QR code recognition on the first image.

[0095] Step S305: Display the UI / animation obtained by recognition.

[0096] In one embodiment, when the barcode / QR code recognition is performed on the first image, a corresponding pop-up UI / animation may be displayed in the first image, such as Figure 7 As shown, the UI can be represented as an information box, a dialog box, or an interactive panel to provide detailed information or other related operation information about the recognized barcode / QR code. At the same time, based on different barcodes / QR codes, further operation options can be provided in the UI, such as viewing details, editing properties, or executing other commands.

[0097] Step S306: Determine whether the recognition is successful.

[0098] Optionally, whether the recognition is successful can be determined based on the UI / animation obtained by displaying the recognition. In one embodiment, if the recognition is wrong or the recognized content is inconsistent with the content required by the user, it is determined whether it is unsuccessful, and the process proceeds to step S307, in response to the second operation, the barcode / QR code recognition is performed on the second image, and step S308 is further executed to determine the annotation box in the second image and display the recognition result.

[0099] In one embodiment, the second operation instruction can be set as a recognition instruction for performing barcode / QR code recognition on the second image. This can be a corresponding response based on the user's set operation, or it can be automatically switched to the second image to perform barcode / QR code recognition when it is detected that the recognition of the first image is unsuccessful. In one embodiment, in response to the second operation instruction, the target coordinates in the second image are determined, and the vicinity of the target coordinates is used as the focus area, and the barcode / QR code in the second image is sequentially identified and determined, and the barcode / QR code is recognized.

[0100] If it is determined in step S306 that the barcode / QR code is successfully recognized, the process proceeds to step S309 to display the first image, determine the annotation frame, and display the recognition result.

[0101] In one embodiment, a label box is superimposed and drawn at the coordinates of the recognition result of the first image to prompt the user whether the interaction is accurate; and a UI pops up. If the recognition result is a barcode / QR code, the UI displays the recognition result text or link for copying the text or jumping to the browser to open it. If the recognition result is an object, a graphic introduction of the object recognition result, shopping recommendations, etc. are displayed.

[0102] Step S310: In response to the third operation, update the region of interest.

[0103] Optionally, in response to the user updating the focus area (such as manually re-designating the area, etc.), or the user's instruction to return to the original preview screen, the area selection algorithm is executed accordingly, and the focus area is updated.

[0104] Step S311: Identify the area of ​​interest.

[0105] Optionally, based on the updated area of ​​interest, the barcode / QR code in the area of ​​interest is recognized.

[0106] In summary, in the processing method provided in this embodiment, the user can quickly trigger the scanning / object recognition mode by double-clicking anywhere on the preview interface, and at the same time give the recognition results and recommended information, which improves the flexibility of image processing and the convenience of image recognition.

[0107] An embodiment of the present application also provides an intelligent terminal, including a memory and a processor. A processing program is stored in the memory, and when the processing program is executed by the processor, the steps of the processing method in any of the above embodiments are implemented.

[0108] An embodiment of the present application further provides a storage medium, on which a processing program is stored. When the processing program is executed by a processor, the steps of the processing method in any of the above embodiments are implemented.

[0109] In the embodiments of the smart terminal and storage medium provided in the present application, all technical features of any of the above-mentioned processing method embodiments may be included, and the expanded and explained contents of the specification are basically the same as those of the embodiments of the above-mentioned methods, and will not be repeated here.

[0110] The embodiment of the present application further provides a computer program product, which includes a computer program code. When the computer program code runs on a computer, the computer executes the methods in the above various possible implementation modes.

[0111] An embodiment of the present application also provides a chip, including a memory and a processor, the memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that a device equipped with the chip executes the methods in various possible implementation modes as described above.

[0112] It is understood that the above scenarios are only examples and do not constitute a limitation on the application scenarios of the technical solutions provided in the embodiments of the present application. The technical solutions of the present application can also be applied to other scenarios. For example, it is known to those skilled in the art that with the evolution of the system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0113] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0114] The steps in the method of the embodiment of the present application can be adjusted in order, combined and deleted according to actual needs.

[0115] The units in the device of the embodiment of the present application can be merged, divided and deleted according to actual needs.

[0116] In the present application, the same or similar terminology concepts, technical solutions and / or application scenario descriptions are generally described in detail only the first time they appear. When they appear again later, they are generally not repeated for the sake of brevity. When understanding the technical solutions and other contents of the present application, for the same or similar terminology concepts, technical solutions and / or application scenario descriptions that are not described in detail later, reference can be made to the previous related detailed descriptions.

[0117] In the present application, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0118] The various technical features of the technical solution of the present application can be arbitrarily combined. In order to make the description concise, not all possible combinations of the various technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of the present application.

[0119] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as above, and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, a controlled terminal, or a network device, etc.) to execute the method of each embodiment of the present application.

[0120] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a storage medium, or transmitted from one storage medium to another storage medium. For example, the computer instructions can be transmitted from a website site, a computer, a server or a data center to another website site, a computer, a server or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The storage medium can be any available medium that a computer can access or a data storage device such as a server or a data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a storage disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state storage disk Solid State Disk (SSD)), etc.

[0121] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A processing method, characterized in that: include: S1, in response to a first operation, adjusting shooting parameters for at least a partial area in a preview image, and when the adjustment degree reaches a preset adjustment range, identifying a target element in the adjusted preview image.

2. The method according to claim 1, characterized in that At least a portion of the preview image includes at least one of the following: The text area in the preview screen; The picture area in the preview screen; An identification code area in the preview screen; The character area in the preview image; The face area in the preview image; an object selected by the first operation in the preview screen; The preview screen as a whole.

3. The method according to claim 2, characterized in that The shooting parameters include at least one of the following: a focal length parameter, an exposure parameter, and a white balance parameter.

4. The method according to claim 1, characterized in that: Also includes at least one of the following: S2, displaying the element content corresponding to the target element in the preview screen; S3, in response to the second operation, capturing a captured image according to the adjusted capturing parameters, and superimposing the element content corresponding to the target element on the captured image.

5. The method according to claim 4, characterized in that The element content includes at least one of the following: Element category, element name, element annotation, and element related links.

6. The method according to claim 1, characterized in that Also includes: S4, when the adjustment degree does not reach the preset adjustment range, identifying the target element in the preview image before the adjustment.

7. The method according to claim 6, characterized in that Also includes at least one of the following: S5, restoring the preview screen before adjustment, and displaying the element content corresponding to the target element in the preview screen; S6, in response to the third operation, capturing a captured image according to the captured parameters before adjustment, and superimposing the element content corresponding to the target element on the captured image.

8. The method according to any one of claims 1 to 7, characterized in that: During the process of identifying the target element, an identifying interface is displayed.

9. An intelligent terminal, characterized in that: include: A memory and a processor, wherein a processing program is stored in the memory, and when the processing program is executed by the processor, the steps of the processing method according to any one of claims 1 to 8 are implemented.

10. A storage medium, characterized in that: The storage medium stores a processing program, and when the processing program is executed by the processor, the steps of the processing method according to any one of claims 1 to 8 are implemented.

Images