Processing methods, smart terminals and storage media

Abstract

This application proposes a processing method, a smart terminal, and a storage medium. The processing method, applicable to the smart terminal, includes the following steps: determining a content recognition area based on the usage state and a first preset touch operation. Through this technical solution, different content recognition areas are located according to different states of the smart terminal, reducing system overhead and improving the utilization rate of system resources.

Description

Technical Field

[0001] This application relates to the field of smart terminal technology, specifically to a processing method, a smart terminal, and a storage medium. Background Technology

[0002] Currently, with the popularization of smart terminals, there are more and more types of smart terminals, such as foldable screen phones.

[0003] In conceiving and implementing this application, the inventors discovered at least the following problems: To meet users' needs for analyzing or further processing certain displayed content, smart terminals often employ a full-screen scan of the display interface to obtain the content specified by the user. This recognition method wastes system resources and reduces recognition efficiency in split-screen mode.

[0004] The preceding description is intended to provide general background information and does not necessarily constitute prior art. Summary of the Invention

[0005] To address the aforementioned technical problems, this application provides a processing method, a smart terminal, and a storage medium that can effectively locate the content recognition area, reduce system losses, and improve the utilization rate of system resources.

[0006] This application provides a processing method applicable to smart terminals, including:

[0007] S10: Determine the content recognition area based on the usage status and the first preset touch operation.

[0008] Optionally, step S10 includes at least one of the following:

[0009] If the usage state is a folded state, the content recognition area is determined to be a full-screen area based on the first preset touch operation;

[0010] If the usage state is an open state, step S10 includes at least one of the following: determining the content recognition area based on the usage mode.

[0011] Optionally, determining the content recognition region based on usage patterns includes at least one of the following:

[0012] If the usage mode is split-screen mode, then the content recognition area is determined to be the split-screen area touched by the first preset touch operation;

[0013] If the usage mode is full-screen mode, then the content recognition area is determined to be the full-screen area.

[0014] Optionally, the steps also include:

[0015] S20: Determine the content recognition range in the content recognition area according to the second preset touch operation;

[0016] S30: Determine or generate recognition results and / or recognition result output methods based on the content recognition range, or determine recognition result output methods based on user historical behavior.

[0017] Optionally, the output method of the recognition result is determined according to the content recognition scope, including at least one of the following:

[0018] If the content recognition range is the full-screen area, the recognition result output method is determined to be displayed on the full-screen area;

[0019] If the content recognition range is the first region, the recognition result is determined to be displayed in the second region.

[0020] Optionally, the identification result includes at least one of the following:

[0021] Content information in the content-aware region;

[0022] Related information about content within the content-aware region;

[0023] Recommended information about content in the content-aware region.

[0024] Optionally, the method further includes the step of:

[0025] S40: Output the recognition result.

[0026] Optionally, the usage status is determined by the number of running objects and / or setting information.

[0027] This application also provides a processing apparatus, including:

[0028] The first determining unit is used to determine the content recognition area based on the usage status and the first preset touch operation.

[0029] Optionally, the first determining unit includes:

[0030] The first determining module is used to determine, if the usage state is a folded state, the content recognition area is a full-screen area based on the first preset touch operation;

[0031] The second determining module is used to determine the content recognition area based on the usage mode if the usage state is an open state.

[0032] Optionally, the second determining module includes:

[0033] The first determining submodule is used to determine the content recognition area as the split-screen area touched by the first preset touch operation if the usage mode is split-screen mode.

[0034] The second determining submodule is used to determine the content recognition area as a full-screen area if the usage mode is full-screen mode.

[0035] Optionally, the second determining unit is configured to determine a content recognition range in the content recognition area based on a second preset touch operation;

[0036] Optionally, the generation unit is used to determine or generate recognition results and / or recognition result output methods based on the content recognition range, or to determine the recognition result output methods based on user historical behavior.

[0037] Optionally, the generating unit includes at least one of the following:

[0038] The third determining module is used to determine that if the content recognition range is the full-screen area, the recognition result output method is to be displayed on the full-screen area;

[0039] The fourth determining module is used to determine that if the content recognition range is the first region, the recognition result output method is to be displayed on the second region.

[0040] Optionally, the identification result includes at least one of the following:

[0041] Content information in the content-aware region;

[0042] Related information about content within the content-aware region;

[0043] Recommended information about content in the content-aware region.

[0044] Optionally, the device further includes:

[0045] The output unit is used to output the recognition results.

[0046] Optionally, the usage status is determined by the number of running objects and / or setting information.

[0047] This application also provides a smart terminal, including: a memory and a processor, wherein the memory stores a processing program, and when the processing program is executed by the processor, it implements the steps of the method described above.

[0048] This application also provides a storage medium storing a computer program that, when executed by a processor, implements the steps of the method described above.

[0049] As described above, the processing method of this application can be applied to smart terminals, including the steps of: determining the content recognition area based on the usage state and a first preset touch operation. Through the above technical solution, different content recognition areas are located according to different states of the smart terminal, reducing system overhead and improving the utilization rate of system resources. Attached Figure Description

[0050] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application. To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, those skilled in the art can obtain other drawings based on these drawings without any creative effort.

[0051] Figure 1 A schematic diagram of the hardware structure of a smart terminal to implement the various embodiments of this application;

[0052] Figure 2 A communication network system architecture diagram provided for an embodiment of this application;

[0053] Figure 3 This is a flowchart illustrating the processing method according to the first embodiment;

[0054] Figure 4 This is a flowchart illustrating the processing method according to the second embodiment;

[0055] Figure 5 This is a schematic diagram of the processing apparatus shown according to the third embodiment;

[0056] Figure 6 This is a schematic diagram of the processing apparatus shown according to the fourth embodiment.

[0057] The realization of the objectives, functional features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. The accompanying drawings have illustrated specific embodiments of this application, which will be described in more detail below. These drawings and textual descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concepts of this application to those skilled in the art through reference to specific embodiments. Detailed Implementation

[0058] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0059] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, components, features, and elements with the same names in different embodiments of this application may have the same meaning or different meanings, the specific meaning of which must be determined by its interpretation in that specific embodiment or further in conjunction with the context of that specific embodiment.

[0060] It should be understood that although the terms first, second, third, etc., may be used herein to describe various information, such information should not be limited to these terms. These terms are used only to distinguish information of the same type from one another. For example, without departing from the scope of this document, first information may also be referred to as second information, and similarly, second information may also be referred to as first information. Depending on the context, the word "if," as used herein, may be interpreted as "when," "when," or "in response to determination." Furthermore, as used herein, the singular forms "a," "an," and "the" are intended to also include the plural forms unless the context indicates otherwise. It should be further understood that the terms "comprising," "including," indicate the presence of the stated feature, step, operation, element, component, item, kind, and / or group, but do not exclude the presence, occurrence, or addition of one or more other features, steps, operations, elements, components, items, kinds, and / or groups. The terms "or," "and / or," "including at least one of the following," etc., as used in this application, may be interpreted as inclusive, or mean any one or any combination thereof. For example, "including at least one of the following: A, B, C" means "any one of the following: A; B; C; A and B; A and C; B and C; A and B and C." Similarly, "A, B, or C" or "A, B, and / or C" means "any one of the following: A; B; C; A and B; A and C; B and C; A and B and C." Exceptions to this definition only occur when the combination of elements, functions, steps, or operations is inherently mutually exclusive in some way.

[0061] It should be understood that although the steps in the flowcharts of this application's embodiments are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some of the steps in the figures may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times, and their execution order is not necessarily sequential, but can be performed alternately or in turn with other steps or at least a portion of the sub-steps or stages of other steps.

[0062] Depending on the context, the words “if” or “suppose” as used here can be interpreted as “when” or “in response to determination” or “in response to detection.” Similarly, depending on the context, the phrases “if determination” or “if detection (of the stated condition or event)” can be interpreted as “when determination” or “in response to determination” or “when detection (of the stated condition or event)” or “in response to detection (of the stated condition or event).”

[0063] It should be noted that step designations such as S10 and S20 are used in this document for the purpose of more clearly and concisely describing the corresponding content, and do not constitute a substantial limitation on the order. In specific implementation, those skilled in the art may execute S20 first and then S10, etc., but these should all be within the protection scope of this application.

[0064] It should be understood that the specific embodiments described herein are merely illustrative of this application and are not intended to limit this application.

[0065] In the following description, the use of suffixes such as "module," "part," or "unit" to denote elements is solely for the purpose of illustrative purposes and has no specific meaning in itself. Therefore, "module," "part," or "unit" may be used interchangeably.

[0066] Smart terminals can be implemented in various forms. For example, the smart terminals described in this application may include smart terminals such as mobile phones, tablets, laptops, handheld computers, personal digital assistants (PDAs), portable media players (PMPs), navigation devices, wearable devices, smart bracelets, pedometers, etc., as well as fixed terminals such as digital TVs and desktop computers.

[0067] The following description will use a mobile terminal as an example. Those skilled in the art will understand that, apart from elements specifically designed for mobile purposes, the construction according to the embodiments of this application can also be applied to fixed-type terminals.

[0068] Please see Figure 1 This is a schematic diagram of the hardware structure of a mobile terminal implementing various embodiments of this application. The mobile terminal 100 may include: an RF (Radio Frequency) unit 101, a WiFi module 102, an audio output unit 103, an A / V (Audio / Video) input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, a processor 110, and a power supply 111, etc. Those skilled in the art will understand that... Figure 1 The mobile terminal structure shown does not constitute a limitation on the mobile terminal. The mobile terminal may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0069] The following is combined Figure 1 A detailed introduction to each component of the mobile terminal:

[0070] The radio frequency unit 101 can be used for receiving and transmitting signals during information transmission or calls. Specifically, it receives downlink information from the base station and processes it with the processor 110; additionally, it transmits uplink data to the base station. Typically, the radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low-noise amplifier, and a duplexer. Furthermore, the radio frequency unit 101 can also communicate wirelessly with networks and other devices. The aforementioned wireless communications may use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution), TDD-LTE (Time Division Duplexing-Long Term Evolution), and 5G, etc.

[0071] WiFi is a short-range wireless transmission technology. Mobile terminals, through the WiFi module 102, can help users send and receive emails, browse web pages, and access streaming media, providing users with wireless broadband internet access. Although Figure 1 WiFi module 102 is shown, but it is understood that it is not a necessary component of a mobile terminal and can be omitted as needed without changing the nature of the invention.

[0072] The audio output unit 103 can convert audio data received by the radio frequency unit 101 or the WiFi module 102 or stored in the memory 109 into audio signals and output them as sound when the mobile terminal 100 is in call signal receiving mode, call mode, recording mode, voice recognition mode, broadcast receiving mode, etc. Furthermore, the audio output unit 103 can also provide audio output related to specific functions performed by the mobile terminal 100 (e.g., call signal receiving sound, message receiving sound, etc.). The audio output unit 103 may include a speaker, a buzzer, etc.

[0073] The A / V input unit 104 is used to receive audio or video signals. The A / V input unit 104 may include a graphics processing unit (GPU) 1041 and a microphone 1042. The GPU 1041 processes image data of still images or videos acquired by an image capture device (such as a camera) in video capture mode or image capture mode. The processed image frames can be displayed on the display unit 106. The image frames processed by the GPU 1041 can be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 can receive sound (audio data) in operating modes such as telephone call mode, recording mode, and voice recognition mode, and can process such sound into audio data. The processed audio (voice) data can be converted into a format that can be transmitted to a mobile communication base station via the radio frequency unit 101 in telephone call mode. The microphone 1042 can implement various types of noise cancellation (or suppression) algorithms to eliminate (or suppress) noise or interference generated during the reception and transmission of audio signals.

[0074] The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Optionally, the light sensor includes an ambient light sensor and a proximity sensor. Optionally, the ambient light sensor can adjust the brightness of the display panel 1061 according to the ambient light level, and the proximity sensor can turn off the display panel 1061 and / or backlight when the mobile terminal 100 is moved to the ear. As a type of motion sensor, an accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that recognize the phone's posture (such as landscape / portrait switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc. Other sensors that may be configured in the phone, such as fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, and infrared sensors, will not be described in detail here.

[0075] The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061, which may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

[0076] User input unit 107 can be used to receive input numerical or character information, and generate key signal inputs related to user settings and function control of the mobile terminal. Optionally, user input unit 107 may include touch panel 1071 and other input devices 1072. Touch panel 1071, also known as a touch screen, can collect touch operations performed by the user on or near it (such as operations performed by the user using a finger, stylus, or any suitable object or accessory on or near touch panel 1071), and drive corresponding connection devices according to a pre-set program. Touch panel 1071 may include a touch detection device and a touch controller. Optionally, the touch detection device detects the user's touch position and the signal generated by the touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts it into touch point coordinates, sends it to processor 110, and can receive and execute commands sent by processor 110. In addition, touch panel 1071 can be implemented using various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may also include other input devices 1072. Optionally, other input devices 1072 may include, but are not limited to, one or more of the following: physical keyboard, function keys (such as volume control buttons, power buttons, etc.), trackball, mouse, joystick, etc., without being specifically limited here.

[0077] Optionally, the touch panel 1071 may cover the display panel 1061. When the touch panel 1071 detects a touch operation on or near it, it transmits the information to the processor 110 to determine the type of touch event. Subsequently, the processor 110 provides corresponding visual output on the display panel 1061 based on the type of touch event. Although in Figure 1 In this embodiment, the touch panel 1071 and the display panel 1061 are two independent components to realize the input and output functions of the mobile terminal. However, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated to realize the input and output functions of the mobile terminal. The specific implementation is not limited here.

[0078] Interface unit 108 serves as an interface through which at least one external device can connect to mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, and so on. Interface unit 108 may be used to receive input (e.g., data, power, etc.) from the external device and transmit the received input to one or more elements within mobile terminal 100, or it may be used to transmit data between mobile terminal 100 and the external device.

[0079] The memory 109 can be used to store software programs and various data. The memory 109 may primarily include a program storage area and a data storage area. Optionally, the program storage area may store the operating system, applications required for at least one function (such as sound playback, image playback, etc.), etc.; the data storage area may store data created based on the use of the mobile phone (such as audio data, phonebook, etc.). Furthermore, the memory 109 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device.

[0080] The processor 110 is the control center of the mobile terminal. It connects various parts of the mobile terminal via various interfaces and lines. By running or executing software programs and / or modules stored in the memory 109, and by calling data stored in the memory 109, it performs various functions and processes data of the mobile terminal, thereby providing overall monitoring of the mobile terminal. The processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor and a modem processor. Optionally, the application processor mainly handles the operating system, user interface, and applications, while the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into the processor 110.

[0081] The mobile terminal 100 may also include a power supply 111 (such as a battery) that supplies power to various components. Preferably, the power supply 111 can be logically connected to the processor 110 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system.

[0082] although Figure 1 As not shown, the mobile terminal 100 may also include a Bluetooth module, etc., which will not be described in detail here.

[0083] To facilitate understanding of the embodiments of this application, the communication network system on which the mobile terminal of this application is based is described below.

[0084] Please see Figure 2 , Figure 2 This application provides a communication network system architecture diagram. The communication network system is an LTE system based on the universal mobile communication technology. The LTE system includes a UE (User Equipment) 201, an E-UTRAN (Evolved UMTS Terrestrial Radio Access Network) 202, an EPC (Evolved Packet Core) 203, and the operator's IP services 204, which are connected in sequence.

[0085] Optionally, UE201 can be the aforementioned terminal 100, which will not be described in detail here.

[0086] E-UTRAN202 includes eNodeB2021 and other eNodeB2022, etc. Optionally, eNodeB2021 can connect to other eNodeB2022 via backhaul (e.g., X2 interface), and eNodeB2021 connects to EPC203, providing access from UE201 to EPC203.

[0087] EPC203 may include MME (Mobility Management Entity) 2031, HSS (Home Subscriber Server) 2032, other MMEs 2033, SGW (Serving Gateway) 2034, PGW (Packet Data Network Gateway) 2035, and PCRF (Policy and Charging Rules Function) 2036, etc. Optionally, MME2031 is the control node that handles signaling between UE201 and EPC203, providing bearer and connection management. HSS2032 is used to provide registers to manage functions such as the Home Location Register (not shown in the figure) and stores user-specific information such as service characteristics and data rates. All user data can be sent through SGW2034. PGW2035 can provide UE 201 IP address allocation and other functions. PCRF2036 is the policy and charging control decision point for service data flow and IP bearer resources. It selects and provides available policy and charging control decisions for the policy and charging enforcement function unit (not shown in the figure).

[0088] IP services 204 may include the Internet, intranet, IMS (IP Multimedia Subsystem), or other IP services.

[0089] Although the above description uses the LTE system as an example, those skilled in the art should know that this application is not only applicable to the LTE system, but also to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, 5G and future new network systems (such as 6G), etc., without limitation.

[0090] Based on the above-described mobile terminal hardware structure and communication network system, various embodiments of this application are proposed.

[0091] First Embodiment

[0092] Reference Figure 3 , Figure 3 This is a flowchart illustrating the processing method according to the first embodiment. The processing method of this application embodiment can be applied to a smart terminal (such as a mobile phone) and includes the following steps:

[0093] S10: Determine the content recognition area based on the usage status and the first preset touch operation.

[0094] In this embodiment, the usage states of the smart terminal include: a folded state and an unfolded state. In the folded state, the smart terminal is used after being double-folded; in this state, the screen displayed in front of the user is not unfolded. In the unfolded state, the smart terminal is used after the screen is unfolded. The content recognition area is the area presented on the smart terminal screen. The content can be text, images, or videos, etc. No limitations are imposed.

[0095] This application provides a processing method applicable to smart terminals, comprising the steps of: determining a content recognition area based on the usage state and a first preset touch operation. Through this technical solution, different content recognition areas are located according to different states of the smart terminal, reducing system overhead and improving the utilization rate of system resources.

[0096] Second Embodiment

[0097] Reference Figure 4 , Figure 4 This is a flowchart illustrating the processing method according to the second embodiment. The processing method of this application embodiment can be applied to a smart terminal (such as a mobile phone) and includes the following steps:

[0098] S401: Determine the content recognition area based on the usage status and the first preset touch operation.

[0099] Optionally, the usage status is determined by the number of running objects and / or setting information.

[0100] In this embodiment, the running object can be an application in the smart terminal. The number of running objects indicates the number of running objects launched. If the number of running objects is greater than one, the smart terminal is in an open state; if the number of running objects is one, the smart terminal can be in either an open or closed state.

[0101] In this embodiment, the settings are pre-configured. For example, if the settings are set to keep the smart terminal in an open state, the smart terminal will always be in an open state; if the settings are set to keep the smart terminal in a folded state, the smart terminal will always be in a folded state.

[0102] Optionally, step S401 includes at least one of the following:

[0103] If the usage state is a folded state, the content recognition area is determined to be a full-screen area based on the first preset touch operation;

[0104] If the usage state is an open state, step S401 includes at least one of the following: determining the content recognition area based on the usage mode.

[0105] Optionally, the first preset touch operation is used to determine the content recognition area. The first preset touch operation can be set when the smart terminal leaves the factory, or it can be set by the user according to their own behavior habits. There is no restriction here.

[0106] In this embodiment, the usage mode can be either split-screen mode or full-screen mode. The usage mode can also be determined by a third preset touch operation, which can be the same as or different from the first preset touch operation. For example, the third preset touch operation can move the slider in the unfolded state, and the usage mode determined by the slider is the final execution mode.

[0107] Optionally, determining the content recognition region based on usage patterns includes at least one of the following:

[0108] If the usage mode is split-screen mode, then the content recognition area is determined to be the split-screen area touched by the first preset touch operation;

[0109] If the usage mode is full-screen mode, then the content recognition area is determined to be the full-screen area.

[0110] In this embodiment, the usage state is the non-folded state, meaning the smart terminal is used with the screen unfolded. Further, the split-screen mode in the non-folded state represents the simultaneous display of content on the first screen and then on the second screen; the two screens display content sequentially. In the split-screen mode of the smart terminal in the non-folded state, if the screen touched by the first preset touch operation is the first screen, then the first screen is determined as the content recognition area; if the screen touched by the first preset touch operation is the second screen, then the second screen is determined as the content recognition area.

[0111] In this embodiment, full-screen mode represents the content displayed after the first and second screens are combined. When the smart terminal is in full-screen mode in its non-folded state, the content recognition area is the first and second screens.

[0112] S402: Determine the content recognition range in the content recognition area according to the second preset touch operation.

[0113] In this embodiment, the second preset touch operation is used to instruct the determination of a specific content recognition range within the content recognition area. The second preset touch operation can be the same as or different from the first preset touch operation. For example, the second preset touch operation can move a content recognition slider within the content recognition area, and the area covered by the content recognition slider is the content recognition range.

[0114] S403: Determine or generate recognition results and / or recognition result output method based on the content recognition scope, or determine the recognition result output method based on user historical behavior.

[0115] In this embodiment, user history behavior refers to user profiles or user's historical usage records. If the content recognition scope includes multiple keywords, multiple different recognition results will be displayed. In this case, the order of different recognition results will affect the user experience. Therefore, user history behavior can be obtained to determine the output method of the recognition results. This output method can be a specific order or style.

[0116] Optionally, the identification results include at least one of the following:

[0117] Content information in the content-aware region;

[0118] Related information about content within the content-aware region;

[0119] Recommended information about content in the content-aware region.

[0120] In this embodiment, the content information can be text, animation, audio, or video. The associated information can be text semantic information, which represents text attribute information, such as address information, weather information, or date information.

[0121] After acquiring the content information within the content recognition area, the system identifies the keywords corresponding to the content information and determines recommended information based on these keywords. Specifically, links to the content information or interfaces of applications can be displayed. For example, if the keyword in the content information is "AA City BB District," then the recognition results will display an address card and interfaces for map applications or ride-hailing applications.

[0122] Furthermore, the recognition results may also include a copy button, a search button, or a share button. The search button can be connected to the search application's interface, allowing users to search within the application based on keywords.

[0123] In this embodiment, the associated information of the content information in the content recognition area can be text language information. Specifically, it can be displayed as text language information that the user frequently uses. For example, if the text language information in the content recognition area is Chinese, then the text language information in the recognition result will be Chinese; if the text language information that the user frequently uses is French, and the content information in the content recognition area is Chinese, then the text language information in the recognition result will be French. Furthermore, the recognition result includes a translation button, which can be used to translate the text language information in the content recognition area into a preset text language information as needed.

[0124] Optionally, the output method of the recognition result is determined according to the content recognition scope, including at least one of the following:

[0125] If the content recognition range is the full-screen area, the recognition result output method is determined to be displayed on the full-screen area;

[0126] If the content recognition range is the first region, the recognition result output method is determined to be displayed on the second region.

[0127] In this embodiment, if the area is full-screen, the recognition result can be displayed as a floating window over the entire screen. The size and position of the floating window can be adjusted, and the floating window can also be displayed in a minimized form.

[0128] In this embodiment, if it is a split-screen area, the content recognition range is the first area, and the recognition result is floated above the second area. Specifically, the recognition result can also be floated above the B split-screen area in the form of a floating window.

[0129] S404: Output the recognition result.

[0130] In this embodiment, the recognition results are output according to a preset format, which can be a display order, display time, and display style. In this embodiment, the display time can be concentrated at 7:00 AM. For example, if a user checks their smart terminal at 7:00 AM, the recognition results can be output concentrated at that time, effectively displaying the results without disturbing the user. In this embodiment, the display style can include transparency, background, and shape, etc.

[0131] This application provides a processing method applicable to smart terminals, comprising the steps of: determining a content recognition area based on usage status and a first preset touch operation; determining a content recognition range within the content recognition area based on a second preset touch operation; determining or generating a recognition result and / or a recognition result output method based on the content recognition range, or determining the recognition result output method based on user history behavior; and outputting the recognition result. This technical solution enhances the flexibility of interaction between the user and the smart terminal, and prioritizes display methods that conform to user habits, thereby improving the user experience.

[0132] Third Embodiment

[0133] Reference Figure 5 , Figure 5 This is a schematic diagram of the processing device according to the third embodiment. The processing device 50 of this application embodiment can be applied to a smart terminal (such as a mobile phone) and includes the following:

[0134] The first determining unit 501 is used to determine the content recognition area based on the usage status and the first preset touch operation.

[0135] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the above-described device can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0136] Fourth embodiment

[0137] Reference Figure 6 , Figure 6 This is a schematic diagram of the processing device according to the fourth embodiment. The processing device 60 of this application embodiment can be applied to a smart terminal (such as a mobile phone) and includes the following:

[0138] The first determining unit 601 is used to determine the content recognition area based on the usage status and the first preset touch operation.

[0139] Optionally, the first determining unit 601 includes:

[0140] The first determining module 6011 is used to determine the content recognition area as the full-screen area based on the first preset touch operation if the usage state is folded.

[0141] The second determining module 6012 is used to determine the content recognition area based on the usage mode if the usage state is non-folded.

[0142] Optionally, the second determining module 6012 includes:

[0143] The first determining submodule 60121 is used to determine the content recognition area as the split-screen area touched by the first preset touch operation if the usage mode is split-screen mode.

[0144] The second determining submodule 60122 is used to determine the content recognition area as the full-screen area if the usage mode is full-screen mode.

[0145] Optionally, the second determining unit 602 is used to determine the content recognition range in the content recognition area according to the second preset touch operation.

[0146] Optionally, the generation unit 603 is used to determine or generate recognition results and / or recognition result output methods based on the content recognition scope, or to determine the recognition result output methods based on user historical behavior.

[0147] Optionally, the generating unit 603 includes at least one of the following:

[0148] The third determining module 6031 is used to determine the recognition result output method as being displayed on the full-screen area if the content recognition range is the full-screen area.

[0149] The fourth determining module 6032 is used to determine the recognition result output method as displaying it on the second area if the content recognition range is the first area.

[0150] Optionally, the identification results include at least one of the following:

[0151] Content information in the content-aware region;

[0152] Related information about content within the content-aware region;

[0153] Recommended information about content in the content-aware region.

[0154] Optionally, device 60 further includes:

[0155] Output unit 604 is used to output the recognition results.

[0156] Optionally, the usage status is determined by the number of running objects and / or setting information.

[0157] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the above-described device can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0158] This application also provides a smart terminal, including a memory and a processor. The memory stores a processing program, and when the processing program is executed by the processor, it implements the steps of the processing method in any of the above embodiments.

[0159] This application also provides a storage medium storing a processing program, which, when executed by a processor, implements the steps of the processing method in any of the above embodiments.

[0160] In the embodiments of the smart terminal and storage medium provided in this application, all the technical features of any of the above-described processing method embodiments may be included. The extended and explained contents of the specification are basically the same as the embodiments of the above methods, and will not be repeated here.

[0161] This application also provides a computer program product, which includes computer program code. When the computer program code is run on a computer, it causes the computer to perform the methods described in the various possible implementations above.

[0162] This application also provides a chip, including a memory and a processor. The memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that a device with the chip installed performs the methods described in the various possible implementations above.

[0163] It is understood that the above scenarios are merely examples and do not constitute a limitation on the application scenarios of the technical solutions provided in the embodiments of this application. The technical solutions of this application can also be applied to other scenarios. For example, as those skilled in the art will know, with the evolution of system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.

[0164] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0165] The steps in the method of this application embodiment can be adjusted, combined, or deleted according to actual needs.

[0166] The units in the device of this application embodiment can be merged, divided, and deleted according to actual needs.

[0167] In this application, the same or similar terms, concepts, technical solutions and / or application scenario descriptions are generally described in detail only when they appear for the first time. When they appear again, they are generally not repeated for the sake of brevity. When understanding the technical solutions and other contents of this application, the same or similar terms, concepts, technical solutions and / or application scenario descriptions that are not described in detail later can be referred to their previous relevant detailed descriptions.

[0168] In this application, the descriptions of the various embodiments have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0169] The technical features of the present application can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of the present application.

[0170] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, controlled terminal, or network device, etc.) to execute the methods of each embodiment of this application.

[0171] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented, in whole or in part, as a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the flow or function according to the embodiments of this application is generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a storage medium or transmitted from one storage medium to another. For example, computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, storage disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., a solid-state disk (SSD)).

[0172] The above are merely preferred embodiments of this application and do not limit the patent scope of this application. Any equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of this application.

Claims

1. A processing method, characterized in that, Including the following steps: The usage status of the smart terminal is determined, including a folded state and an open state; the usage status is determined by the number of running objects and / or setting information. If the usage state is a folded state, then the content recognition area is determined to be the full-screen area according to the first preset touch operation; If the usage state is non-folded, the content recognition area is determined according to the usage mode of the smart terminal; Based on the second preset touch operation, the content recognition range is determined in the content recognition area; The recognition result and / or the recognition result output method are determined or generated based on the content recognition scope, or the recognition result output method is determined based on the user's historical behavior; Determining the content recognition area based on the usage pattern of the smart terminal includes: If the usage mode is split-screen mode, then the content recognition area is determined to be the split-screen area touched by the first preset touch operation; If the usage mode is full-screen mode, then the content recognition area is determined to be a full-screen area; Determining the output method of the recognition result based on the content recognition range includes: If the content recognition range is the full-screen area, the recognition result output method is determined to be displayed on the full-screen area; If the content recognition range is the first region, the recognition result is determined to be displayed in the second region.

2. The method as described in claim 1, characterized in that, The identification result includes at least one of the following: Content information in the content-aware region; Related information about content within the content-aware region; Recommended information about content in the content-aware region.

3. The method as described in claim 1, characterized in that, The method further includes the following steps: S40: Output the recognition result.

4. A smart terminal, characterized in that, include: A memory and a processor, wherein the memory stores a processing program, which, when executed by the processor, implements the steps of the processing method as described in any one of claims 1 to 3.

5. A storage medium, characterized in that, The storage medium stores a computer program, which, when executed by a processor, implements the steps of the processing method as described in any one of claims 1 to 3.

6. A computer program product comprising computer program code, which, when executed on a computer, causes the computer to perform the steps of the processing method as described in any one of claims 1 to 3.

Images