Control method, intelligent terminal and storage medium

Through the preset operation and control strategies of the camera module, contactless interaction on the smart terminal is realized, solving the problem of missing feel and blind pressing in touch screen operation, and improving user experience and operation convenience.

CN119299561APending Publication Date: 2025-01-10SHENZHEN TRANSSION HLDG CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411268169.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-10
Publication Date
2025-01-10

AI Technical Summary

Technical Problem

The interaction between users and smart terminals mainly relies on touch screen operations, resulting in missing touch feel of virtual buttons, low blind pressing accuracy and screen occlusion problems, affecting the user experience.

Method used

Through the preset operation of the camera module, the target button in the display application is controlled by the preset control strategy, including the use of the camera's pressure sensor, photosensitive value change and specific gesture recognition, and adjusting the key force, duration and speed. to achieve contactless interaction.

Benefits of technology

It improves the user's interaction convenience and experience with the display application interface, reduces the blind press error rate, and reduces the risk of obstructing the screen by virtual buttons.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119299561A_ABST
    Figure CN119299561A_ABST
Patent Text Reader

Abstract

The invention provides a control method, an intelligent terminal and a storage medium, and the method comprises the steps: responding to a preset operation for at least one camera of a camera module, and carrying out the key control of at least one target button in a current display application according to a preset control strategy. According to the technical scheme, non-contact interaction between the user and the display application interface can be realized, the operation is simple and convenient, and the user experience is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a control method, an intelligent terminal and a storage medium. Background Art

[0002] With the continuous development of electronic technology, touch screens have been widely used in various intelligent terminals. For example, terminal products such as smart phones, smart home appliances and tablet computers are equipped with touch screens and support touch operations.

[0003] In the process of conceiving and implementing this application, the inventors found that there are at least the following problems: the way users interact with smart terminals mainly relies on touch screen operations. However, the virtual buttons of the touch screen have problems such as lack of feel, low accuracy of blind pressing, and easy obstruction of the screen display, which may lead to poor user experience.

[0004] The preceding description is intended to provide general background information and does not necessarily constitute prior art. Summary of the invention

[0005] In response to the above technical problems, the present application provides a control method, an intelligent terminal and a storage medium, which can realize non-contact interaction between a user and a display application interface, and the operation is simple and convenient, thereby improving the user experience.

[0006] In order to solve the above technical problems, the present application provides a control method, comprising:

[0007] S1: In response to a preset operation on at least one camera of the camera module, according to a preset control strategy, key control is performed on at least one target button in the currently displayed application.

[0008] Optionally, the preset control strategy includes at least one of the following:

[0009] In response to a preset operation on a target camera in the camera module, triggering a target button associated with the target camera in the camera application;

[0010] In response to a preset operation on at least one camera in the camera module, triggering at least one operation button in the game application;

[0011] In response to a preset operation for at least one camera in the camera module, triggering a selection button of at least one option in a selection interface of a currently displayed application;

[0012] In response to a preset operation on a shooting camera, triggering an on button or an off button of the shooting camera in the video call application;

[0013] In response to a preset operation for the non-shooting camera, a same-screen on button or a same-screen off button in the video call application is triggered.

[0014] Optionally, in response to a preset operation on a target camera in the camera module, triggering a target button associated with the target camera in the camera application includes at least one of the following:

[0015] In response to a preset operation on a target camera in the camera module, triggering an on button or an off button of the target camera in the camera application;

[0016] In response to a preset operation on a target camera in the camera module, triggering an on button or an off button of a shooting mode corresponding to the target camera in the camera application;

[0017] In response to a preset operation for the telephoto camera in the camera module, triggering a focus increase button in the camera application;

[0018] In response to a preset operation for the wide-angle camera in the camera module, a focus reduction button in the camera application is triggered.

[0019] Optionally, in response to a preset operation on at least one camera in the camera module, triggering a selection button of at least one option in a selection interface of a currently displayed application includes:

[0020] The method triggers a selection button of a target option in a selection interface of a currently displayed application in response to a preset operation on the first camera in the camera module;

[0021] The response to the preset operation for the second camera in the camera module triggers a selection button of the target type option in the selection interface of the currently displayed application;

[0022] The response is to a preset operation for the third camera in the camera module, triggering a select all button in the selection interface of the currently displayed application.

[0023] Optionally, at least one of the following is included:

[0024] The screen displaying the application is located on the same side as the camera module;

[0025] The screens displaying the application are located on different sides of the camera module.

[0026] Optionally, at least one of the following is included:

[0027] At least one pressure sensor is provided in the camera module;

[0028] A pressure sensor is provided in at least one camera of the camera module;

[0029] The preset operation includes an operation for changing a pressure feedback value of the pressure sensor;

[0030] The preset operation includes an operation for changing the photosensitivity value of at least one camera in the camera module.

[0031] Optionally, at least one of the following is also included:

[0032] Adjusting the key strength according to the operation strength of the preset operation;

[0033] Adjust the key press duration according to the operation duration of the preset operation;

[0034] Adjust the keystroke speed according to the operation speed of the preset operation.

[0035] Optionally, at least one of the following is also included:

[0036] Displaying a button mark corresponding to the at least one camera on the current interface;

[0037] In response to a preset operation on at least one camera of the camera module, a trigger feedback is output.

[0038] The present application also provides an intelligent terminal, comprising: a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the steps of the above control method are implemented.

[0039] The present application also provides a computer storage medium, wherein the computer storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the above control method are implemented.

[0040] As described above, the control method of the present application responds to the preset operation of at least one camera of the camera module and performs key control on at least one target button in the current display application according to the preset control strategy. The technical solution of the present application can realize non-contact interaction between the user and the display application interface, which is simple and convenient to operate and improves the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] The drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present application, and are used together with the specification to explain the principles of the present application. In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative labor.

[0042] Figure 1 A schematic diagram of the hardware structure of an intelligent terminal for implementing various embodiments of the present application.

[0043] Figure 2 A communication network system architecture diagram provided for an embodiment of the present application.

[0044] Figure 3 It is a flowchart of a control method according to an embodiment of the present application.

[0045] Figure 4 It is one of the schematic diagrams of the implementation effect of the control method shown in the embodiment of the present application.

[0046] Figure 5 This is the second schematic diagram of the implementation effect of the control method shown in the embodiment of the present application.

[0047] Figure 6 This is the unfolded state of the smart terminal shown in the embodiment of the present application.

[0048] Figure 7 This is the folded state of the smart terminal shown in the embodiment of the present application.

[0049] The realization of the purpose, functional features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. The above-mentioned drawings have shown clear embodiments of this application, which will be described in more detail later. These drawings and textual descriptions are not intended to limit the scope of the concept of this application in any way, but to illustrate the concept of this application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0050] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0051] It should be noted that, in this article, the terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "includes a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element. In addition, components, features, and elements with the same name in different embodiments of the present application may have the same meaning or different meanings, and their specific meanings need to be determined by their explanation in the specific embodiment or further combined with the context of the specific embodiment.

[0052] It should be understood that, although the terms first, second, third, etc. may be used to describe various information in this article, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of this article, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein can be interpreted as "at the time of" or "when" or "in response to determination". Furthermore, as used in this article, the singular forms "one", "one" and "the" are intended to also include plural forms, unless there is an opposite indication in the context. It should be further understood that the terms "comprising" and "including" indicate that there are the described features, steps, operations, elements, components, projects, kinds, and / or groups, but do not exclude the existence, occurrence or addition of one or more other features, steps, operations, elements, components, projects, kinds, and / or groups. The terms "or", "and / or", "including at least one of the following" etc. used in this application can be interpreted as inclusive, or mean any one or any combination. For example, “comprising at least one of the following: A, B, C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”, and for another example, “A, B or C” or “A, B and / or C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”. An exception to this definition will only occur when a combination of elements, functions, steps or operations are inherently mutually exclusive in some manner.

[0053] It should be understood that, although the various steps in the flowchart in the embodiment of the present application are displayed in sequence according to the indication of the arrows, these steps are not necessarily performed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and it can be performed in other orders. Moreover, at least a portion of the steps in the figure may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and their execution order is not necessarily performed in sequence, but can be performed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.

[0054] As used herein, the words "if" and "if" may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to determining" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)", depending on the context.

[0055] It should be noted that in this article, step codes such as S1 and S2 are used for the purpose of expressing the corresponding content more clearly and concisely, and do not constitute a substantial limitation on the order. When implementing the step, those skilled in the art may execute S2 first and then S1, etc., but these should all be within the scope of protection of this application.

[0056] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0057] In the subsequent description, the suffixes such as "module", "component" or "unit" used to represent elements are only used to facilitate the description of the present application, and have no specific meanings. Therefore, "module", "component" or "unit" can be used in a mixed manner.

[0058] The intelligent terminal may be implemented in various forms. For example, the intelligent terminal described in the present application may include intelligent terminals such as mobile phones, tablet computers, laptop computers, PDAs, portable media players (PMPs), navigation devices, wearable devices, smart bracelets, pedometers, etc., as well as fixed terminals such as digital TVs and desktop computers.

[0059] The following description will be made by taking a mobile terminal as an example, and those skilled in the art will understand that, in addition to components specifically used for mobile purposes, the construction according to the embodiments of the present application can also be applied to fixed-type terminals.

[0060] See also Figure 1 , which is a schematic diagram of the hardware structure of a mobile terminal for implementing various embodiments of the present application, the mobile terminal 100 may include: RF (Radio Frequency) unit 101, WiFi module 102, audio output unit 103, A / V (audio / video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111 and other components. Those skilled in the art can understand that Figure 1 The structure of the mobile terminal shown in the figure does not constitute a limitation on the mobile terminal. The mobile terminal may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0061] Combine the following Figure 1 The following is a detailed introduction to the various components of the mobile terminal:

[0062] The radio frequency unit 101 can be used for receiving and sending signals during information transmission or communication. Specifically, after receiving the downlink information of the base station, it is sent to the processor 110 for processing; in addition, the uplink data is sent to the base station. Generally, the radio frequency unit 101 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, etc. In addition, the radio frequency unit 101 can also communicate with the network and other devices through wireless communication. The above-mentioned wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System of Mobile Communications), GPRS (Generic Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution), TDD-LTE (Time Division Duplexing-Long Term Evolution), and the like. ion, time-division duplex long-term evolution) and 5G, etc.

[0063] WiFi is a short-range wireless transmission technology. Mobile terminals can help users send and receive emails, browse web pages, and access streaming media through WiFi module 102. It provides users with wireless broadband Internet access. Figure 1 The WiFi module 102 is shown, but it is understandable that it is not an essential component of the mobile terminal and can be omitted as needed without changing the essence of the invention.

[0064] The audio output unit 103 can convert the audio data received by the RF unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output it as sound when the mobile terminal 100 is in a call signal reception mode, a talk mode, a recording mode, a voice recognition mode, a broadcast reception mode, etc. Moreover, the audio output unit 103 can also provide audio output related to a specific function performed by the mobile terminal 100 (for example, a call signal reception sound, a message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, etc.

[0065] The A / V input unit 104 is used to receive audio or video signals. The A / V input unit 104 may include a graphics processor (GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The processed image frame can be displayed on the display unit 106. The image frame processed by the graphics processor 1041 can be stored in the memory 109 (or other storage medium) or sent via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 can receive sound (audio data) via the microphone 1042 in a telephone call mode, a recording mode, a voice recognition mode, and other operating modes, and can process such sound into audio data. The processed audio (voice) data can be converted into a format output that can be sent to a mobile communication base station via the radio frequency unit 101 in the case of a telephone call mode. The microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the process of receiving and transmitting audio signals.

[0066] The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Optionally, the light sensor includes an ambient light sensor and a proximity sensor. Optionally, the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 1061 and / or the backlight when the mobile terminal 100 is moved to the ear. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors that can be configured on the mobile phone, such as fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be repeated here.

[0067] The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061, which may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

[0068] The user input unit 107 can be used to receive input digital or character information, and to generate key signal input related to the user settings and function control of the mobile terminal. Optionally, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also known as a touch screen, can collect the user's touch operation on or near it (such as the user's operation on the touch panel 1071 or near the touch panel 1071 using any suitable object or accessory such as a finger, stylus, etc.), and drive the corresponding connection device according to a pre-set program. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Optionally, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the touch point coordinates, and then sends it to the processor 110, and can receive and execute the command sent by the processor 110. In addition, the touch panel 1071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may further include other input devices 1072. Optionally, the other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, a function key (such as a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, etc., which are not specifically limited here.

[0069] Optionally, the touch panel 1071 may cover the display panel 1061. When the touch panel 1071 detects a touch operation on or near it, it transmits the information to the processor 110 to determine the type of touch event. Then, the processor 110 provides corresponding visual output on the display panel 1061 according to the type of touch event. Figure 1 In the figure, the touch panel 1071 and the display panel 1061 are used as two independent components to implement the input and output functions of the mobile terminal. However, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated to implement the input and output functions of the mobile terminal, which is not limited here.

[0070] The interface unit 108 serves as an interface through which at least one external device can be connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, etc. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal 100 and an external device.

[0071] The memory 109 can be used to store software programs and various data. The memory 109 can mainly include a program storage area and a data storage area. Optionally, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the memory 109 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0072] The processor 110 is the control center of the mobile terminal. It uses various interfaces and lines to connect various parts of the entire mobile terminal. It executes various functions of the mobile terminal and processes data by running or executing software programs and / or modules stored in the memory 109, and calling data stored in the memory 109, so as to monitor the mobile terminal as a whole. The processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor and a modem processor. Optionally, the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 110.

[0073] The mobile terminal 100 may also include a power supply 111 (such as a battery) for supplying power to various components. Preferably, the power supply 111 may be logically connected to the processor 110 via a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system.

[0074] although Figure 1 Not shown, the mobile terminal 100 may further include a Bluetooth module, etc., which will not be described in detail here.

[0075] In order to facilitate understanding of the embodiments of the present application, the communication network system on which the mobile terminal of the present application is based is described below.

[0076] See also Figure 2 , Figure 2 A communication network system architecture diagram is provided for an embodiment of the present application, wherein the communication network system is an LTE system of universal mobile communication technology, and the LTE system includes a UE (User Equ i pment) 201, an E-UTRAN (Evolved UMTS Terrestrial Rad i oAccess Network) 202, an EPC (Evolved Packet Core) 203 and an operator's IP service 204, which are connected in sequence for communication.

[0077] Optionally, UE201 may be the above-mentioned terminal 100, which will not be described in detail here.

[0078] E-UTRAN 202 includes eNodeB 2021 and other eNodeBs 2022, etc. Optionally, eNodeB 2021 may be connected to other eNodeBs 2022 via a backhaul (eg, an X2 interface), and eNodeB 2021 is connected to EPC 203, and eNodeB 2021 may provide UE 201 with access to EPC 203.

[0079] EPC203 may include MME (Mobility Management Entity) 2031, HSS (Home Subscriber Server) 2032, other MME 2033, SGW (Serving Gateway) 2034, PGW (PDN Gate Way) 2035 and PCRF (Policy and Rate Function) 2036. Optionally, MME 2031 is a control node for processing signaling between UE 201 and EPC 203, providing bearer and connection management. HSS 2032 is used to provide some registers to manage functions such as home location register (not shown), and save some user-specific information such as service features and data rates. All user data can be sent through SGW2034, PGW2035 can provide IP address allocation and other functions for UE 201, PCRF2036 is the policy and charging control policy decision point for service data flow and IP bearer resources, which selects and provides available policy and charging control decisions for the policy and charging execution function unit (not shown in the figure).

[0080] The IP service 204 may include the Internet, an intranet, an IMS (IP Multimedia Subsystem, IP Multimedia Subsystem) or other IP services.

[0081] Although the above introduction takes the LTE system as an example, those skilled in the art should know that the present application is not only applicable to the LTE system, but also to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA and future new network systems (such as 5G), etc., without limitation here.

[0082] Based on the above-mentioned mobile terminal hardware structure and communication network system, an embodiment of the present application is proposed.

[0083] See also Figure 3 , which is a flow chart of the control method shown in the embodiment of the present application. The present application provides a control method, which can be applied to a smart terminal (such as a mobile phone), and the method includes the following steps (for example, step S1):

[0084] S1: In response to a preset operation on at least one camera of the camera module, according to a preset control strategy, key control is performed on at least one target button in the currently displayed application.

[0085] Optionally, a preset operation is performed on one or more cameras in the camera module of the smart terminal. The preset operation refers to a specific action or gesture performed by the user on at least one camera in the camera module. These actions or gestures are predefined and can trigger corresponding preset control strategies to automatically control the target button in the current display application. The preset operation may include but is not limited to gesture recognition (such as waving, clicking, etc.), triggering of pressure sensors (such as pressing the camera area), changes in the camera's light sensitivity value, etc., and the execution mode of the control strategy can be adjusted according to the strength, duration and speed of the operation. In this way, non-contact interaction between the user and the display application screen can be achieved, improving user experience and ease of operation.

[0086] Optionally, at least one camera for receiving preset operations has an AON (Always on) function. The AON function means that the camera remains active to a certain extent when the device is in a low-power state (such as standby mode) so as to be able to quickly respond to user operations or detect environmental changes. The AON function enables the camera to continuously collect image data in low-power mode, and to continuously monitor user actions when the smart terminal is in standby mode to receive and identify preset operations.

[0087] Optionally, the preset control strategy can be a standard configuration preset by the smart terminal when it leaves the factory, or can be customized according to the personalized needs of the user.

[0088] Optionally, the target button is a visible or invisible interactive element in the user interface, which is a specific button that can be triggered in the currently displayed application and can be activated by contact or non-contact operation to perform a corresponding function or operation.

[0089] Optionally, the preset control strategy includes at least one of the following:

[0090] In response to a preset operation on a target camera in the camera module, triggering a target button associated with the target camera in the camera application;

[0091] In response to a preset operation on at least one camera in the camera module, triggering at least one operation button in the game application;

[0092] In response to a preset operation for at least one camera in the camera module, triggering a selection button of at least one option in a selection interface of a currently displayed application;

[0093] In response to a preset operation on the shooting camera, triggering an on button or an off button of the shooting camera in the video call application;

[0094] In response to a preset operation for the non-shooting camera, a same-screen on button or a same-screen off button in the video call application is triggered.

[0095] Optionally, the currently displayed application is a camera application, such as a camera application or other third-party camera application installed on a smart terminal for taking photos or recording videos. A preset operation of the user for a target camera is received, and a target button associated with the target camera in the camera application is triggered to control the camera application to perform specific functions, such as turning the camera on or off, switching shooting modes, adjusting the focus, etc.

[0096] Optionally, in response to a preset operation on a target camera in the camera module, triggering a target button associated with the target camera in the camera application includes at least one of the following:

[0097] In response to a preset operation on a target camera in the camera module, triggering an on button or an off button of the target camera in the camera application;

[0098] In response to a preset operation on a target camera in the camera module, triggering an on button or an off button of a shooting mode corresponding to the target camera in the camera application;

[0099] In response to a preset operation for the telephoto camera in the camera module, triggering a focus increase button in the camera application;

[0100] In response to a preset operation for the wide-angle camera in the camera module, a focus reduction button in the camera application is triggered.

[0101] Optionally, a preset operation of a user on a target camera in the camera module is received to control the target camera to be turned on or off. For example, when a user waves his palm towards the front camera, a front camera on button in the camera application is triggered, the front camera is turned on, and the user can take a selfie. When a user makes a fist towards the front camera, a front camera off button in the camera application is triggered, and the front camera is turned off.

[0102] Optionally, a preset operation of the user on the target camera in the camera module is received to control the on button or off button of the shooting mode corresponding to the target camera in the camera application. The shooting mode includes but is not limited to the photo mode, the video mode, the night mode, the portrait mode, the wide-angle mode, and the telephoto mode. For example, after the rear camera in the camera application is turned on, a single click operation of the user is received to trigger the opening of the photo mode, and a single click operation of the user is received again to trigger the closing of the photo mode.

[0103] Optionally, the camera module includes a plurality of cameras with the same or different configurations, which may include a telephoto camera and a wide-angle camera. A preset operation of the user on the telephoto camera is received, and a focus increase button in the camera application is triggered. A preset operation of the user on the wide-angle camera is received, and a focus reduction button in the camera application is triggered. For example, when the user continues to click on the telephoto camera, the shooting focal length is gradually increased. When the user continues to click on the wide-angle camera, the shooting focal length is gradually reduced.

[0104] Optionally, receiving a preset operation of at least one camera in the camera module by the user triggers at least one operation button in the game application. Figure 4 As shown, the camera module includes camera 1 and camera 2. When the game application is turned on, the game application interface is displayed on the upper part of the display screen of the smart terminal, and the lower left part of the display screen of the smart terminal displays buttons 6, 7 and 3 from left to right in sequence, and the preset operation is performed on camera 1 to trigger buttons 4 and 5 of the game application. Among them, buttons 6, 7 and 3 are virtual keys. By operating camera 1 and camera 2, the control effect of physical keys (i.e., buttons 4 and 5) can be simulated. In this game application, button 6 can be a direction key, button 7 can be a selection key, button 3 can be a start key, button 4 can be a B key, and button 5 can be an A key. In this way, by operating buttons 4 and 5, the button feel of the game application can be improved, the accuracy of blind pressing can be improved, and the blocking of the screen viewing effect by the button area can be reduced.

[0105] Optionally, in response to a preset operation on at least one camera in the camera module, triggering a selection button of at least one option in a selection interface of a currently displayed application includes:

[0106] In response to a preset operation on a first camera in the camera module, triggering a selection button of a target option in a selection interface of a currently displayed application;

[0107] In response to a preset operation for the second camera in the camera module, triggering a selection button for a target type option in a selection interface of a currently displayed application;

[0108] In response to a preset operation for the third camera in the camera module, a select all button in the selection interface of the currently displayed application is triggered.

[0109] Optionally, a preset operation of the user on at least one camera in the camera module is received, and a selection button of at least one option in the selection interface of the currently displayed application is triggered. The camera module may include multiple cameras, and the preset operations performed on different cameras may trigger different selection buttons on the selection interface of the currently displayed application. Specifically, the preset operation for the first camera may trigger a selection button for a target option. The preset operation for the second camera may trigger a selection button for a target class option. The preset operation for the third camera may trigger a select all button. For example, Figure 5 As shown, Figure 5 (a) is the front side of the smart terminal. Figure 5 (b) is the back side of the smart terminal. The smart terminal includes a first camera 10, a second camera 11, and a third camera 12. The user clicks the first camera 10 to control the cursor to move between the selection box xxx, the selection box yyy, and the selection box zzz on the front side, and double-clicks to select and confirm. Click the second camera 11 to control the cursor to move between the category selection box-first category and the category selection box-second category on the front side, and double-clicks to select and confirm. Click the third camera 12 to control the cursor to move to the all selection box, and double-clicks to select and confirm. In this way, a more flexible and convenient operation experience is provided for the user.

[0110] Optionally, when a user is using a video call application, the user can trigger the on button or off button of the camera in the video call application by performing a preset operation on the camera. For example, user C makes a video call with user D through the front camera. If user C wants to stop transmitting video information to user D, he can long press the front camera. When user C long presses for more than a preset time, a black screen is automatically sent to user D to replace the actual video stream. This state will continue until user C actively cancels the function. In this way, user C can temporarily choose not to show his video screen to the other party without interrupting the call.

[0111] Optionally, when the user is using a video call application, the user can trigger a same-screen on button or a same-screen off button in the video call application by performing a preset operation on the non-shooting camera. Same-screen refers to the screen sharing function during a video call, allowing the user to share the content of his or her screen with the other party during the video call. For example, user E makes a video call with user F through the front camera. If user E wants to show user F a document on her computer, she can click on the rear camera to turn on the screen sharing function provided by the video call application. After the sharing is completed, user E clicks on the rear camera again to turn off the screen sharing function. In this way, the user can easily switch the screen sharing function during a video call to meet different communication needs.

[0112] Optionally, at least one of the following is included:

[0113] The screen displaying the application is located on the same side as the camera module;

[0114] The screens that display the applications are located on different sides of the camera module.

[0115] Optionally, the screen for displaying the application can be located on the same side as the camera module. For example, a preset operation is performed on the front camera to control the application displayed on the screen on the same side. The user can operate the screen intuitively so that the preset operation is synchronized with the feedback of the screen. Since the screen and the camera are on the same side, the consistency and reliability of the operation can be ensured.

[0116] Optionally, the screens for displaying applications can be located on different sides of the camera module. For example, preset operations are performed on the rear camera to control applications displayed on different side screens. This can avoid the display screen being blocked by the operating camera to the greatest extent. Combined with the raised setting of the rear camera, it can improve the feel of the buttons and reduce the risk of accidental touches.

[0117] Alternatively, if Figure 6 and Figure 7 As shown, the control method of the embodiment of the present application can also be applied to a smart terminal with a folding screen and a secondary screen. The folding screen refers to the main display screen of the smart terminal that can be folded through a hinge. The secondary display screen refers to another display screen located on a different side from the main screen. Figure 6 When the smart terminal is in the unfolded state shown in FIG. 1 , the user can control the application displayed on the main display screen by performing preset operations on the camera module. Figure 7 In the unfolded state shown, the user can control the application displayed on the secondary display screen by performing preset operations on the camera module. In this way, by adjusting the intelligent terminal to switch between the folded state and the unfolded state, the user can control different display screens based on the preset operations on the same camera module, which enhances the flexibility of operation and improves the practicality and user experience of the device in different usage scenarios.

[0118] Optionally, at least one of the following is included:

[0119] At least one pressure sensor is provided in the camera module;

[0120] A pressure sensor is provided in at least one camera of the camera module;

[0121] The preset operation includes an operation for changing a pressure feedback value of a pressure sensor;

[0122] The preset operation includes an operation for changing the photosensitivity value of at least one camera in the camera module.

[0123] Optionally, the camera module includes one or more pressure sensors for detecting the pressure applied by the user. The user can perform a preset operation by pressing the area where the camera is located. The pressure sensor may also be located inside at least one camera, and the user can directly trigger the preset operation by pressing the camera. The user can achieve different preset operations by changing the force applied to the pressure sensor. For example, the user can lightly or hard press the camera to trigger different functions.

[0124] Optionally, users can change the camera's photosensitivity by blocking or partially blocking the camera to achieve different preset operations, such as adjusting exposure, switching to night vision mode, increasing video call brightness, turning on low-light mode, and adjusting exposure compensation. The photosensitivity refers to the sensitivity of the camera sensor to light. For example, when a user opens the camera app, the camera automatically adjusts to the default sensitivity. The user gently covers part of the camera with his finger. When it is detected that the camera is partially blocked, the photosensitivity is automatically reduced, reducing the amount of light entering, reducing the exposure of the photo, and making the imaging details clearer.

[0125] Optionally, at least one of the following is also included:

[0126] Adjust the key strength according to the operation strength of the preset operation;

[0127] Adjust the key duration according to the preset operation duration;

[0128] Adjust the keystroke speed according to the preset operation speed.

[0129] Optionally, the preset control strategy includes adjusting the key control mode of the target button, such as force, duration and speed, according to the specific characteristics of the preset operation, such as force, duration and speed. The control force of the target button is adjusted according to the operation force to improve the user experience. For example, a user may trigger a light touch button by pressing the camera lightly, while a heavy press may trigger a long press button. For another example, a short press on the camera may trigger a click, while a long press on the camera may trigger different operations, such as a long press to mute. For another example, a quick slide of the camera triggers a quick page turn, while a slow slide may trigger a slow scroll.

[0130] Optionally, at least one of the following is also included:

[0131] Display at least one button icon corresponding to a camera on the current interface;

[0132] In response to a preset operation on at least one camera of the camera module, a trigger feedback is output.

[0133] Optionally, a virtual button mark or icon corresponding to one or more cameras is displayed on the application interface of the display screen to enhance the intuitiveness and clarity of user operations and improve the convenience and accuracy of operations. When the user performs a preset operation, the display state of the button mark can also be dynamically adjusted, such as changing the color / shape, adding animation effects, changing the display position, etc., to improve the feedback effect.

[0134] Optionally, in response to a preset operation on at least one camera of the camera module, a trigger feedback is output, for example, tactile feedback is provided by vibration of the device, auditory feedback is provided by sound or voice prompt, etc. In this way, misoperation can be reduced and the interactive experience can be improved.

[0135] The present application also provides an intelligent terminal, which includes a memory and a processor. The memory stores a computer program, and when the computer program is executed by the processor, the steps of the control method in any of the above embodiments are implemented.

[0136] The present application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the control method in any of the above embodiments are implemented.

[0137] In the embodiments of the smart terminal and computer-readable storage medium provided in the present application, all technical features of any of the above-mentioned control method embodiments may be included, and the expanded and explained contents of the specification are basically the same as those of the embodiments of the above-mentioned methods, and will not be repeated here.

[0138] The embodiment of the present application further provides a computer program product, which includes a computer program code. When the computer program code runs on a computer, the computer executes the methods in the above various possible implementation modes.

[0139] An embodiment of the present application also provides a chip, including a memory and a processor, the memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that a device equipped with the chip executes the methods in various possible implementation modes as described above.

[0140] It is understood that the above scenarios are only examples and do not constitute a limitation on the application scenarios of the technical solutions provided in the embodiments of the present application. The technical solutions of the present application can also be applied to other scenarios. For example, it is known to those skilled in the art that with the evolution of the system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0141] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0142] The steps in the method of the embodiment of the present application can be adjusted in order, combined and deleted according to actual needs.

[0143] The units in the device of the embodiment of the present application can be merged, divided and deleted according to actual needs.

[0144] In the present application, the same or similar terminology concepts, technical solutions and / or application scenario descriptions are generally described in detail only the first time they appear. When they appear again later, they are generally not repeated for the sake of brevity. When understanding the technical solutions and other contents of the present application, for the same or similar terminology concepts, technical solutions and / or application scenario descriptions that are not described in detail later, reference can be made to the previous related detailed descriptions.

[0145] In the present application, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0146] The various technical features of the technical solution of the present application can be arbitrarily combined. In order to make the description concise, not all possible combinations of the various technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of the present application.

[0147] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as above, and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, a controlled terminal, or a network device, etc.) to execute the method of each embodiment of the present application.

[0148] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loading and executing computer program instructions on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, a computer, a server or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server, a data center, etc. that contains one or more available media integrated. The available medium can be a magnetic medium, (e.g., a floppy disk, a storage disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state storage disk So lid State Dis sk (SSD)), etc.

[0149] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A control method, characterized in that: include: S1: In response to a preset operation on at least one camera of the camera module, according to a preset control strategy, key control is performed on at least one target button in the currently displayed application.

2. The control method according to claim 1, characterized in that: The preset control strategy includes at least one of the following: In response to a preset operation on a target camera in the camera module, triggering a target button associated with the target camera in the camera application; In response to a preset operation on at least one camera in the camera module, triggering at least one operation button in the game application; In response to a preset operation for at least one camera in the camera module, triggering a selection button of at least one option in a selection interface of a currently displayed application; In response to a preset operation on a shooting camera, triggering an on button or an off button of the shooting camera in the video call application; In response to a preset operation for the non-shooting camera, a same-screen on button or a same-screen off button in the video call application is triggered.

3. The control method according to claim 2, characterized in that: The triggering of a target button associated with the target camera in the camera application in response to a preset operation on the target camera in the camera module includes at least one of the following: In response to a preset operation on a target camera in the camera module, triggering an on button or an off button of the target camera in the camera application; In response to a preset operation on a target camera in the camera module, triggering an on button or an off button of a shooting mode corresponding to the target camera in the camera application; In response to a preset operation for the telephoto camera in the camera module, triggering a focus increase button in the camera application; In response to a preset operation for the wide-angle camera in the camera module, a focus reduction button in the camera application is triggered.

4. The control method according to claim 2, characterized in that: The triggering of a selection button of at least one option in a selection interface of a currently displayed application in response to a preset operation on at least one camera in the camera module includes: The method triggers a selection button of a target option in a selection interface of a currently displayed application in response to a preset operation on the first camera in the camera module; The response to the preset operation for the second camera in the camera module triggers a selection button of the target type option in the selection interface of the currently displayed application; The response is to a preset operation for the third camera in the camera module, triggering a select all button in the selection interface of the currently displayed application.

5. The control method according to any one of claims 1 to 4, characterized in that: Include at least one of the following: The screen displaying the application is located on the same side as the camera module; The screens displaying the application are located on different sides of the camera module.

6. The control method according to any one of claims 1 to 4, characterized in that: Include at least one of the following: At least one pressure sensor is provided in the camera module; A pressure sensor is provided in at least one camera of the camera module; The preset operation includes an operation for changing a pressure feedback value of the pressure sensor; The preset operation includes an operation for changing the photosensitivity value of at least one camera in the camera module.

7. The control method according to claim 6, characterized in that: Also includes at least one of the following: Adjusting the key strength according to the operation strength of the preset operation; Adjust the key press duration according to the operation duration of the preset operation; Adjust the keystroke speed according to the operation speed of the preset operation.

8. The control method according to any one of claims 1 to 4, characterized in that: Also includes at least one of the following: Displaying a button mark corresponding to the at least one camera on the current interface; In response to a preset operation on at least one camera of the camera module, a trigger feedback is output.

9. An intelligent terminal, characterized in that: The intelligent terminal comprises: a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the steps of the control method according to any one of claims 1 to 8 are implemented.

10. A readable storage medium, characterized in that: The readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the control method according to any one of claims 1 to 8 are implemented.