Control method and device, electronic equipment and storage medium

Abstract

The invention provides a control method and device, electronic equipment and a storage medium. The method comprises the following steps: acquiring a gesture event corresponding to touch information; the touch information is acquired when a touch key on the electronic equipment is touched; and determining an interaction operation corresponding to the gesture event in the current application scene. Thus, the gesture operation can be detected through the touch key, interaction with the electronic equipment can be carried out, one-hand operation of a user is facilitated, and the use experience is improved.

Description

Technical Field

[0001] This disclosure relates to the field of control technology, and in particular to a control method, apparatus, electronic device and storage medium. Background Technology

[0002] As smart devices' displays grow larger, such as 6 inches, two hands are often required for operation. In some scenarios, such as riding the subway or bus, one hand needs to hold the handrail while the other holds the smart device. Because the area of ​​the thumb that can operate on the screen is limited, problems such as being unable to operate or difficulty in operation can easily occur, resulting in a poor user experience. Summary of the Invention

[0003] This disclosure provides a control method, apparatus, electronic device, and storage medium to solve the above-mentioned technical problems.

[0004] According to a first aspect of this disclosure, a control method is provided, comprising:

[0005] Acquire the gesture event corresponding to the touch information; the touch information is collected when the touch button on the electronic device is touched;

[0006] Determine the interactive operation corresponding to the gesture event in the current application scenario.

[0007] Optionally, the gesture event corresponding to the touch information is obtained, including:

[0008] Obtain the position order and sampling time order of each sampling point in the touch information;

[0009] The gesture event is determined to be either a first swipe operation or a second swipe operation based on the position order and the sampling time order; the first swipe operation is a swipe operation pointing in a first direction, and the second swipe operation is a swipe operation pointing in the opposite direction of the first direction.

[0010] Optionally, the gesture event corresponding to the touch information is obtained, including:

[0011] Obtain the pressure value and sampling time of each sampling point in the touch information;

[0012] The duration of pressure is determined based on the pressure value and the sampling time.

[0013] When the press duration exceeds a first preset duration threshold, the gesture event is determined to be a long press operation.

[0014] Optionally, obtaining the gesture event corresponding to the touch information also includes:

[0015] When the pressing duration is less than or equal to a first preset duration threshold, the gesture event is determined to be a click operation.

[0016] Optionally, determining the interaction operation corresponding to the gesture event in the current application scenario includes:

[0017] Determine the current application scenario and obtain the mapping relationship of the current application scenario; the mapping relationship includes the correspondence between gesture events and interactive operations;

[0018] The mapping relationship is queried based on the gesture event to obtain the interactive operation corresponding to the gesture event.

[0019] Optionally, determining the interaction operation corresponding to the gesture event in the current application scenario includes:

[0020] Update the sampling frequency of the touch button in the current application scenario to obtain touch update information;

[0021] Determine the gesture event based on the touch update information;

[0022] The mapping relationship of the current application scenario is queried based on the gesture event to obtain the interactive operation corresponding to the gesture event; the mapping relationship includes the correspondence between gesture events and interactive operations.

[0023] Optionally, the method further includes:

[0024] Execute the interactive operation corresponding to the gesture event.

[0025] Optionally, the interactive operation corresponding to the gesture event is executed, including:

[0026] When the current application scenario is image playback mode and the gesture event is a swipe operation, the current image is scaled and displayed.

[0027] Optionally, the method further includes:

[0028] When the scaled image is displayed, the original image corresponding to the scaled image is displayed in response to the detection of a click operation of a gesture event.

[0029] Optionally, the interactive operation corresponding to the gesture event is executed, including:

[0030] When the current application scenario is a menu scenario or a short video scenario and the gesture event is a swipe operation, the currently displayed content is swiped in the first direction or the opposite direction of the first aspect.

[0031] Optionally, the interactive operation corresponding to the gesture event is executed, including:

[0032] When the current application scenario is a camera preview scenario and the gesture event is a swipe operation, the swipe information is input to the camera module to adjust the camera's focal length.

[0033] Optionally, the interactive operation corresponding to the gesture event is executed, including:

[0034] When the current application scenario is a health management scenario and the gesture event is a press operation, a first information pop-up and / or a second information pop-up are generated; the first information pop-up is used to prompt the user to continue the press operation and maintain it for a second preset duration; the second information pop-up is used to prompt the user for the current press duration and whether the press action is correct.

[0035] When the duration of the pressing operation exceeds the second preset duration, a third information pop-up window is generated, which includes the health data of this detection.

[0036] Optionally, the interactive operation corresponding to the gesture event is executed, including:

[0037] When the current application scenario is a magnifying glass auxiliary interface scenario and the gesture event is a swipe operation, the currently displayed content is magnified and the magnified image is displayed.

[0038] Optionally, the currently displayed content can be magnified, including:

[0039] Take a screenshot of the currently displayed content to obtain the initial screenshot;

[0040] The initial screenshot is encoded to obtain an encoded image;

[0041] The coded image is magnified according to the magnification of the magnifying glass to obtain a magnified image;

[0042] Write the magnified image to the display cache.

[0043] According to a second aspect of this disclosure, a control device is provided, the device comprising:

[0044] The gesture event acquisition module is used to acquire gesture events corresponding to touch information; the touch information refers to the events generated when a touch button on an electronic device is operated.

[0045] The interaction operation determination module is used to determine the interaction operation corresponding to the gesture event in the current application scenario.

[0046] Optionally, the gesture event determination submodule includes:

[0047] The sequence acquisition unit is used to acquire the positional order and sampling time order of each sampling point in the touch information;

[0048] The gesture determination unit is used to determine whether the gesture event is a first swipe operation or a second swipe operation based on the position order and the sampling time order; the first swipe operation is a swipe operation pointing in a first direction, and the second swipe operation is a swipe operation pointing in the opposite direction of the first direction.

[0049] Optionally, the gesture event determination submodule includes:

[0050] The pressure-time acquisition unit is used to acquire the pressure value and sampling time of each sampling point in the touch information;

[0051] The duration of pressure is determined based on the pressure value and the sampling time.

[0052] When the press duration exceeds a first preset duration threshold, the gesture event is determined to be a long press operation.

[0053] Optionally, the gesture event determination submodule further includes:

[0054] The click operation determination unit is used to determine that the gesture event is a click operation when the pressing duration is less than or equal to a first preset duration threshold.

[0055] Optionally, the interactive operation determination module includes:

[0056] The current scenario determination submodule is used to determine the current application scenario and obtain the mapping relationship of the current application scenario; the mapping relationship includes the correspondence between gesture events and interactive operations;

[0057] The relationship table query submodule is used to query the mapping relationship based on the gesture event and obtain the interactive operation corresponding to the gesture event.

[0058] Optionally, the interactive operation determination module includes:

[0059] The update information acquisition submodule is used to update the sampling frequency of the touch button in the current application scenario and obtain touch update information;

[0060] The gesture event determination submodule is used to determine gesture events based on touch update information;

[0061] The interaction operation determination submodule is used to query the mapping relationship of the current application scenario based on the gesture event to obtain the interaction operation corresponding to the gesture event; the mapping relationship includes the correspondence between gesture events and interaction operations.

[0062] Optionally, the device further includes:

[0063] The interactive operation execution module is used to execute the interactive operation corresponding to the gesture event.

[0064] Optionally, the interactive operation execution module includes:

[0065] The image scaling submodule is used to scale the current image when the current application scenario is image playback mode and the gesture event is a swipe operation; and to display the scaled image.

[0066] Optionally, the device further includes:

[0067] The original image restoration submodule is used to display the original image corresponding to the scaled image when the scaled image is displayed, in response to the detection of a click operation of a gesture event.

[0068] Optionally, the interactive operation execution module includes:

[0069] The content display sliding submodule is used to slide the currently displayed content in a first direction or the opposite direction of the first aspect when the current application scenario is a menu scenario or a short video scenario and the gesture event is a sliding operation.

[0070] Optionally, the interactive operation execution module includes:

[0071] The camera central adjustment submodule is used to input swiping information into the camera module to adjust the camera's focal length when the current application scenario is a camera preview scenario and the gesture event is a swipe operation.

[0072] Optionally, the interactive operation execution module includes:

[0073] The first generation submodule is used to generate a first information pop-up and / or a second information pop-up when the current application scenario is a health management scenario and the gesture event is a press operation; the first information pop-up is used to prompt the user to continue the press operation and maintain it for a second preset duration; the second information pop-up is used to prompt the user for the current press duration and whether the press action is correct.

[0074] The second generation submodule is used to generate a third information pop-up window when the duration of the pressing operation exceeds the second preset duration. The third information pop-up window includes the health data of this detection.

[0075] Optionally, the interactive operation execution module includes:

[0076] The image magnification submodule is used to magnify the currently displayed content and display the magnified image when the current application scenario is a magnifying glass auxiliary interface scenario and the gesture event is a swipe operation.

[0077] Optionally, the image magnification submodule includes:

[0078] The initial screenshot acquisition unit is used to capture the currently displayed content and obtain an initial screenshot;

[0079] An encoded image acquisition unit is used to encode the initial screenshot to obtain an encoded image;

[0080] The magnified image acquisition unit is used to magnify the coded image according to the magnification of the magnifying glass to obtain a magnified image;

[0081] An image magnification writing unit is used to write the magnified image into a display cache.

[0082] According to a third aspect of this disclosure, an electronic device is provided, comprising: a processor and a memory;

[0083] The memory is used to store computer programs that can be executed by the processor;

[0084] The processor is configured to execute a computer program in the memory to implement the method as described in any of the first aspects.

[0085] According to a fourth aspect of this disclosure, a non-transitory computer-readable storage medium is provided, which, when an executable computer program in the storage medium is executed by a processor, enables the implementation of the method as described in any of the first aspects.

[0086] The technical solutions provided by the embodiments of this disclosure may include the following beneficial effects:

[0087] In the solution provided in this embodiment, the gesture event corresponding to the touch information is obtained; the touch information is collected when the touch button on the electronic device is touched; and the interactive operation corresponding to the gesture event in the current application scenario is determined. Because the touch button has a small area, it is convenient for users to operate the touch button with one hand to interact with the electronic device, which helps improve the user experience.

[0088] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0089] Figure 1 This is a schematic diagram illustrating an electronic device with a touch button according to an embodiment of the present disclosure.

[0090] Figure 2 This is a schematic diagram of an electronic device according to an embodiment of the present disclosure, which is provided with two touch buttons.

[0091] Figure 3 This is a schematic diagram illustrating the division of a sampling area using a touch button according to an embodiment of this disclosure.

[0092] Figure 4 This is a flowchart of a control method according to an embodiment of the present disclosure.

[0093] Figure 5 This is a flowchart illustrating one embodiment of the present disclosure of determining a sliding operation.

[0094] Figure 6 This is a flowchart illustrating how to determine a long-press operation according to an embodiment of the present disclosure.

[0095] Figure 7 This is a flowchart illustrating one embodiment of the present disclosure of determining an interactive operation.

[0096] Figure 8 This is a flowchart illustrating one embodiment of the present disclosure of determining an interactive operation.

[0097] Figure 9 This is a flowchart of another control method according to an embodiment of the present disclosure.

[0098] Figure 10 This is a system block diagram of an electronic device according to an embodiment of the present disclosure.

[0099] Figure 11 This is a schematic diagram of an enlarged display image according to an embodiment of the present disclosure.

[0100] Figure 12 This is a block diagram of a control device according to an embodiment of the present disclosure.

[0101] Figure 13 This is a block diagram of an electronic device according to an embodiment of the present disclosure. Detailed Implementation

[0102] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses consistent with some aspects of this disclosure as detailed in the appended claims.

[0103] To address the aforementioned technical problems, this disclosure provides a control method, apparatus, electronic device, and storage medium. The control method is applicable to electronic devices, including but not limited to smartphones, tablets, or personal computers, and other devices with processing capabilities. The electronic device includes touch buttons. See also... Figure 1 The touch button 10 can be located on one side of the electronic device, such as the right side; in this case, when the user holds the electronic device with their right hand, they can use their right thumb to press, click, or slide the touch button 10. See also Figure 2The touch buttons 10 can be located on both sides of the electronic device to accommodate left-hand or right-hand holding scenarios. It is understood that those skilled in the art can select the number and placement of the touch buttons according to the specific scenario; as long as touch operations can be detected, the corresponding solution falls within the protection scope of this disclosure.

[0104] In one example, the touch button 10 can be divided into multiple regions, each region being used as a sampling point. See also Figure 3 Taking a setup with 5 areas as an example, the touch button 10 includes sampling areas T0 to T4. This touch button 10 can detect press operations, such as... Figure 3 As shown in Figure a; it can detect single-click (or double-click) operations, such as... Figure 3 As shown in Figure b; it can also detect sliding operations, such as Figure 3 As shown in Figure c, the specific process is as follows: touch information is sampled according to a pre-set (or default) sampling frequency f. Within each sampling period, touch sub-data from sampling areas T0, T1, T2, T3, and T4 are acquired sequentially to form a set of touch information. It is understood that each set of touch information includes the position of the sampling point, the touch voltage, and the sampling time. In this example, the touch button 10 also includes a pressure sensor. The sampling points of this pressure sensor are the same as those in the aforementioned sampling areas T0 to T4. In this case, each set of touch information includes not only the position of the sampling point, the touch voltage, and the sampling time, but also the pressure value. Considering that the touch voltage and pressure value are collected simultaneously, their sampling times are the same.

[0105] In this embodiment, the sampling frequency of the touch button is usually a preset sampling frequency for sampling touch information. In one example, the touch button can be set to multiple sampling frequency levels, such as three frequencies: F1 (high), F2 (medium), and F3 (low). The default configuration is the low frequency sampling level F3. The appropriate sampling frequency level can be selected or the default frequency can be selected according to the specific scenario. The corresponding scheme falls within the protection scope of this disclosure.

[0106] In this embodiment, when the touch button is pressed, the pressure value p is set and configured into three levels: P1, P2 and P3. Based on the pressure value, operations such as long press, single click, double click or multiple clicks can be detected.

[0107] In this embodiment, when the touch button performs a slide detection, the triggering order of the sampling points and the triggering time order are calculated to determine the slide operation. For example, T0-T5 is defined as a downward slide (R1, delta_t1), which is the second slide operation, or T5-T0 is defined as an upward slide (R2, delta_t2), which is the first slide operation. The first slide operation is a slide operation pointing in a first direction, and the second slide operation is a slide operation pointing in the opposite direction of the first direction. The first direction refers to the direction from the bottom to the top when the display screen of the electronic device is facing the user, such as... Figure 1 The direction x is shown.

[0108] In this embodiment, the electronic device includes a processor that can be electrically connected to the touch buttons. The processor can acquire touch information collected by the touch buttons and execute a control method provided in this embodiment. (See also...) Figure 4 This includes steps 41 to 42.

[0109] In step 41, the gesture event corresponding to the touch information is obtained; the touch information is collected when the touch button on the electronic device is touched.

[0110] In this step, the processor of the electronic device can obtain the gesture event corresponding to the touch information.

[0111] See one example. Figure 5 The processor can acquire gesture events corresponding to touch information, including: in step 51, the processor can acquire the position order and sampling time order of each sampling point in the touch information. It is understood that the distribution of touch voltage can be determined based on the aforementioned position order and sampling time order. In step 52, the processor can determine whether the gesture event is a first swipe operation or a second swipe operation based on the position order and the sampling time order. Thus, this embodiment can acquire gesture events such as swipe operations.

[0112] In another example, see Figure 6The processor can acquire gesture events corresponding to touch information, including: in step 61, the processor can acquire the pressure value and sampling time of each sampling point in the touch information. In step 62, the processor can determine the press duration based on the pressure value and the sampling time. In step 63, when the press duration is greater than a first preset duration threshold, the processor can determine the gesture event as a long press operation. The press duration can also be updated during the long press process, thereby providing duration information for the application scenario. In some examples, when the press duration is less than or equal to the first preset duration, the processor can determine the gesture event as a single click operation; when two single click operations occur within a detection cycle, the gesture event is determined to be a double click operation; when multiple single click operations occur within a detection cycle, the gesture event is determined to be a multi-click event. Thus, this embodiment can acquire gesture events such as long press operations, single click operations, double click operations, or multi-click operations.

[0113] In step 42, the interactive operation corresponding to the gesture event in the current application scenario is determined.

[0114] In this step, the processor can determine the interactive operation corresponding to the gesture event in the current application scenario.

[0115] See one example. Figure 7 The processor can determine the interaction operation corresponding to the gesture event in the current application scenario, including:

[0116] In step 71, the processor can determine the current application scenario and obtain the mapping relationship of the current application scenario; this mapping relationship includes the correspondence between gesture events and interactive operations. It is understood that the above mapping relationship describes the interactive operations corresponding to different gesture events in various application scenarios. In some examples, the above mapping relationship can be represented by a mapping relationship table.

[0117] In step 72, the processor can query the above mapping relationship based on the gesture event to obtain the corresponding interactive operation. These interactive operations include zooming in and out of an image, swiping to display content, adjusting the camera focus, and health checks, and can be set according to the specific scenario.

[0118] In another example, see Figure 8 The processor can determine the interaction operation corresponding to the gesture event in the current application scenario, including:

[0119] In step 81, the processor can update the sampling frequency of the touch button in the current application scenario to obtain touch update information.

[0120] In step 82, the processor can determine the gesture event based on the touch update information. The steps for determining the gesture event can be found in the scheme of step 41, and will not be repeated here.

[0121] In step 83, the processor can query the mapping relationship of the current application scenario based on the gesture event to obtain the interactive operation corresponding to the gesture event; the mapping relationship includes the correspondence between gesture events and interactive operations.

[0122] Understandably, touch buttons sample touch information at a default sampling frequency. In this example, by updating to a higher sampling frequency, finer-grained touch information can be sampled, thereby obtaining more accurate gesture events and improving control precision.

[0123] In one embodiment, in Figure 4 Based on the example method, see [link / reference]. Figure 9 The control method also includes step 91.

[0124] In step 91, the processor can execute the interactive operation corresponding to the gesture event.

[0125] In one example, when the current application scenario is image playback mode and the gesture event is a swipe operation, the processor can scale the current image and display the scaled image, thereby enabling touch operation to control the scaling of the image.

[0126] In another example, when the scaled image is displayed, the processor can respond to a detected gesture event as a click operation by displaying the original image corresponding to the scaled image. This allows the user to continue touch operations after scaling the image to restore the original image.

[0127] In another example, when the current application scenario is a menu scenario or a short video scenario and the gesture event is a swipe operation, the processor can swipe the currently displayed content in a first direction or the opposite direction of the first aspect. For example, when the gesture event is a first swipe operation (such as... Figure 1 When the example shows an upward swipe, the currently displayed content can slide upward following the first swipe operation, at which point the content below the currently displayed content can be displayed.

[0128] In another example, when the current application scenario is a camera preview scenario and the gesture event is a swipe operation, the processor can input the swipe information into the camera module to adjust the camera's focal length.

[0129] In another example, when the current application scenario is a health management scenario and the gesture event is a press operation, the processor can generate a first information pop-up window to prompt the user to continue the press operation and maintain it for a second preset duration. And / or, the processor can generate a second information pop-up window to prompt the user about the current press duration and whether the press action is correct. Then, when the duration of the press operation exceeds the second preset duration, a third information pop-up window is generated, which includes the health data detected in this instance. Thus, in this example, displaying different information pop-ups can prompt the user, which helps improve the user experience.

[0130] In another example, when the current application scenario is a magnifying glass-assisted interface scenario and the gesture event is a swipe operation, the processor can magnify the currently displayed content. For example, the processor can take a screenshot of the currently displayed content to obtain an initial screenshot; then, it can encode the initial screenshot to obtain an encoded image; subsequently, it can magnify the encoded image according to the magnification of the magnifying glass to obtain a magnified image; furthermore, it can write the magnified image to the display cache and display the magnified image. In this way, this example can improve the clarity and reading experience by magnifying the currently displayed content.

[0131] The control method provided in this disclosure is described below with reference to a specific scenario. (See also...) Figure 10 ,include:

[0132] The electronic device is equipped with a touch button 10 for touch sampling 101 and a touch algorithm 102. The touch button 10 can collect touch sub-data from each sampling point at a default frequency. Each sampling period (e.g., 30ms, adjustable) can collect a set of touch information. The touch button can send the touch information to the touch algorithm 102. The touch algorithm 102 can determine whether the current touch operation is a click, press, or swipe gesture event based on one or more of the sampling point position order, sampling time order, touch voltage, and pressure value in the touch information.

[0133] The electronic device is also equipped with an input management module 103. The input data of the input management module 103 is the management of gesture events to filter out interference noise events; its output data is the filtered gesture events.

[0134] The electronic device also includes a scene management module 104. The input data for this scene management module 104 is the gesture events filtered and output by the input management module 103. Upon receiving a gesture event, the scene management module 104 can determine the current application scene 105, such as a gallery / camera scene, menu scene, camera preview scene, health management scene, or screen magnifier scene. Each application scene corresponds to a different interactive operation 106. For example, in the gallery / camera scene, one can zoom in or switch between images. In the menu scene, one can swipe up or down on the currently displayed content. In the camera preview scene, one can zoom in on the camera. In health management, one can monitor heart rate / blood pressure. In the screen magnifier scene, one can recognize and perform super-resolution on the currently displayed content.

[0135] In one example, when the electronic device is in an image playback scenario, and the user is using the device with one hand, their thumb can touch the touch buttons to zoom in or out of the image by swiping up or down. When the user triggers a swipe, the touch algorithm detects the swipe. If either (R1, delta_t1) or (R2, delta_t2) is detected, the swipe operation is reported to the input management module. The input management module then inputs the swipe operation information into the scene management module. The scene management module determines the current application scenario, identifying it as an image playback scenario. At this point, the image zoom-in or zoom-out interaction can be triggered, and the image layer is processed by the scaling module to zoom in or out. The zoomed-in or zoomed-out image is then re-displayed on the display interface. It's understood that this example also sets a maximum zoom level Z to ensure optimal image quality after zooming in. For example, the maximum magnification of a single pixel in the zoomed-in image is no more than four screen pixels. When a single click is detected, the zoom mode is exited, and the original image display is restored.

[0136] In another example, when an electronic device switches between menus or short videos, users can swipe up or down to navigate through the menu. Within the short video operation, swiping up or down allows users to switch between the previous or next short video content. This process involves: the user triggering a touch button swipe operation; the touch algorithm detects the button; when an operation of (R1, delta_t1) or (R2, delta_t2) is detected, the swipe operation is triggered and reported to the input management module. The input management module then inputs the swipe information into the scene management module. The scene management module determines the current application scenario, identifying whether it is in menu mode or a short video scenario. Finally, it triggers the up / down swipe operation to navigate between the menu / content interfaces.

[0137] In another example, on the camera preview interface, the electronic device allows for zooming at long or short distances by swiping up and down. This includes: the user triggers a touch button swipe operation; the touch algorithm detects the button; when (R1, delta_t1) or (R2, delta_t2) is detected, the swipe operation is triggered and reported to the input management module. The scene management module determines the current application scenario, identifying it as either the camera preview interface or a camera video recording scenario. In this scenario, the scene management module can reconfigure the sampling frequency F1 (high) for the touch button to maximize zoom accuracy. Triggering the up-and-down swipe operation inputs (R1, delta_t1) or (R2, delta_t2) as the zoom operation input, where delta_t1 and delta_t2 configure the zoom speed.

[0138] In another example, the electronic device is in health management mode. Health detection, such as heart rate / blood pressure detection, is performed by triggering the sampling accuracy of touch buttons. This includes: the user triggers a touch button press operation; the touch algorithm performs button detection; when pressure values ​​P1, P2, and P3 are detected, a press detection action is triggered. The input management module inputs the press information into the scene management module. The scene management module determines the current application scenario and identifies it as a health management scenario. In this health management scenario, the sampling frequency F1 (high) is reconfigured, and the zoom accuracy is correspondingly increased to the highest level. The user is prompted to press the touch button with their thumb, and the button press intensity is detected for a certain period of time (adjustable). Simultaneously, the screen displays the press duration (first information pop-up) and whether the press action is correct (second pop-up). The detection ends, and a third information pop-up is displayed to prompt the user with the corresponding health data.

[0139] In another example, when vision is limited in specific scenarios or among specific groups, such as the elderly or nearsighted individuals, users can tap a screen area to magnify the selected content. The magnification level can be switched by sliding a button up or down. This process includes: the user triggers a touch button press, which is detected in the touch algorithm. When an operation of (R1, delta_t1) or (R2, delta_t2) is detected, a sliding operation is triggered and reported to the input management module. The input management module inputs the press information into the scene management module. The scene management module determines the current application scenario, identifying it as a screen magnifier auxiliary interface. It then captures the screen content and magnifies it. Next, it triggers a zoom-in or zoom-out image operation, which enlarges the image layer using a scaling module. Finally, the magnified image is re-displayed on the display interface. See also... Figure 11Content 111 is displayed on screen 112. After being magnified, the magnified content 113 is displayed on screen 112. Simultaneously, a maximum magnification factor X is set to ensure image quality; typically, the individual pixels of the magnified image should not occupy more than four screen pixels. When a click operation is detected, the magnification mode is exited, and the original image is displayed.

[0140] Based on the control method provided in the embodiments of this disclosure, the embodiments of this disclosure also provide a control device, see [link to relevant documentation]. Figure 12 ,include:

[0141] The gesture event acquisition module 121 is used to acquire gesture events corresponding to touch information; the touch information refers to the information generated when a touch button on an electronic device is operated.

[0142] The interaction operation determination module 122 is used to determine the interaction operation corresponding to the gesture event in the current application scenario.

[0143] In one embodiment, the gesture event determination submodule includes:

[0144] The sequence acquisition unit is used to acquire the positional order and sampling time order of each sampling point in the touch information;

[0145] The gesture determination unit is used to determine whether the gesture event is a first swipe operation or a second swipe operation based on the position order and the sampling time order; the first swipe operation is a swipe operation pointing in a first direction, and the second swipe operation is a swipe operation pointing in the opposite direction of the first direction.

[0146] In one embodiment, the gesture event determination submodule includes:

[0147] The pressure-time acquisition unit is used to acquire the pressure value and sampling time of each sampling point in the touch information;

[0148] The duration of pressure is determined based on the pressure value and the sampling time.

[0149] When the press duration exceeds a first preset duration threshold, the gesture event is determined to be a long press operation.

[0150] In one embodiment, the gesture event determination submodule further includes:

[0151] The click operation determination unit is used to determine that the gesture event is a click operation when the pressing duration is less than or equal to a first preset duration threshold.

[0152] In one embodiment, the interactive operation determination module includes:

[0153] The current scenario determination submodule is used to determine the current application scenario and obtain the mapping relationship of the current application scenario; the mapping relationship includes the correspondence between gesture events and interactive operations;

[0154] The relationship table query submodule is used to query the mapping relationship based on the gesture event and obtain the interactive operation corresponding to the gesture event.

[0155] In one embodiment, the interactive operation determination module includes:

[0156] The update information acquisition submodule is used to update the sampling frequency of the touch button in the current application scenario and obtain touch update information;

[0157] The gesture event determination submodule is used to determine gesture events based on touch update information;

[0158] The interaction operation determination submodule is used to query the mapping relationship of the current application scenario based on the gesture event to obtain the interaction operation corresponding to the gesture event; the mapping relationship includes the correspondence between gesture events and interaction operations.

[0159] In one embodiment, the device further includes:

[0160] The interactive operation execution module is used to execute the interactive operation corresponding to the gesture event.

[0161] In one embodiment, the interactive operation execution module includes:

[0162] The image scaling submodule is used to scale the current image when the current application scenario is image playback mode and the gesture event is a swipe operation; and to display the scaled image.

[0163] In one embodiment, the device further includes:

[0164] The original image restoration submodule is used to display the original image corresponding to the scaled image when the scaled image is displayed, in response to the detection of a click operation of a gesture event.

[0165] In one embodiment, the interactive operation execution module includes:

[0166] The content display sliding submodule is used to slide the currently displayed content in a first direction or the opposite direction of the first aspect when the current application scenario is a menu scenario or a short video scenario and the gesture event is a sliding operation.

[0167] In one embodiment, the interactive operation execution module includes:

[0168] The camera central adjustment submodule is used to input swiping information into the camera module to adjust the camera's focal length when the current application scenario is a camera preview scenario and the gesture event is a swipe operation.

[0169] In one embodiment, the interactive operation execution module includes:

[0170] The first generation submodule is used to generate a first information pop-up and / or a second information pop-up when the current application scenario is a health management scenario and the gesture event is a press operation; the first information pop-up is used to prompt the user to continue the press operation and maintain it for a second preset duration; the second information pop-up is used to prompt the user for the current press duration and whether the press action is correct.

[0171] The second generation submodule is used to generate a third information pop-up window when the duration of the pressing operation exceeds the second preset duration. The third information pop-up window includes the health data of this detection.

[0172] In one embodiment, the interactive operation execution module includes:

[0173] The image magnification submodule is used to magnify the currently displayed content and display the magnified image when the current application scenario is a magnifying glass auxiliary interface scenario and the gesture event is a swipe operation.

[0174] In one embodiment, the image magnification submodule includes:

[0175] The initial screenshot acquisition unit is used to capture the currently displayed content and obtain an initial screenshot;

[0176] An encoded image acquisition unit is used to encode the initial screenshot to obtain an encoded image;

[0177] The magnified image acquisition unit is used to magnify the coded image according to the magnification of the magnifying glass to obtain a magnified image;

[0178] An image magnification writing unit is used to write the magnified image into a display cache.

[0179] It should be noted that the apparatus shown in this embodiment matches the content of the method embodiment, and the content of the above method embodiment can be referred to, which will not be repeated here.

[0180] Figure 13 This is a block diagram illustrating an electronic device according to an exemplary embodiment. For example, the electronic device 1300 may be a smartphone, computer, digital broadcasting terminal, tablet device, medical device, fitness equipment, personal digital assistant, etc. This electronic device can implement the control method described above.

[0181] Reference Figure 13 The electronic device 1300 may include one or more of the following components: processing component 1302, memory 1304, power supply component 1306, multimedia component 1308, audio component 1310, input / output (I / O) interface 1312, sensor component 1314, communication component 1316, and image acquisition component 1318.

[0182] Processing component 1302 typically controls the overall operation of electronic device 1300, such as operations associated with display, telephone calls, data communication, camera operation, and recording operations. Processing component 1302 may include one or more processors 1320 to execute computer programs. Furthermore, processing component 1302 may include one or more modules to facilitate interaction between processing component 1302 and other components. For example, processing component 1302 may include a multimedia module to facilitate interaction between multimedia component 1308 and processing component 1302. In one example, the processing component may include a processor for performing the methods described above.

[0183] Memory 1304 is configured to store various types of data to support the operation of electronic device 1300. Examples of such data include computer programs for any application or method operating on electronic device 1300, contact data, phone book data, messages, pictures, videos, etc. Memory 1304 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0184] Power supply assembly 1306 provides power to various components of electronic device 1300. Power supply assembly 1306 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to electronic device 1300. Power supply assembly 1306 may include a power chip, and a controller may communicate with the power chip to control the power chip to turn on or off a first switching device, thereby enabling or disabling battery power to the circuit board.

[0185] Multimedia component 1308 includes a screen that provides an output interface between electronic device 1300 and target object. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input information from the target object. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of touch or swipe actions but also the duration and pressure associated with the touch or swipe operation.

[0186] Audio component 1310 is configured to output and / or input audio file information. For example, audio component 1310 includes a microphone (MIC) configured to receive external audio file information when electronic device 1300 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio file information may be further stored in memory 1304 or transmitted via communication component 1316. In some embodiments, audio component 1310 also includes a speaker for outputting audio file information.

[0187] I / O interface 1312 provides an interface between processing component 1302 and peripheral interface modules, such as keyboards, click wheels, buttons, etc.

[0188] Sensor assembly 1314 includes one or more sensors for providing state assessments of various aspects of electronic device 1300. For example, sensor assembly 1314 can detect the on / off state of electronic device 1300, the relative positioning of components (e.g., the display screen and keypad of electronic device 1300), changes in position of electronic device 1300 or a component, the presence or absence of contact between a target object and electronic device 1300, the orientation or acceleration / deceleration of electronic device 1300, and temperature changes of electronic device 1300. In this example, sensor assembly 1314 may include magnetic sensors, gyroscopes, and magnetic field sensors, and may also include inertial sensors, image sensors, etc., wherein the magnetic field sensor includes at least one of the following: a Hall sensor, a thin-film magnetoresistive sensor, and a magnetic fluid accelerometer.

[0189] Communication component 1316 is configured to facilitate wired or wireless communication between electronic device 1300 and other devices. Electronic device 1300 can access wireless networks based on communication standards, such as WiFi, 2G, 3G, 4G, 5G, or combinations thereof. In one exemplary embodiment, communication component 1316 receives broadcast information or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 1316 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0190] In an exemplary embodiment, the electronic device 1300 may be implemented by one or more application-specific integrated circuits (ASICs), digital information processors (DSPs), digital information processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components.

[0191] In an exemplary embodiment, a non-transitory computer-readable storage medium is also provided, which enables the testing method described above to be implemented when an executable computer program in the storage medium is executed by a processor.

[0192] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and the practice of the disclosed solutions. This disclosure is intended to cover any variations, uses, or adaptations that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope of this disclosure is indicated by the claims.

[0193] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A control method, characterized in that, include: Obtain the gesture event corresponding to the touch information; The touch information is collected when a touch button on an electronic device is touched. Determine the interactive operation corresponding to the gesture event in the current application scenario.

2. The control method according to claim 1, characterized in that, Obtain the gesture events corresponding to the touch information, including: Obtain the position order and sampling time order of each sampling point in the touch information; The gesture event is determined to be either a first swipe operation or a second swipe operation based on the position order and the sampling time order; the first swipe operation is a swipe operation pointing in a first direction, and the second swipe operation is a swipe operation pointing in the opposite direction of the first direction.

3. The control method according to claim 1, characterized in that, Obtain the gesture events corresponding to the touch information, including: Obtain the pressure value and sampling time of each sampling point in the touch information; The duration of pressure is determined based on the pressure value and the sampling time. When the press duration exceeds a first preset duration threshold, the gesture event is determined to be a long press operation.

4. The control method according to claim 3, characterized in that, Obtaining the gesture event corresponding to the touch information also includes: When the pressing duration is less than or equal to a first preset duration threshold, the gesture event is determined to be a click operation.

5. The control method according to claim 1, characterized in that, Determine the interaction operation corresponding to the gesture event in the current application scenario, including: Determine the current application scenario and obtain the mapping relationship of the current application scenario; the mapping relationship includes the correspondence between gesture events and interactive operations; The mapping relationship is queried based on the gesture event to obtain the interactive operation corresponding to the gesture event.

6. The control method according to claim 1, characterized in that, Determine the interaction operation corresponding to the gesture event in the current application scenario, including: Update the sampling frequency of the touch button in the current application scenario to obtain touch update information; Determine the gesture event based on the touch update information; The mapping relationship of the current application scenario is queried based on the gesture event to obtain the interactive operation corresponding to the gesture event; the mapping relationship includes the correspondence between gesture events and interactive operations.

7. The control method according to claim 1, characterized in that, The method further includes: Execute the interactive operation corresponding to the gesture event.

8. The control method according to claim 7, characterized in that, Executing the interactive operation corresponding to the gesture event includes: When the current application scenario is image playback mode and the gesture event is a swipe operation, the current image is scaled and displayed.

9. The control method according to claim 8, characterized in that, The method further includes: When the scaled image is displayed, the original image corresponding to the scaled image is displayed in response to the detection of a click operation of a gesture event.

10. The control method according to claim 7, characterized in that, Executing the interactive operation corresponding to the gesture event includes: When the current application scenario is a menu scenario or a short video scenario and the gesture event is a swipe operation, the currently displayed content is swiped in the first direction or the opposite direction of the first aspect.

11. The control method according to claim 7, characterized in that, Executing the interactive operation corresponding to the gesture event includes: When the current application scenario is a camera preview scenario and the gesture event is a swipe operation, the swipe information is input to the camera module to adjust the camera's focal length.

12. The control method according to claim 7, characterized in that, Executing the interactive operation corresponding to the gesture event includes: When the current application scenario is a health management scenario and the gesture event is a press operation, a first information pop-up and / or a second information pop-up are generated; the first information pop-up is used to prompt the user to continue the press operation and maintain it for a second preset duration; the second information pop-up is used to prompt the user for the current press duration and whether the press action is correct. When the duration of the pressing operation exceeds the second preset duration, a third information pop-up window is generated, which includes the health data of this detection.

13. The control method according to claim 7, characterized in that, Executing the interactive operation corresponding to the gesture event includes: When the current application scenario is a magnifying glass auxiliary interface scenario and the gesture event is a swipe operation, the currently displayed content is magnified and the magnified image is displayed.

14. The control method according to claim 13, characterized in that, Enlarge the currently displayed content, including: Take a screenshot of the currently displayed content to obtain the initial screenshot; The initial screenshot is encoded to obtain an encoded image; The coded image is magnified according to the magnification of the magnifying glass to obtain a magnified image; Write the magnified image to the display cache.

15. A control device, characterized in that, The device includes: The gesture event acquisition module is used to acquire gesture events corresponding to touch information; the touch information refers to the events generated when a touch button on an electronic device is operated. The interaction operation determination module is used to determine the interaction operation corresponding to the gesture event in the current application scenario.

16. An electronic device, characterized in that, include: Processor and memory; The memory is used to store computer programs that can be executed by the processor; The processor is configured to execute a computer program in the memory to implement the method as described in any one of claims 1 to 14.

17. A non-transitory computer-readable storage medium, characterized in that, When the executable computer program in the storage medium is executed by a processor, it can implement the method as described in any one of claims 1 to 14.

Images