Screen capture method, device and storage medium

By dividing the touch screen into multiple small screen pieces and identifying and tapping operations based on relative distance and gradient threshold threshold, the problem of low success rate of knuckle screenshots on large-screen devices is solved, achieving higher recognition accuracy and user experience.

CN117827054BActive Publication Date: 2025-03-11HONOR DEVICE CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202311633488.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-05-31
Publication Date
2025-03-11
Estimated Expiration
2042-05-31

AI Technical Summary

Technical Problem

The existing knuckle screenshot function has a low success rate on large-screen devices such as tablets, especially when the screen is large, the recognition rate and misjudgment rate are low, resulting in poor user experience.

Method used

By dividing the touch screen into multiple screen chunks with relatively small areas, and determining the gradient threshold of the screen chunk where the tapping position is determined based on the relative distance, distance coefficient and constant parameters between the screen chunk where the tapping position is, the acceleration sensor is located, thereby accurately identifying whether the tapping operation is a trigger screenshot.

Benefits of technology

It improves the success rate of knuckle screenshots of large-screen devices, enhances the recognition accuracy of screenshot operations, reduces the misjudgment rate, and improves the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117827054B_ABST
    Figure CN117827054B_ABST
Patent Text Reader

Abstract

The present application provides a screenshot method, device and storage medium. The touch screen is divided into a plurality of relatively small screen blocks, and the gradient threshold corresponding to the screen block where the tapping position is located is determined by determining the constant parameter corresponding to the screen block where the tapping position is located, the gradient threshold of the screen block where the acceleration sensor is located, and the relative distance between the two screen blocks and the distance coefficient corresponding to the relative distance, so that different tapping positions can correspond to different gradient thresholds, and thus it is possible to more accurately identify whether the tapping is to trigger the screenshot operation, which greatly improves the recognition rate of the screenshot operation.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application is a divisional application. The application number of the original application is 202210606734.9, and the original application date is May 31, 2022. The entire contents of the original application are incorporated into this application by reference. Technical Field

[0002] The present application relates to the technical field of terminal devices, and in particular to a screenshot method, device and storage medium. Background Art

[0003] With the continuous development of terminal device technology, the functions supported by terminal devices are becoming more and more abundant. For example, existing terminal devices usually support a screenshot function, so that users can capture the content they need at any time through the screenshot function when using the terminal device.

[0004] At present, in order to facilitate users to take screenshots with one hand, many terminal devices have the feature of supporting knuckle screenshots, so that users can take screenshots by continuously tapping the screen with a single knuckle.

[0005] However, the existing knuckle screenshot function is usually applicable to terminal devices with relatively small screens such as mobile phones. For terminal devices with larger screens such as tablet computers, the success rate of knuckle screenshot is low. Summary of the invention

[0006] In order to solve the above technical problems, the present application provides a screenshot method, device and storage medium, which aim to improve the success rate of knuckle screenshots on large-screen devices such as tablet computers.

[0007] In the first aspect, the present application provides a screenshot method, which is applied to a terminal device. The touch screen of the terminal device is divided into a plurality of screen blocks, and the method includes: in response to a user's tapping operation on the touch screen, determining the screen block where the tapping position is located and the gradient value corresponding to the tapping operation, the gradient value being used to indicate the amount of data change between multiple frames of acceleration data; determining the relative distance between the screen block where the tapping position is located and the screen block where the acceleration sensor is located; determining the gradient threshold of the screen block where the tapping position is located according to the gradient threshold of the screen block where the acceleration sensor is located, the relative distance, the distance coefficient corresponding to the relative distance, and the constant parameter corresponding to the screen block where the tapping position is located; when the gradient value corresponding to the tapping operation is greater than the gradient threshold of the screen block where the tapping position is located, triggering the screenshot. Therefore, by dividing the touch screen into multiple screen blocks with relatively small areas, and by determining the constant parameters corresponding to the screen block where the tap position is located, the gradient threshold value of the screen block where the acceleration sensor is located, and the relative distance between the two screen blocks and the distance coefficient corresponding to the relative distance, the gradient threshold value corresponding to the screen block where the tap position is located is determined, so that different tap positions can correspond to different gradient threshold values, and thus it can be more accurately identified whether the tap is to trigger a screenshot operation, thereby greatly improving the recognition rate of the screenshot operation.

[0008] According to the first aspect, determining the screen block where the tapping position is located includes: determining the coordinates of the tapping position relative to the touch screen; and determining the screen block where the tapping position is located according to the coordinates of the tapping position relative to the touch screen. In this way, by locating the coordinates of the tapping position, the screen block where the tapping position is located can be accurately determined according to the specific coordinates, thereby ensuring that the relative distance determined based on the screen block where the tapping position is located and the screen block where the acceleration sensor is located is more accurate, thereby ensuring that the calculated gradient threshold is more accurate, thereby further improving the recognition rate of the screenshot operation.

[0009] According to the first aspect, or any one of the implementation methods of the first aspect above, determining the coordinates of the tapping position relative to the touch screen includes: collecting point reporting data when the user taps the tapping position through the touch sensor in the touch screen; constructing a coordinate system relative to the touch screen; and determining the coordinates of the tapping position in the coordinate system based on the point reporting data.

[0010] According to the first aspect, or any implementation of the first aspect above, the coordinates of the tapping position in the coordinate system are determined, including: determining the change trend of the capacitance value according to the first capacitance value of the tapping position collected by the touch sensor in the reporting data within the first time threshold before the tapping, the second capacitance value at the tapping moment, and the third capacitance value within the second time threshold after the tapping; determining the coordinates of the tapping position in the coordinate system according to the change trend of the capacitance value. Since the capacitance value changes when the finger or the knuckle contacts the touch screen, in order to ensure the recognition rate and reduce the misjudgment as much as possible, by obtaining the tapping moment and the capacitance value within a certain time before and after the tapping moment, the change of the capacitance value can be accurately known, thereby accurately determining whether a tapping operation has occurred and the specific tapping position through the change trend of the capacitance value.

[0011] According to the first aspect, or any implementation of the first aspect above, after obtaining the reporting point data, the method further includes: collecting acceleration data when the user taps the tapping position through an acceleration sensor; predicting the confidence value of the tapping operation triggering the screenshot based on the reporting point data and the acceleration data; and executing the operation of constructing a coordinate system relative to the touch screen when the confidence value is greater than the set confidence threshold. In this way, the process of the screenshot method provided by the present application is executed only when the confidence value is greater than the set confidence threshold, thereby further improving the recognition rate of the screenshot operation.

[0012] According to the first aspect, or any implementation of the first aspect above, a coordinate system relative to the touch screen is constructed, including: taking the lower left corner of the touch screen as the coordinate origin; setting the X-axis horizontally to point to the right, the Y-axis vertically to point to the top, and the Z-axis to point to the front of the touch screen, to obtain a coordinate system relative to the touch screen.

[0013] According to the first aspect, or any implementation of the first aspect above, determining the gradient value corresponding to the tapping operation includes: collecting acceleration data when the user taps the tapping position through an acceleration sensor; and determining the gradient value corresponding to the tapping operation based on the acceleration data.

[0014] According to the first aspect, or any implementation of the first aspect above, based on the following formula, according to the gradient threshold value of the screen block where the acceleration sensor is located, the relative distance, the distance coefficient corresponding to the relative distance, and the constant parameter corresponding to the screen block where the tap position is located, the gradient threshold value of the screen block where the tap position is located is determined:

[0015] Current_Grandient=Threshold_Grandient*distance*Coeff+K

[0016] Among them, Current_Grandient is the gradient threshold value of the screen block where the tap position is located, Threshold_Grandient is the gradient threshold value of the screen block where the acceleration sensor is located; distance is the relative distance between the screen block where the tap position is located and the screen block where the acceleration sensor is located, Coeff is the distance coefficient corresponding to the relative distance, and K is the constant parameter corresponding to the screen block where the tap position is located.

[0017] According to the first aspect, or any implementation of the first aspect above, the number of acceleration sensors is greater than 1; determining the gradient value corresponding to the tapping operation includes: obtaining the acceleration data collected by each acceleration sensor when the user taps the tapping position; based on the acceleration data collected by each acceleration sensor when the user taps the tapping position, determining the gradient value corresponding to each acceleration sensor when the tapping operation acts on the tapping position.

[0018] According to the first aspect, or any implementation of the first aspect above, determining the relative distance between the screen block where the tap position is located and the screen block where the acceleration sensor is located includes: determining the relative distance between the screen block where the tap position is located and the screen block where each acceleration sensor is located.

[0019] According to the first aspect, or any implementation of the first aspect above, the gradient threshold of the screen block where the tapping position is located is determined according to the gradient threshold of the screen block where the acceleration sensor is located, the relative distance, the distance coefficient corresponding to the relative distance, and the constant parameter corresponding to the screen block where the tapping position is located, including: selecting the shortest relative distance from the determined multiple relative distances; determining the gradient threshold of the screen block where the tapping position is located according to the gradient threshold of the screen block where the acceleration sensor is located corresponding to the shortest relative distance, the shortest relative distance, the distance coefficient corresponding to the shortest relative distance, and the constant parameter corresponding to the screen block where the tapping position is located. In this way, when there are multiple acceleration sensors in the terminal device, the shortest relative distance, the distance coefficient corresponding to the shortest relative distance, and the gradient threshold of the screen block where the acceleration sensor is located are given priority to calculate the gradient threshold of the screen block where the tapping position is located, thereby ensuring that the calculated gradient threshold is more accurate, thereby further improving the recognition rate of the screenshot operation.

[0020] According to the first aspect, or any implementation of the first aspect above, when the gradient value corresponding to the tapping operation is greater than the gradient threshold of the screen block where the tapping position is located, the screenshot is triggered, including: when the gradient value corresponding to the acceleration sensor corresponding to the shortest relative distance is greater than the gradient threshold of the screen block where the tapping position is located, the screenshot is triggered. In this way, it is ensured that all judgments are based on the relevant parameters corresponding to the shortest relative distance, thereby ensuring the accuracy of the results.

[0021] According to the first aspect, or any implementation of the first aspect above, before determining the relative distance between the screen block where the tapping position is located and the screen block where the acceleration sensor is located, the method also includes: determining the relative distance between each screen block and the screen block where the acceleration sensor is located; with the acceleration sensor as the center, mapping outward based on the distance relationship function, and setting a corresponding distance coefficient for each relative distance. In this way, with the acceleration sensor as the center, mapping outward, setting distance coefficients corresponding to different relative distances, so that the distance coefficient required when calculating the gradient threshold can be more accurately fitted to the tapping operation, thereby ensuring that the calculated gradient threshold is more accurate, thereby further improving the recognition rate of the screenshot operation.

[0022] According to the first aspect, or any implementation of the first aspect above, before determining the relative distance between the screen block where the tapping position is located and the screen block where the acceleration sensor is located, the method also includes: determining the coordinates of the camera relative to the touch screen; determining the fold line of the touch screen according to the coordinates of the camera relative to the touch screen, the coordinates of the camera relative to the touch screen are located on the fold line, and the fold line runs through part of the screen blocks of the touch screen; setting corresponding constant parameters for each screen block according to the coordinates of the camera relative to the touch screen and the fold line. Since the protrusion of the camera will cause some areas to be unable to be parallel to the horizontal plane when the terminal device is placed horizontally, that is, there is a certain angle, so when the user clicks the touch screen of the terminal device, the reported point data and the acceleration data will be very different. Therefore, by considering the coordinates of the camera relative to the touch screen, setting special constant parameters for the screen block where the camera is located and the screen block on the fold line where the camera is located, it can ensure that the calculated gradient threshold is more accurate, thereby further improving the recognition rate of the screenshot operation.

[0023] According to the first aspect, or any implementation of the first aspect above, in response to a user tapping operation on the touch screen, determining the screen block where the tapping position is located and the gradient value corresponding to the tapping operation includes: when receiving N tapping operations on any same area of ​​the touch screen by the user within a set time threshold, determining the screen block where the tapping position is located and the gradient value corresponding to the tapping operation, where N is an integer greater than 1. In this way, within a specific time, when multiple taps on the same area of ​​the touch screen are monitored, the screenshot process provided by the present application is triggered, thereby reducing the false touch rate, and possibly avoiding the situation where the user accidentally touches and causes the screenshot.

[0024] In a second aspect, the present application provides a terminal device. The terminal device includes: a memory and a processor, the memory and the processor are coupled; the memory stores program instructions, and when the program instructions are executed by the processor, the terminal device executes instructions of the method in the first aspect or any possible implementation of the first aspect.

[0025] Exemplarily, the terminal device in the second aspect may be, for example, a terminal device with a relatively large screen size, such as a tablet computer.

[0026] In a third aspect, the present application provides a computer-readable medium for storing a computer program, wherein the computer program includes instructions for executing the method in the first aspect or any possible implementation of the first aspect.

[0027] In a fourth aspect, the present application provides a computer program, comprising instructions for executing the method in the first aspect or any possible implementation of the first aspect.

[0028] In a fifth aspect, the present application provides a chip, the chip comprising a processing circuit and a transceiver pin, wherein the transceiver pin and the processing circuit communicate with each other through an internal connection path, and the processing circuit executes the method in the first aspect or any possible implementation of the first aspect to control the receiving pin to receive a signal and control the sending pin to send a signal. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Figure 1 The following is a schematic diagram of the hardware structure of a terminal device shown as an example;

[0030] Figure 2 The following is a schematic diagram of a software structure of a terminal device shown as an example;

[0031] Figure 3 The following is a schematic diagram of an interface operation of a mobile phone shown as an example;

[0032] Figure 4 The figure is a schematic diagram showing the oscillation characteristics of acceleration data after tapping the screen of a mobile phone;

[0033] Figure 5 The figure is a schematic diagram of an interface operation of a tablet shown as an example;

[0034] Figure 6 is a schematic diagram of another tablet for interface operation as an example;

[0035] Figure 7 For example, the tapping Figure 6 Schematic diagram of the oscillation characteristics of the acceleration data behind the screen area shown;

[0036] Figure 8 The figure is a flowchart of an exemplary screenshot method;

[0037] Fig. 9 The following is a schematic diagram showing a touch screen division format of a tablet computer;

[0038] Fig.10 is a schematic diagram of an exemplary tapping plate;

[0039] Fig.11 The figure is a flowchart of another exemplary method for taking screenshots;

[0040] Fig.12 The figure is a flowchart of another exemplary method for taking screenshots;

[0041] Fig.13 The figure is a schematic diagram showing an exemplary arrangement of two acceleration sensors in a flat panel. DETAILED DESCRIPTION

[0042] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0043] The term "and / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0044] The terms "first" and "second" in the description and claims of the embodiments of the present application are used to distinguish different objects rather than to describe a specific order of objects. For example, a first target object and a second target object are used to distinguish different target objects rather than to describe a specific order of target objects.

[0045] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0046] In the description of the embodiments of the present application, unless otherwise specified, the meaning of "multiple" refers to two or more than two. For example, multiple processing units refer to two or more processing units; multiple systems refer to two or more systems.

[0047] In order to better understand the technical solution provided by the embodiments of the present application, before describing the technical solution of the embodiments of the present application, the hardware structure of the terminal device (such as a mobile phone, a tablet computer, a touch-screen PC, etc.) to which the embodiments of the present application are applicable is first described in conjunction with the accompanying drawings.

[0048] It should be noted that the technical solution provided in the embodiments of the present application is particularly suitable for terminal devices with relatively large screens, such as tablet computers, touch-screen PCs, smart screens, etc. For the sake of convenience, Figure 1 A tablet computer is used as an example for explanation.

[0049] See also Figure 1 The terminal device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0050] Exemplarily, in some implementations, the sensor module 180 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc., which are not listed one by one here and the present application does not limit this.

[0051] In order to better understand the working principles of the above sensors, the following is a detailed description:

[0052] The pressure sensor is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some implementations, the pressure sensor can be set on the display screen 194. There are many types of pressure sensors, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor, the capacitance between the electrodes changes. The terminal device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the terminal device 100 detects the touch operation intensity according to the pressure sensor. The terminal device 100 can also calculate the touch position according to the detection signal of the pressure sensor. In some implementations, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.

[0053] The gyroscope sensor can be used to determine the motion posture of the terminal device 100. In some implementations, the angular velocity of the terminal device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor. The gyroscope sensor can be used for anti-shake shooting. For example, when the shutter is pressed, the gyroscope sensor detects the angle of the terminal device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the terminal device 100 through reverse movement to achieve anti-shake. Gyroscope sensors can also be used for navigation and somatosensory game scenes.

[0054] The air pressure sensor is used to measure air pressure. In some implementations, the terminal device 100 calculates the altitude through the air pressure value measured by the air pressure sensor to assist positioning and navigation.

[0055] The magnetic sensor includes a Hall sensor. The terminal device 100 can use the magnetic sensor to detect the opening and closing of the flip leather case. In some implementations, when the terminal device 100 is a flip phone, the terminal device 100 can detect the opening and closing of the flip cover according to the magnetic sensor. Then, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, the flip cover automatic unlocking and other features are set.

[0056] The acceleration sensor can detect the magnitude of the acceleration of the terminal device 100 in all directions (generally three axes). When the terminal device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device and is applied to applications such as horizontal and vertical screen switching and pedometers.

[0057] The distance sensor is used to measure the distance. The terminal device 100 can measure the distance by infrared or laser. In some implementations, when shooting a scene, the terminal device 100 can use the distance sensor to measure the distance to achieve fast focusing.

[0058] The proximity light sensor may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The terminal device 100 emits infrared light outward through the light emitting diode. The terminal device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the terminal device 100. When insufficient reflected light is detected, the terminal device 100 can determine that there is no object near the terminal device 100. The terminal device 100 can use the proximity light sensor to detect that the user holds the terminal device 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.

[0059] The ambient light sensor is used to sense the ambient light brightness. The terminal device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor can also cooperate with the proximity light sensor to detect whether the terminal device 100 is in a pocket to prevent accidental touch.

[0060] The fingerprint sensor is used to collect fingerprints. The terminal device 100 can use the collected fingerprint characteristics to achieve fingerprint unlocking, access application locks, fingerprint photography, fingerprint answering calls, etc.

[0061] The temperature sensor is used to detect temperature. In some implementations, the terminal device 100 uses the temperature detected by the temperature sensor to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor exceeds a threshold, the terminal device 100 reduces the performance of the processor located near the temperature sensor to reduce power consumption and implement thermal protection. In other implementations, when the temperature is lower than another threshold, the terminal device 100 heats the battery 142 to avoid abnormal shutdown of the terminal device 100 due to low temperature. In some other implementations, when the temperature is lower than another threshold, the terminal device 100 performs a boost on the output voltage of the battery 142 to avoid abnormal shutdown due to low temperature.

[0062] Touch sensor, also known as "touch panel". The touch sensor can be set on the display screen 194, and the touch sensor and the display screen 194 form a touch screen, also known as a "touch screen". The touch sensor is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event, for example, it can include touch event types such as sliding, clicking, and long pressing. Visual output related to the touch operation can be provided by the display screen 194. In some other implementations, the touch sensor can also be set on the surface of the terminal device 100, which is different from the position of the display screen 194. Specifically, in the technical solution provided in the embodiment of the present application, when the user touches or taps the touch screen, the touch sensor will monitor the user's operation behavior, and the terminal device 100 will receive the data collected by the touch sensor in the touch screen, and will respond to the operation behavior, such as executing the operation of determining the screen block where the tapping position is located in the technical solution provided in the embodiment of the present application.

[0063] The bone conduction sensor can obtain vibration signals. In some implementations, the bone conduction sensor can obtain vibration signals of the vibrating bones of the vocal part of the human body. The bone conduction sensor can also contact the human pulse to receive blood pressure pulse signals. In some implementations, the bone conduction sensor can also be set in the earphones and combined into bone conduction earphones. The audio module 170 can parse out the voice signal based on the vibration signal of the vibrating bones of the vocal part obtained by the bone conduction sensor to realize the voice function. The application processor can parse the heart rate information based on the blood pressure pulse signal obtained by the bone conduction sensor to realize the heart rate detection function.

[0064] Specifically in the technical solution provided in the embodiment of the present application, the sensor module 180 needs to include at least a touch sensor and an acceleration sensor. In this way, the data collected by the touch sensor can determine whether the user has tapped the touch screen, and determine the specific coordinates of the user's tapping position, and the data collected by the acceleration sensor can determine the data changes between multiple frames of acceleration data, and determine the specific coordinates of the acceleration sensor. Then, according to the coordinates of the tapping position, the specific screen block of the tapping position on the touch screen is determined, and according to the coordinates of the acceleration sensor, the specific screen block of the acceleration sensor on the touch screen is determined, and then according to the determined two screen blocks, the gradient threshold value of the screen block where the tapping position is located is obtained and calculated, so that it can be accurately determined whether this tapping needs to trigger a screenshot operation.

[0065] In addition, it should be noted that the processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors.

[0066] It is understandable that the controller may be the nerve center and command center of the terminal device 100. In practical applications, the controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0067] In addition, it should be noted that a memory may be provided in the processor 110 for storing instructions and data. In some implementations, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0068] Exemplarily, in some implementations, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0069] Continue to see Figure 1 Exemplarily, the charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging implementations, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging implementations, the charging management module 140 may receive wireless charging input through a wireless charging coil of the terminal device 100. While the charging management module 140 is charging the battery 142, it may also power the electronic device through the power management module 141.

[0070] Continue to see Figure 1 Exemplarily, the power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and provides power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other implementations, the power management module 141 can also be set in the processor 110. In other implementations, the power management module 141 and the charging management module 140 can also be set in the same device.

[0071] Continue to see Figure 1, exemplarily, the wireless communication function of the terminal device 100 can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor.

[0072] It should be noted that antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in terminal device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other implementations, the antenna can be used in combination with a tuning switch.

[0073] Continue to see Figure 1 , exemplarily, the mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the terminal device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some implementations, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some implementations, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0074] In addition, it should be noted that the modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some implementations, the modem processor may be an independent device. In other implementations, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0075] Continue to see Figure 1Exemplarily, the wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the terminal device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0076] Specifically, in the technical solution provided in the embodiment of the present application, the terminal device 100 can communicate with the cloud server or other servers through the mobile communication module 150 or the wireless communication module 160. For example, the terminal device 100 can send the corresponding delay time to the cloud server through the mobile communication module 150. Exemplarily, the cloud can be a server cluster composed of multiple servers.

[0077] In addition, it should be noted that the terminal device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.

[0078] Continue to see Figure 1, exemplarily, the display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light emitting diode (QLED), etc. In some implementations, the terminal device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0079] In addition, it should be noted that the terminal device 100 can achieve the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0080] In addition, it should be noted that the ISP is used to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. The ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some implementations, the ISP can be set in the camera 193.

[0081] In addition, it should be noted that the camera 193 is used to capture static images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some implementations, the terminal device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0082] Specifically, in the technical solution provided in the embodiment of the present application, considering that the protrusion of the rear camera will affect the horizontal placement of the terminal device 100, the constant parameters set for each screen block take into account the impact of the camera position on each screen block.

[0083] In addition, it should be noted that the digital signal processor is used to process digital signals, and in addition to processing digital image signals, it can also process other digital signals. For example, when the terminal device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0084] In addition, it should be noted that the video codec is used to compress or decompress digital video. The terminal device 100 can support one or more video codecs. In this way, the terminal device 100 can play or record videos in multiple coding formats, such as: moving picture experts group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0085] Continue to see Figure 1 Exemplarily, the external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the terminal device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music and videos are stored in the external memory card.

[0086] Continue to see Figure 1 , exemplarily, the internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the terminal device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the terminal device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0087] Specifically, in the technical solution provided in the embodiment of the present application, the constant parameters corresponding to each screen block, the distance coefficient corresponding to the relative distance between any screen block and the screen block where the acceleration sensor is located, and the gradient threshold value of the screen block where the acceleration sensor is located can be pre-determined and stored in the internal memory 121 of the terminal device, so as to facilitate quick reading.

[0088] In addition, it should be noted that the terminal device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor.

[0089] In addition, it should be noted that the audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some implementations, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

[0090] Continue to see Figure 1 For example, the button 190 includes a power button, a volume button, etc. The button 190 may be a mechanical button or a touch button. The terminal device 100 may receive a button input and generate a key signal input related to the user settings and function control of the terminal device 100.

[0091] Continue to see Figure 1 , exemplarily, motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0092] Continue to see Figure 1 , exemplarily, the indicator 192 can be an indicator light, which can be used to indicate the charging status, power change, and can also be used to indicate messages, missed calls, notifications, etc.

[0093] The hardware structure of the terminal device 100 is introduced here. It should be understood that: Figure 1The terminal device 100 shown is only an example. In a specific implementation, the terminal device 100 may have more or fewer components than those shown in the figure, may combine two or more components, or may have a different component configuration. Figure 1 The various components shown in the EMBODIMENTS 2000 may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.

[0094] For a better understanding Figure 1 The software structure of the terminal device 100 is shown in FIG. 1 . The software structure of the terminal device 100 is described below. Before describing the software structure of the terminal device 100, the architecture that can be adopted by the software system of the terminal device 100 is first described.

[0095] Specifically, in actual applications, the software system of the terminal device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture.

[0096] In addition, it is understandable that the software systems used by the current mainstream terminal devices include but are not limited to Windows systems, Android systems and iOS systems. For ease of explanation, the embodiment of the present application takes the layered Android system as an example to exemplify the software structure of the terminal device 100.

[0097] In addition, in the subsequent specific implementation of the screenshot solution provided in the embodiment of the present application, the screenshot solution provided in the embodiment of the present application is also applicable to other systems.

[0098] See also Figure 2 , which is a software structure block diagram of the terminal device 100 according to an embodiment of the present application.

[0099] like Figure 2 As shown, the layered architecture of the terminal device 100 divides the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some implementations, the Android system is divided into four layers, from top to bottom, namely, the application layer, the application framework layer, the Android runtime (Android runtime) and the system library, and the kernel layer.

[0100] The application layer may include a series of application packages. Figure 2 As shown, the application package may include application market, video, shopping, permission management, Bluetooth, Wi-Fi, settings and other applications, which are not listed here one by one and are not limited in this application.

[0101] The application framework layer provides an application programming interface (API) and a programming framework for applications in the application layer.

[0102] The application framework layer includes some predefined functions. Figure 2 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, etc., which are not listed here one by one and are not limited in this application.

[0103] The window manager is used to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc. Specifically, in the technical solution provided by the embodiment of the present application, the window manager is required for the screenshot operation.

[0104] The content provider is used to store and obtain data and make the data accessible to the application. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone book, etc., which are not listed here and are not limited by this application.

[0105] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0106] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including connecting, hanging up, etc.).

[0107] The resource manager provides various resources for the application, such as localized strings, icons, images, layout files, video files, etc., which are not listed here one by one and are not limited in this application.

[0108] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0109] Android Runtime includes core libraries and virtual machines. Android Runtime is responsible for scheduling and management of the Android system.

[0110] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0111] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0112] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0113] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0114] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0115] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0116] It can be understood that the 2D graphics engine mentioned above is a drawing engine for 2D drawing.

[0117] In addition, it is understandable that the kernel layer in the Android system is a layer between hardware and software. The kernel layer includes at least a display driver, a camera driver, an audio driver, a sensor driver, etc. Exemplarily, the sensor driver can be used to output a detection signal of a sensor (such as a touch sensor) to the view system, so that the view system responds to the detection signal and displays a corresponding application interface.

[0118] The software structure of the terminal device 100 is introduced here. It can be understood that: Figure 2 The layers in the software structure shown and the components contained in each layer do not constitute a specific limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 may include more or fewer layers than shown in the figure, and each layer may include more or fewer components, which is not limited in the present application.

[0119] In order to better understand the technical solution provided by this application, the following Figures 3 to 7, taking the terminal devices as a mobile phone with a relatively small screen and a tablet with a relatively large screen as examples, the usage scenarios of the screenshot solution are explained.

[0120] See also Figure 3 For example, the current display interface 10a of the mobile phone 10 may include one or more controls. The controls include but are not limited to: network controls, power controls, application icon controls, etc.

[0121] Continue to see Figure 3 By way of example, application icon controls include, but are not limited to, clock application icon controls, calendar application icon controls, gallery application icon controls, memo application icon controls, file management application icon controls, email application icon controls, music application icon controls, calculator application icon controls, video application icon controls, settings application icon controls, weather application icon controls, browser application icon controls 302, etc. These are not listed one by one here and this application does not impose any limitation on this.

[0122] Continue to see Figure 3 For example, when a user triggers the finger joint screenshot function on the display page 10a, when the user uses the finger / knuckle ( Figure 3 The mobile phone 10 responds to the user's tapping operation by tapping the area 10a-1 of the display page 10a (using the knuckles) for a certain period of time, for example, twice within 1 second. As is understandable, since the screen of the mobile phone 10 is relatively small, even if the area 10a-1 tapped by the user is relatively far from the acceleration sensor in the mobile phone 10, the oscillation characteristics of the acceleration data (hereinafter referred to as: ACC data) collected by the acceleration sensor are also very obvious. Therefore, the mobile phone 10 can determine that this tapping operation triggers the knuckle screenshot function, and thus generates a screenshot instruction to trigger the screenshot operation, thereby capturing the screen corresponding to the display page 10a.

[0123] Exemplarily, in some implementations, the ACC data collected by the acceleration sensor may include the sampling point corresponding to the tapping moment, and ACC data corresponding to some sampling points before and after the tapping moment, for example, ACC data of a total of 126 sampling points before and after the tapping moment.

[0124] Exemplarily, in some other implementations, the ACC data collected by the acceleration sensor may be set to include ACC data at the tapping moment, within a certain time before the tapping moment, and within a certain time after the tapping moment.

[0125] In addition, it should be noted that in order to make the oscillation characteristics more obvious, the ACC data collected by the acceleration sensor can be multiplied by a fixed multiple, so that the oscillation characteristics of the ACC data corresponding to the current tapping operation can be determined more clearly and intuitively. Figure 4As shown, it is a schematic diagram of the oscillation characteristics of the ACC data of 126 collection points before and after the tapping collected by the acceleration sensor in the mobile phone 10 when the user taps the area 10a-1, multiplied by a fixed multiple.

[0126] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0127] From the above description, it can be known that in actual applications, for terminal devices with relatively small screens such as mobile phones 10, due to their relatively small screens, when tapping any position on the screen, the oscillation characteristics of the ACC data collected by the internal acceleration sensor are relatively obvious. Therefore, even if the same gradient threshold value (used to indicate the data variable between multiple frames / multiple sampling points of ACC data) is used for different tapping areas, it is possible to accurately identify whether the current tapping operation needs to trigger the knuckle screenshot function. However, for terminal devices with relatively large screens, such as Figure 5 and Figure 6 As shown in the tablet 20, it is assumed that the acceleration sensor disposed in the tablet 20 is located near 20a. When the user taps 20a, the oscillation characteristics of the ACC data collected by the acceleration sensor will be more obvious. The oscillation characteristic diagram thereof can be, for example, as shown in FIG. Figure 4 As shown in FIG. 1 , that is, by using the existing method of corresponding different tapping areas to the same gradient threshold, it is still possible to accurately identify that the current tapping operation needs to trigger the knuckle screenshot function. However, when the user taps at a location Figure 6 When the area 20b is shown, since the area 20b is far away from the acceleration sensor located near the area 20a, and the screen of the tablet 20 is large, the oscillation characteristics of the ACC data collected by the acceleration sensor are not obvious enough, for example Figure 7 As shown in Figure 2, even if the ACC data is multiplied by a fixed multiple, the maximum oscillation amplitude is between 3000 and 5000. Figure 4 As shown, it is directly between -3000 and 18000. For a terminal device with a relatively large screen such as the tablet 20, when the tapping position is far from the acceleration sensor, the gradient value corresponding to the tapping operation (used to indicate the data change amount between multiple frames of acceleration data) is often not greater than the preset fixed gradient threshold value, so the tapping operation is often not recognized as triggering the screenshot operation, the recognition rate and the false positive rate are very low, and the user experience is poor.

[0128] Therefore, in order to solve the shortcomings of the existing knuckle screenshot function when applied to large-screen devices, the present application provides a screenshot solution, which divides the touch screen into multiple screen blocks with relatively small areas, and determines the gradient threshold corresponding to the screen block where the tapping position is located by determining the constant parameters corresponding to the screen block where the tapping position is located, the gradient threshold of the screen block where the acceleration sensor is located, and the relative distance between the two screen blocks and the distance coefficient corresponding to the relative distance, so that different tapping positions can correspond to different gradient thresholds. In this way, it is only necessary to compare the gradient value corresponding to the tapping operation with the gradient threshold of the screen block where the tapping position is located, so as to accurately identify whether the tapping is to trigger a screenshot operation, so that the gradient threshold used in the judgment is more reasonable, thereby greatly improving the recognition rate of the screenshot operation.

[0129] Combination Figures 3 to 7 The screenshot scenario shown below takes the terminal device as a tablet device with a relatively large screen as an example, and uses several specific embodiments to illustrate the implementation details of the technical solution provided by this application. The following content is only the implementation details provided for ease of understanding and is not necessary for the implementation of this solution.

[0130] For example, see Figure 8 In some embodiments, the specific implementation steps of the screenshot solution provided by the present application include:

[0131] S101, when receiving N tapping operations on any same area of ​​a touch screen by a user within a set time threshold, determining a screen block where the tapping position is located and a gradient value corresponding to the tapping operation.

[0132] It is understandable that the current triggering of the knuckle screenshot function is usually to tap the same position of the touch screen multiple times, for example, twice, within a certain period of time, for example, 1 second. Therefore, the above N is an integer greater than 1. In other words, when the tablet device receives N tapping operations of the user on any same area of ​​the touch screen within the set time threshold, it will respond to the user's tapping operation on the touch screen, and then determine the screen block where the tapping position is located.

[0133] It should be noted that the above-mentioned screen blocks can be obtained by dividing the touch screen according to business needs, or by dividing the touch screen according to product models, and this application does not impose any restrictions on this.

[0134] In addition, it should be noted that, in some implementations, the multiple screen blocks divided into the touch screen may be uniform blocks or non-uniform blocks, and the present application does not impose any limitation on this.

[0135] Regarding the manner in which, after detecting a user's tapping operation on the touch screen, the tablet device responds to the user's tapping operation and determines the screen block where the tapping position is located, in some implementations, this can be achieved by first determining the coordinates of the tapping position relative to the touch screen, and then determining the screen block where the tapping position is located based on the determined coordinates of the tapping position relative to the touch screen.

[0136] It is understandable that touch events / tap events are usually sensed by the touch sensor (or capacitive sensor) in the touch screen. Therefore, when determining the coordinates of the tap position relative to the touch screen, it can be determined by the point reporting data collected by the touch sensor when the user taps the above tap position.

[0137] The so-called touch report refers to the coordinates obtained at the tapping position reported by the touch panel integrated circuit (TP IC) of the touch screen to the application processor (AP) in the tablet device through the integrated circuit bus (I2C) or the serial peripheral interface (SPI). Since the tapping operation may correspond to more than one coordinate of the tapping position on the touch screen, the touch sensor will collect multiple coordinates. In this embodiment, the collected multiple report points are referred to as report point data.

[0138] Accordingly, after obtaining the reporting point data, the coordinates of the tapping position corresponding to the current tapping operation relative to the touch screen can be determined according to the existing standard for determining the specific coordinates of the tapping position based on the reporting point data collected by the touch sensor. For example, according to the first capacitance value of the tapping position collected by the touch sensor in the reporting point data within the first time threshold before the tapping, the second capacitance value at the time of the tapping, and the third capacitance value within the second time threshold after the tapping, the variation trend of the capacitance value is determined; according to the variation trend of the capacitance value, the coordinates of the tapping position in the coordinate system are determined.

[0139] It is understandable that in some implementations, the variation trend of the capacitance value may be set to be determined based on the capacitance values ​​collected at multiple sampling points, such as the capacitance values ​​collected at a total of 126 sampling points at the tapping moment, before the tapping moment, and after the tapping moment.

[0140] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0141] In addition, it should be noted that in order to make the coordinates of two consecutive tap positions relative to the same coordinate system, so as to facilitate the feasibility of subsequent calculations, this embodiment selects the coordinate system constructed with the touch screen as the reference standard as an example to determine the coordinates of the tap position, that is, the coordinates of the tap position relative to the touch screen determined according to the reporting point data, which is essentially to determine the coordinates of the tap position in the constructed coordinate system.

[0142] For example, regarding the coordinate system constructed with the touch screen as the reference standard, it can be agreed that the coordinate origin is located at the lower left corner of the touch screen, the X axis points horizontally to the right, the Y axis points vertically to the top, the Z axis points to the front of the touch screen, and the coordinate behind the touch screen is the negative Z axis. That is, with the lower left corner of the touch screen as the coordinate origin, the X axis is set to point horizontally to the right, the Y axis is set to point vertically to the top, and the Z axis is set to point to the front of the touch screen, so that a coordinate system relative to the touch screen can be obtained.

[0143] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0144] In addition, the gradient value corresponding to the tapping operation determined in this embodiment is specifically used to indicate the data change amount between multiple frames of acceleration data (ACC data), or the oscillation characteristics. Therefore, the gradient value corresponding to the tapping operation is specifically determined based on the acceleration data collected by the acceleration sensor when the user taps the tapping position.

[0145] It is understandable that since the gradient value is used to indicate the data change amount, or oscillation characteristics, between multiple frames of acceleration data (ACC data), in some implementations, the maximum and minimum values ​​of the signals on the X-axis, Y-axis, and Z-axis of an acceleration sensor, such as a three-axis acceleration sensor, can be calculated, and the signal oscillation amplitude vector is calculated based on the maximum and minimum values ​​of the signals on the three axes to obtain the gradient value corresponding to the tapping operation.

[0146] For example, in some other implementations, the gradient value corresponding to the tapping operation can also be determined according to current touch control technology and software algorithms. For specific implementations, please refer to relevant standards and will not be described in detail here.

[0147] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0148] S102, determining a relative distance between a screen block where a tapping position is located and a screen block where an acceleration sensor is located.

[0149] Based on the above description of the touch screen division, it can be known that no matter which division method is used, after the division method and the number of divisions required are determined, the screen block where the acceleration sensor in the terminal device is located is known. Therefore, when responding to the user's tapping operation on the touch screen, the information of the screen block where the acceleration sensor is located can be directly obtained.

[0150] Exemplarily, in some implementations, the information of the screen block where the acceleration sensor is located may be pre-recorded in an internal memory, for example, so that the information can be directly accessed and read from the internal memory when needed.

[0151] Exemplarily, in some implementations, the relative distance between the two screen blocks can be determined based on the coordinates of the center points of the two screen blocks. Taking the case where the touch screen is divided into multiple uniform rectangular blocks as an example, after determining the screen block where the tapping position is located, first determine the coordinates of the center point of the screen block based on the coordinates of the four vertices of the screen block. Similarly, after obtaining the screen block where the acceleration sensor is located, first determine the coordinates of the center point of the screen block based on the coordinates of the four vertices of the screen block. Then, based on the distance formula between two points, the relative distance between the two screen blocks is determined according to the coordinates of the two determined center points.

[0152] Exemplarily, in other implementations, the relative distance between the screen block where the tapping position is located and the screen block where the acceleration sensor is located may also be determined based on the coordinates of the tapping position and the coordinates of the acceleration sensor.

[0153] In addition, it should be noted that no matter which two positions' coordinate information is used to determine the relative distance between the screen block where the tapping position is located and the screen block where the acceleration sensor is located, since the tapping operation will not cause a position change on the Z-axis, when determining the relative distance between the two screen blocks based on the distance formula between the two points, there is no need to consider the coordinate information of the Z-axis, and only the coordinate information of the X-axis and Y-axis is required.

[0154] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0155] S103, determining the gradient threshold of the screen block where the tapping position is located according to the gradient threshold of the screen block where the acceleration sensor is located, the relative distance, the distance coefficient corresponding to the relative distance, and the constant parameter corresponding to the screen block where the tapping position is located.

[0156] For example, in some implementations, the gradient threshold value of the screen block where the accelerometer is located (hereinafter referred to as Threshold_Grandient) can be pre-set according to factors such as the device model, the accelerometer model, and the chip model used by the device, for example, to 300. The distance coefficient corresponding to the relative distance and the constant parameter corresponding to the screen block where the tapping position is located can be found through the algorithm library, or in the distance coefficient table and constant parameter table constructed by testing data obtained from different devices.

[0157] Exemplarily, regarding the construction of a distance coefficient table that records distance coefficients corresponding to different distances, for example, after determining the relative distance between each screen block and the screen block where the acceleration sensor is located, the acceleration sensor is used as the center and mapped outward based on the distance relationship function to be set for each relative distance.

[0158] Exemplarily, regarding the construction of a constant parameter table that records constant parameters corresponding to screen blocks at different tapping positions, for example, it can be set for each screen block after considering the camera, especially the protruding rear camera.

[0159] Exemplarily, when the camera is considered, the constant parameters corresponding to each screen block may be set, for example, in the following manner:

[0160] First, determine the coordinates of the camera relative to the touch screen.

[0161] Then, the folding line of the touch screen is determined according to the coordinates of the camera relative to the touch screen.

[0162] It should be noted that the above-mentioned fold line runs through some screen blocks of the touch screen, and the coordinates of the camera relative to the touch screen are located on the fold line.

[0163] Finally, according to the coordinates of the camera relative to the touch screen and the fold line, corresponding constant parameters are set for each screen block.

[0164] Exemplarily, in some implementations, different constant parameters may be set for each screen block that is passed through the fold line. For example, different constant parameters may be set based on the distance from the camera.

[0165] Exemplarily, in other implementations, different constant parameters may be set for the screen block where the camera is located and the screen block including the four top corners of the touch screen.

[0166] Exemplarily, in some other implementations, different constant parameters may be set for the screen blocks on the upper side of the fold line and the screen blocks on the lower side of the fold line.

[0167] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0168] S104, when the gradient value corresponding to the tapping operation is greater than the gradient threshold of the screen block where the tapping position is located, triggering a screenshot.

[0169] It can be understood that when the gradient value corresponding to the tapping operation is greater than the gradient threshold value of the screen block where the tapping position is located, the tablet device will generate a screenshot instruction in response to the operation, and then call the corresponding process according to the screenshot instruction. The process will capture the screen currently displayed by the tablet device, and save the captured content as a picture to complete the screenshot operation.

[0170] In order to better understand the technical details of this embodiment, the touch screen of a tablet device is divided into 16 evenly spaced screen blocks as an example. Fig. 9 and Fig.10 Provide specific instructions.

[0171] See also Fig. 9 For example, the touch screen 20a of the tablet 20 has a resolution of 2000*1200, and the touch screen 20a is divided into 16 (4*4) screen blocks. The positions of these 16 screen blocks in the coordinate system with the lower left corner as the origin, the X axis pointing to the right, the Y axis vertically upward, and the Z axis pointing to the top of the screen (not shown in the figure) are as follows: Fig. 9 As shown, the sequential numbers are respectively represented as screen block 0 to screen block 15.

[0172] In order to achieve different gradient thresholds corresponding to different screen blocks, a distance coefficient table can be constructed in the manner of setting the distance coefficient corresponding to the relative distance between any screen block and the screen block where the acceleration sensor is located as given above. At the same time, considering the camera factor, different constant parameters can be set for each screen block, that is, a constant parameter table is constructed.

[0173] For the sake of convenience, the camera (the rear camera protruding from the back of the tablet 20) 20a-1 is located at Fig. 9 The acceleration sensor 20a-2 is Fig. 9 Taking the position shown (located at screen block 8) as an example, a distance coefficient table and a constant parameter table are given.

[0174] Table 1 Distance coefficient table

[0175]

[0176]

[0177] Table 2 Constant parameter table

[0178] Screen segmentation Constant parameters corresponding to screen blocks Screen segmentation Constant parameters corresponding to screen blocks <![CDATA[SB0]]> <![CDATA[K0]]> <![CDATA[SB1]]> <![CDATA[K1]]> <![CDATA[SB2]]> <![CDATA[K2]]> <![CDATA[SB3]]> <![CDATA[K3]]> <![CDATA[SB4]]> <![CDATA[K4]]> <![CDATA[SB5]]> <![CDATA[K5]]> <![CDATA[SB6]]> <![CDATA[K6]]> <![CDATA[SB7]]> <![CDATA[K7]]> <![CDATA[SB8]]> <![CDATA[K8]]> <![CDATA[SB9]]> <![CDATA[K9]]> <![CDATA[SB 10 ]]> <![CDATA[K `10 ]]> <![CDATA[SB 11 ]]> <![CDATA[K 11 ]]> <![CDATA[SB 12 ]]> <![CDATA[K 12 ]]> <![CDATA[SB 13 ]]> <![CDATA[K 13 ]]> <![CDATA[SB 14 ]]> <![CDATA[K 14 ]]> <![CDATA[SB 15 ]]> <![CDATA[K 15 ]]>

[0179] For example, according to business requirements, the distance coefficients corresponding to any two relative distances in Table 1 may be the same or different.

[0180] Accordingly, the constant parameters corresponding to any two screen blocks in Table 2 may be the same or different.

[0181] For example, in practical applications, the distance coefficients recorded in Table 1 and the constant parameters recorded in Table 2 can also be recorded in the form of a queue, for example, Coeff_list is used to represent the queue for recording the distance coefficients, and K_list is used to represent the queue for recording the constant parameters. Then, the content in Table 1 can be converted into Coeff_list and represented as Coeff_list{Coeff 8-0 , Coeff 8-1 , Coeff 8-2 , Coeff 8-3 , Coeff 8-4 , Coeff 8-5 , Coeff 8-6 , Coeff 8-7 , Coeff 8-8 , Coeff 8-9 , Coeff 8-10 , Coeff 8-11 , Coeff 8-12 , Coeff 8-13 , Coeff 8-14 , Coeff 8-15}; The content in Table 2 can be converted into K_list and represented as K_list{K0, K1, K2, K3, K4, K5, K6, K7, K8, K9, K `10 , K 11 , K 12 , K 13 , K 14 , K 15}.

[0182] For example, in the coordinate system constructed according to the touch screen 20a, Fig. 9 As shown, when the user taps the touch screen 20a to trigger the screenshot operation, the probability that the tapping position is located on the left side of the fold line I is relatively high. Therefore, the screen blocks on the left side of the fold line I, such as screen block 0, screen block 1, screen block 2, screen block 4, screen block 5 and screen block 8, have corresponding constant parameters greater than the screen blocks on the right side of the fold line I, such as screen block 7, screen block 10, screen block 11, screen block 13, screen block 14 and screen block 15.

[0183] In addition, different constant parameters may be set for the screen block 3, the screen block 6, the screen block 9 and the screen block 12 through which the fold line I passes.

[0184] Regarding the values ​​of constant parameters set for different screen blocks, for example, it can be K_list{475, 300, 260, 115, 300, 260, 200, 115, 350, 130, 165, 230, 150, 125, 245, 340}.

[0185] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0186] After completing the above distance coefficient and constant parameter settings, if the user Fig.10 The position 20a-3 in the touch screen 20a is tapped twice in succession. In response to the tapping operation, the tablet 20 determines the tapping position 20a-3 according to the reporting point data collected by the touch sensor in the touch screen 20a. Fig.10 The coordinates in the coordinate system shown, and then according to the coordinates of the tap position 20a-3 and the coordinate information included in each screen block, it is determined that the tap position 20a-3 is located in the screen block 2. According to the above Table 2, the constant parameter corresponding to the screen block 2 can be determined to be K2.

[0187] Continue to see Fig.10 For example, since the acceleration sensor is located in screen block 8, according to the above method of determining the relative distance between two screen blocks according to the coordinates of the center point of the screen block, the relative distance between screen block 2 and screen block 8 can be determined as D 8-2 According to the above Table 1, the relative distance D can be determined 8-2 The corresponding distance coefficient is Coeff 8-2 .

[0188] When the relative distance is determined as D 8-2 , relative distance D 8-2 The corresponding distance coefficient is Coeff 8-2 , after the constant parameter corresponding to the screen block 2 where the tap position 20a-3 is located is K2, based on the determined three parameters and the gradient threshold value (Threshold_Grandient) set for the screen block where the acceleration sensor is located, the gradient threshold value (hereinafter expressed as: Current_Grandient) corresponding to the screen block 2 where the tap position 20a-3 is located can be determined.

[0189] The method of determining Current_Grandient based on the above parameters can be expressed by the following formula:

[0190] Current_Grandient=Threshold_Grandient*distance*Coeff+K

[0191] Among them, Current_Grandient is the gradient threshold of the screen block where the tap position is located corresponding to each tap operation, such as the gradient threshold of screen block 2 in the above example; Threshold_Grandient is the gradient threshold set for the screen block where the acceleration sensor is located; distance is the relative distance between the screen block where the tap position is located and the screen block where the acceleration sensor is located, such as the relative distance D in the above example. 8-2 ; Coeff is the distance coefficient corresponding to the determined relative distance, for example, the relative distance D in the above example 8-2 The corresponding distance coefficient is Coeff 8-2 ; K is a constant parameter corresponding to the screen block where the tap position is located. For example, in the above example, the constant parameter corresponding to the screen block 2 where the tap position 20a-3 is located is K2.

[0192] Next, after calculating the gradient threshold Current_Grandien corresponding to the screen block where the tap position is located, for example, the screen block 2 where the tap position 20a-3 is located, according to the above formula, compare Current_Grandien with the gradient value corresponding to the current tap operation. If the gradient value corresponding to the current tap operation is greater than Current_Grandien, it is determined that the currently recognized tap operation triggers the screenshot function. In this case, a screenshot instruction will be generated, and the corresponding process will be called to take a screenshot according to the screenshot instruction.

[0193] Correspondingly, if the gradient value corresponding to this tapping operation is not greater than Current_Grandien, it is determined that the currently recognized tapping operation does not trigger the screenshot function, and may be an accidental touch by the user. In this case, no screenshot instruction will be generated, that is, the screenshot function will not be triggered.

[0194] It should be understood that the above description is only an example listed for a better understanding of the technical solution of this embodiment, and is not the only limitation to this embodiment. In practical applications, it can also be stipulated that when the gradient value corresponding to this tapping operation is not less than Current_Grandien, that is, when it is greater than or equal to Current_Grandien, the currently recognized tapping operation is considered to trigger the screenshot function.

[0195] Therefore, the screenshot method provided in this embodiment divides the touch screen into multiple screen blocks with relatively small areas, and determines the gradient threshold value corresponding to the screen block where the tap position is located by determining the constant parameters corresponding to the screen block where the tap position is located, the gradient threshold value of the screen block where the acceleration sensor is located, and the relative distance between the two screen blocks and the distance coefficient corresponding to the relative distance, so that different tap positions can correspond to different gradient threshold values, and thus can more accurately identify whether the tapping is to trigger a screenshot operation, thereby greatly improving the recognition rate of the screenshot operation.

[0196] For example, see Fig.11 In some other embodiments, the specific implementation steps of the screenshot solution provided by the present application include:

[0197] S201, when N tapping operations are received from the user on any same area of ​​the touch screen within a set time threshold, the touch sensor in the touch screen collects the point data when the user taps the tapping position, and the acceleration sensor collects the acceleration data when the user taps the tapping position.

[0198] For specific implementation details of step S201, please refer to Figure 8 The textual description of the illustrated embodiment will not be repeated here.

[0199] S202: predicting the confidence value of the tapping operation triggering the screenshot based on the reporting point data and the acceleration data.

[0200] Exemplarily, in some implementations, the reporting point data and acceleration data can be used as input parameters and input into a pre-trained neural network model, which will perform recognition processing to predict the confidence value of the tapping operation triggering the screenshot.

[0201] Accordingly, if the confidence value is greater than the set confidence threshold, such as 80, step S203 is executed; otherwise, it is considered that the tapping operation does not trigger the screenshot function, that is, there is no need to perform subsequent steps S203 to S209, and the processing flow of the screenshot method provided in this embodiment is directly exited.

[0202] It is understandable that the neural network model mentioned above can be obtained by, for example, training data based on the knuckle screenshot function triggered by various large-screen devices (tablets, smart screens, touch-screen PCs, etc.) currently popular on the market. For the specific method of training the neural network model, please refer to the existing standards and will not be repeated here.

[0203] In addition, in order to further reduce the misjudgment rate and thus improve the recognition rate, in some implementations, it can be arranged that before performing the confidence prediction, an operation of determining whether the reporting point data and the acceleration data are valid is performed.

[0204] Exemplarily, in other implementations, the operation of determining whether the reporting point data and acceleration data are valid may also be performed after the confidence prediction is performed, specifically, before the predicted confidence value is greater than a set confidence threshold.

[0205] Regarding the method of judging whether the reporting point data and acceleration data are valid, for example, after monitoring the user's first tap on a certain area of ​​the touch screen, it can be judged whether the acceleration sensor senses an acceleration vector change event exceeding a preset value, and whether the touch sensor senses a valid touch event at the same time.

[0206] Accordingly, if the acceleration sensor senses an acceleration vector change event exceeding a preset value, and the touch sensor senses a valid touch event at the same time, the timer is started. If the user taps the same area of ​​the touch screen for the second time within a certain period of time, such as within 1 second, it is further determined whether the acceleration sensor senses an acceleration vector change event exceeding a preset value, and whether the touch sensor senses a valid touch event at the same time.

[0207] Accordingly, if the acceleration sensor senses an acceleration vector change event exceeding a preset value, and the touch sensor senses a valid touch event at the same time, it is determined whether the effective distance of the touch events sensed by the touch sensor in the touch screen during the two previous and subsequent tapping operations is less than a preset value.

[0208] Correspondingly, if it is less than, it is determined that the reporting point data and acceleration data are valid.

[0209] On the contrary, if any of the above judgments is abnormal, it can be considered that the tap is a false touch and there is no need to trigger the screenshot function.

[0210] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0211] S203: When the confidence value is greater than a set confidence threshold, construct a coordinate system relative to the touch screen.

[0212] S204, determining the coordinates of the striking position in the coordinate system according to the reporting point data.

[0213] S205: Determine the screen block where the tapping position is located according to the coordinates of the tapping position relative to the touch screen.

[0214] S206: Determine a gradient value corresponding to the tapping operation according to the acceleration data.

[0215] S207: Determine the relative distance between the screen block where the tapping position is located and the screen block where the acceleration sensor is located.

[0216] S208, determining the gradient threshold of the screen block where the tap position is located according to the gradient threshold of the screen block where the acceleration sensor is located, the relative distance, the distance coefficient corresponding to the relative distance, and the constant parameter corresponding to the screen block where the tap position is located.

[0217] S209 , when the gradient value corresponding to the tapping operation is greater than the gradient threshold of the screen block where the tapping position is located, triggering a screenshot.

[0218] For details on the implementation of steps S203 to S209, please refer to Figure 8 The textual description of the illustrated embodiment will not be repeated here.

[0219] Therefore, the screenshot method provided in this embodiment executes the process of the screenshot method provided in this application only when the confidence value is greater than the set confidence threshold, thereby further improving the recognition rate of the screenshot operation.

[0220] For example, see Fig.12 In some other embodiments, the specific implementation steps of the screenshot solution provided by the present application include:

[0221] S301, when receiving N tapping operations from the user on any same area of ​​the touch screen within a set time threshold, determining the screen block where the tapping position is located and the gradient value corresponding to each acceleration sensor when the tapping operation acts on the tapping position.

[0222] S302: Determine the relative distance between the screen block where the tapping position is located and the screen block where each acceleration sensor is located.

[0223] It is not difficult to find that this embodiment and Figure 8 The difference between the embodiments shown is that the number of acceleration sensors in the terminal device in this embodiment is greater than 1, so it is necessary to obtain the screen block where each acceleration sensor is located, and the relative distance between the screen block where the tap position is located and the screen block where each acceleration sensor is located. For specific implementation details on obtaining the screen block where each acceleration sensor is located, and the relative distance between the screen block where the tap position is located and the screen block where each acceleration sensor is located, please refer to Figure 8 The text part of the illustrated embodiment will not be repeated here.

[0224] S303: Select the shortest relative distance from the determined multiple relative distances.

[0225] For a better understanding, take the example of a tablet device with two accelerometers. Fig.13 Provide specific instructions.

[0226] See also Fig.13 For example, the tablet 20 may be a foldable device with the central axis 20a-5 as the axis, and its touch screen 20a is divided into 16 uniform rectangular screen blocks. Fig.13 A rear camera is provided at the position 20a-1, an acceleration sensor is provided at the position 20a-2, and another acceleration sensor is provided at the position of the central axis 20a-4. The constant parameters corresponding to each screen block may be as shown in Table 2 in the above embodiment, and the distance coefficient corresponding to the relative distance between the screen block 8 where the acceleration sensor at the position 20a-2 is located and any screen block may be as shown in Table 1 in the above embodiment.

[0227] Exemplarily, based on the same method, the distance coefficient corresponding to the relative distance between the screen block 11 where the acceleration sensor at the position 20a-4 is located and any screen block can be shown in Table 3 below.

[0228] Table 3 Distance coefficient table

[0229] Relative distance Distance coefficient corresponding to relative distance Relative distance Distance coefficient corresponding to relative distance <![CDATA[D 11-0 ]]> <![CDATA[Coeff 11-0 ]]> <![CDATA[D 11-1 ]]> <![CDATA[Coeff 11-1 ]]> <![CDATA[D 11-2 ]]> <![CDATA[Coeff 11-2 ]]> <![CDATA[D 11-3 ]]> <![CDATA[Coeff 11-3 ]]> <![CDATA[D 11-4 ]]> <![CDATA[Coeff 11-4 ]]> <![CDATA[D 11-5 ]]> <![CDATA[Coeff 11-5 ]]> <![CDATA[D 11-6 ]]> <![CDATA[Coeff 11-6 ]]> <![CDATA[D 11-7 ]]> <![CDATA[Coeff 11-7 ]]> <![CDATA[D 11-8 ]]> <![CDATA[Coeff 11-8 ]]> <![CDATA[D 11-9 ]]> <![CDATA[Coeff 11-9 ]]> <![CDATA[D 11-10 ]]> <![CDATA[Coeff 11-10 ]]> <![CDATA[D 11-11 ]]> <![CDATA[Coeff 11-11 ]]> <![CDATA[D 11-12 ]]> <![CDATA[Coeff 11-12 ]]> <![CDATA[D 11-13 ]]> <![CDATA[Coeff 11-13 ]]> <![CDATA[D 11-14 ]]> <![CDATA[Coeff 11-14 ]]> <![CDATA[D 11-15 ]]> <![CDATA[Coeff 11-15 ]]>

[0230] Continue to see Fig.13 , for example, when the user taps Fig.13 After the position 20a-3 in the screen is touched, the screen block where the tapping position 20a-3 is located is determined as screen block 2 through the reporting data collected by the touch sensor, the acceleration data collected by the acceleration sensor at the position 20a-2 is determined to be located at screen block 2, and the acceleration data collected by the acceleration sensor at the position 20a-4 is determined to be located at screen block 11. Next, according to the coordinates of the center point of screen block 2 and the coordinates of the center point of screen block 8, the relative distance between screen block 2 and screen block 8 is determined to be D1 (D in Table 1). 8-2 ), according to the coordinates of the center point of screen block 2 and the coordinates of the center point of screen block 11, the relative distance between screen block 2 and screen block 11 is determined as D2 (D in Table 3 11-2 ). Then, by comparing the sizes of D1 and D2, when D2 is smaller than D1, D2 is determined as the relative distance used to calculate the gradient threshold of the screen block 2 where the tap position 20a-3 is located, and the distance coefficient corresponding to D2 is Coeff in Table 3. 11-2On the contrary, if D1 is less than D2, D1 is determined as the relative distance used to calculate the gradient threshold of the screen block 2 where the tap position 20a-3 is located, and the distance coefficient corresponding to D1 is Coeff in Table 1. 8-2 In this way, it is possible to more accurately identify whether the current tapping operation needs to trigger the knuckle screenshot function.

[0231] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0232] S304, determining the gradient threshold value of the screen block where the tap position is located according to the gradient threshold value of the screen block where the acceleration sensor is located corresponding to the shortest relative distance, the shortest relative distance, the distance coefficient corresponding to the shortest relative distance, and the constant parameter corresponding to the screen block where the tap position is located.

[0233] S305 , when the gradient value corresponding to the acceleration sensor corresponding to the shortest relative distance is greater than the gradient threshold of the screen block where the tapping position is located, triggering a screenshot.

[0234] In this way, it is ensured that all judgments are based on the relevant parameters corresponding to the shortest relative distance, thereby ensuring the accuracy of the results.

[0235] For details on the implementation of step S304 and step S305, please refer to Figure 8 The textual description of the illustrated embodiment will not be repeated here.

[0236] In addition, it should be understood that in practical applications, this embodiment can also be used in Fig.11 Improvements are made based on the illustrated embodiments, and this application does not limit this.

[0237] Therefore, the screenshot method provided in this embodiment, when there are multiple acceleration sensors in the terminal device, gives priority to the shortest relative distance, as well as the distance coefficient corresponding to the shortest relative distance and the gradient threshold value of the screen block where the acceleration sensor is located to calculate the gradient threshold value of the screen block where the tapping position is located, thereby ensuring that the calculated gradient threshold value is more accurate, thereby further improving the recognition rate of the screenshot operation.

[0238] It should be understood that the above-mentioned embodiments are only listed for a better understanding of the screenshot solution provided by the present application and are not intended to be the sole limitation on the technical solution of the present application.

[0239] In addition, it is understood that in order to implement the above functions, the terminal device includes hardware and / or software modules corresponding to the execution of each function. In combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of this application.

[0240] In addition, it should be noted that the screenshot methods provided in the above embodiments implemented by the terminal device in the actual application scenario can also be executed by a chip system included in the terminal device, wherein the chip system may include a processor. The chip system can be coupled to the memory so that the chip system calls the computer program stored in the memory when it is running to implement the steps executed by the above terminal device. The processor in the chip system can be an application processor or a processor other than an application processor.

[0241] In addition, an embodiment of the present application also provides a computer-readable storage medium, which stores computer instructions. When the computer instructions are executed on a terminal device, the terminal device executes the above-mentioned related method steps to implement the screenshot method in the above-mentioned embodiment.

[0242] In addition, an embodiment of the present application also provides a computer program product. When the computer program product is run on a terminal device, the terminal device executes the above-mentioned related steps to implement the screenshot method in the above-mentioned embodiment.

[0243] In addition, an embodiment of the present application also provides a chip (which may also be a component or module), which may include one or more processing circuits and one or more transceiver pins; wherein the transceiver pins and the processing circuit communicate with each other through an internal connection path, and the processing circuit executes the above-mentioned related method steps to implement the screenshot method in the above-mentioned embodiment, so as to control the receiving pin to receive the signal, so as to control the sending pin to send the signal.

[0244] In addition, it can be seen from the above description that the terminal device, computer-readable storage medium, computer program product or chip provided in the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0245] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A screenshot method, characterized in that: Applied to an electronic device, the electronic device includes a touch screen, and the method includes: In the case where the electronic device is a large-screen device, in response to a tapping operation of the user on the touch screen, determining a screen block corresponding to the tapping operation and a gradient value corresponding to the tapping operation, wherein the gradient value is used to indicate a data change amount between multiple frames of acceleration data; Determining a relative distance between a screen block corresponding to the tapping operation and a screen block corresponding to the acceleration sensor; Determine the gradient threshold of the screen block corresponding to the tapping operation according to the gradient threshold of the screen block corresponding to the acceleration sensor, the relative distance, the distance coefficient corresponding to the relative distance, and the constant parameter corresponding to the screen block corresponding to the tapping operation; When the gradient value corresponding to the tapping operation is greater than the gradient threshold of the screen block corresponding to the tapping operation, triggering a screenshot; Wherein, in the case where the electronic device is a small-screen device, in response to a tapping operation of the user on the touch screen, a gradient value corresponding to the tapping operation is determined; When the gradient value corresponding to the tapping operation is greater than a preset gradient threshold, a screenshot is triggered, and the preset gradient threshold corresponding to each area of ​​the touch screen is the same.

2. The method according to claim 1, characterized in that The gradient threshold of the screen block corresponding to the acceleration sensor is determined according to the data variation between multiple frames of acceleration data collected by the acceleration sensor.

3. The method according to claim 1 or 2, characterized in that: The constant parameters corresponding to each screen block preset in the electronic device are determined according to the coordinates of the camera of the electronic device relative to the touch screen and the fold line of the touch screen; The fold line is determined according to the coordinates of the camera relative to the touch screen, the coordinates of the camera relative to the touch screen are located on the fold line, and the fold line runs through part of the screen blocks of the touch screen.

4. The method according to any one of claims 1 to 3, characterized in that: The electronic device is preset with the gradient threshold of the screen block corresponding to the acceleration sensor, the relative distance between the acceleration sensor and each screen block of the touch screen, the distance coefficient corresponding to each relative distance, and the constant parameter corresponding to each screen block.

5. The method according to any one of claims 1 to 4, characterized in that: The step of determining the gradient threshold value of the screen block corresponding to the tapping operation according to the gradient threshold value of the screen block corresponding to the acceleration sensor, the relative distance, the distance coefficient corresponding to the relative distance, and the constant parameter corresponding to the screen block corresponding to the tapping operation comprises: Performing a multiplication associative law operation on the gradient threshold value of the screen block corresponding to the acceleration sensor, the relative distance, and a distance coefficient corresponding to the relative distance; The result obtained by the associative law of multiplication operation is added to the constant parameter corresponding to the screen block corresponding to the tapping operation to obtain the gradient threshold of the screen block corresponding to the tapping operation.

6. The method according to any one of claims 1 to 5, characterized in that: The screen block corresponding to the tapping operation is the screen block where the tapping position is located.

7. The method according to claim 6, characterized in that The determining of the screen segment corresponding to the tapping operation includes: Determining the tapping position, relative to the coordinates of the touch screen; The screen block where the tapping position is located is determined according to the coordinates.

8. The method according to claim 7, characterized in that The determining of the tapping position, relative to the coordinates of the touch screen, includes: Acquire reporting point data collected by a touch sensor in the touch screen when a user taps the tapping position; Constructing a coordinate system relative to the touch screen; The coordinates of the striking position in the coordinate system are determined according to the reporting point data.

9. The method according to claim 8, characterized in that Determining the coordinates of the striking position in the coordinate system according to the reporting point data includes: According to the first capacitance value, the second capacitance value and the third capacitance value collected by the touch sensor in the reporting data, determining the change trend of the capacitance value; wherein the first capacitance value is the capacitance value collected within a first time threshold, and the first time threshold is a period of time before the tapping position is tapped; the second capacitance value is the capacitance value collected when the tapping position is tapped; the third capacitance value is the capacitance value collected within a second time threshold, and the second time threshold is a period of time after the tapping position is tapped; According to the variation trend of the capacitance value, the coordinates of the tapping position in the coordinate system are determined.

10. The method according to claim 8, characterized in that After obtaining the reporting point data, the method further includes: Collecting acceleration data when the user taps the tapping position through the acceleration sensor; Predicting, based on the reporting point data and the acceleration data, a confidence value of the tapping operation triggering a screenshot; In a case where the confidence value is greater than a set confidence threshold, the step of constructing a coordinate system relative to the touch screen is performed.

11. The method according to claim 8, characterized in that The constructing a coordinate system relative to the touch screen includes: Taking the lower left corner of the touch screen as the coordinate origin; The X axis is set to point horizontally to the right, the Y axis is set to point vertically to the top, and the Z axis is set to point to the front of the touch screen to obtain a coordinate system relative to the touch screen.

12. The method according to claim 6, characterized in that Determining a gradient value corresponding to the tapping operation includes: Collecting acceleration data when the user taps the tapping position by the acceleration sensor; A gradient value corresponding to the tapping operation is determined according to the acceleration data.

13. The method according to claim 6, characterized in that The number of the acceleration sensors is greater than 1; The determining the gradient value corresponding to the tapping operation includes: Acquire acceleration data collected by each acceleration sensor when the user taps the tapping position; According to the acceleration data collected by each acceleration sensor, a gradient value corresponding to each acceleration sensor when the tapping operation acts on the tapping position is determined.

14. The method according to claim 13, characterized in that The determining the relative distance between the screen block corresponding to the tapping operation and the screen block corresponding to the acceleration sensor includes: The relative distance between the screen block where the tapping position is located and the screen block where each acceleration sensor is located is determined.

15. The method according to claim 14, characterized in that The step of determining the gradient threshold value of the screen block corresponding to the tapping operation according to the gradient threshold value of the screen block corresponding to the acceleration sensor, the relative distance, the distance coefficient corresponding to the relative distance, and the constant parameter corresponding to the screen block corresponding to the tapping operation comprises: Selecting the shortest relative distance from the determined multiple relative distances; The gradient threshold value of the screen block corresponding to the tapping operation is determined based on the gradient threshold value of the screen block corresponding to the acceleration sensor corresponding to the shortest relative distance, the shortest relative distance, the distance coefficient corresponding to the shortest relative distance, and the constant parameter corresponding to the screen block corresponding to the tapping operation.

16. The method according to claim 15, characterized in that When the gradient value corresponding to the tapping operation is greater than the gradient threshold of the screen block corresponding to the tapping operation, triggering a screenshot, including: When the gradient value corresponding to the acceleration sensor corresponding to the shortest relative distance is greater than the gradient threshold of the screen block corresponding to the tapping operation, a screenshot is triggered.

17. The method according to claim 6, characterized in that The step of determining, in response to a tapping operation of a user on a touch screen, a screen segment corresponding to the tapping operation and a gradient value corresponding to the tapping operation comprises: When N tapping operations are received from the user on any same area of ​​the touch screen within a set time threshold, the screen block corresponding to the tapping operations and the gradient value corresponding to the tapping operations are determined, where N is an integer greater than 1.

18. The method according to any one of claims 1 to 4, characterized in that: The touch screen includes multiple areas, and one or more areas belong to one screen block.

19. An electronic device, characterized in that: The electronic device includes: a memory and a processor, the memory and the processor are coupled; the memory stores program instructions, and when the program instructions are executed by the processor, the electronic device executes the screenshot method as described in any one of claims 1 to 18.

20. A computer-readable storage medium, characterized in that: It comprises a computer program, which, when executed on an electronic device, enables the electronic device to execute the screenshot method as claimed in any one of claims 1 to 18.

Citation Information

Patent Citations

  • Method for triggering screen capturing by tapping screen with finger joint

    CN105320436A

  • Method for controlling screen capture with rolling ball, and related intelligent equipment

    CN106569686A

  • Method and device for correcting reporting point of touch screen and electronic equipment

    CN113867562A