Touch screen setting method and device, electronic equipment and computer readable medium

Abstract

The invention discloses a touch screen setting method and device, electronic equipment and a computer readable medium, and relates to the technical field of touch screens, and the method comprises the steps that under the condition that the electronic equipment displays a target application program through a touch screen, a target image corresponding to a target interface of the target application program is acquired; identifying a plurality of operation areas in the target image; determining a to-be-processed area from each operation area; and setting a preset parameter corresponding to each to-be-processed area. Therefore, under the condition that the target application program runs, each operation area of the interface is determined by analyzing the image corresponding to the interface currently displayed by the application program, so that the preset parameters can be independently set for each operation area, and global setting of the parameters corresponding to the whole interface is avoided.

Description

Technical Field

[0001] The present application relates to the field of touch screen technology, and more specifically, to a touch screen setting method, device, electronic device and computer-readable medium. Background Art

[0002] With the development of electronic technology, the functions of electronic devices are becoming more and more abundant. For example, electronic devices are equipped with touch screens. Users can control electronic devices by performing touch events on the touch screen, including press (down) events, lift (up) events, and slide (move) events.

[0003] At present, some applications can allow users to adjust the touch parameters of the touch screen when the application is running, so as to adjust the touch response in the interface of the application. However, the current adjustment method is global adjustment, that is, the touch parameters of the entire interface are adjusted together, which makes the adjustment method unreasonable. Summary of the invention

[0004] The present application proposes a touch screen setting method, device, electronic device and computer-readable medium to improve the above-mentioned defects.

[0005] In a first aspect, an embodiment of the present application provides a touch screen setting method, which is applied to a touch screen of an electronic device, and the method includes: when the electronic device displays a target application through the touch screen, obtaining a target image corresponding to a target interface of the target application; identifying an operation area in the target image; determining an area to be processed based on the operation area; and setting preset parameters corresponding to the area to be processed.

[0006] In a second aspect, an embodiment of the present application further provides a touch screen setting device, which is applied to a touch screen of an electronic device, and the device includes: an acquisition unit, an identification unit, a determination unit, and a setting unit. The acquisition unit is used to acquire a target image corresponding to a target interface of the target application when the electronic device displays the target application through the touch screen. The identification unit is used to identify an operation area in the target image. The determination unit is used to determine a to-be-processed area based on the operation area. The setting unit is used to set preset parameters corresponding to the to-be-processed area.

[0007] In a third aspect, an embodiment of the present application also provides an electronic device, comprising: one or more processors; a memory; one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, and the one or more applications are configured to execute the above method.

[0008] In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium, wherein the readable storage medium stores a program code executable by a processor, and when the program code is executed by the processor, the processor executes the above method.

[0009] The touch screen setting method, device, electronic device and computer-readable medium provided in the present application are applied to the touch screen of the electronic device, and the method comprises: when the electronic device displays the target application through the touch screen, obtaining the target image corresponding to the target interface of the target application; identifying the operation area in the target image; determining the area to be processed based on the operation area; and setting the preset parameters corresponding to the area to be processed. Therefore, when the target application is running, the operation area of ​​the interface is determined by analyzing the image corresponding to the interface currently displayed by the application, so that parameters can be set independently for the operation area, and the global setting of parameters corresponding to the entire interface is avoided.

[0010] Other features and advantages of the embodiments of the present application will be described in the subsequent description, and partly become apparent from the description, or can be understood by practicing the embodiments of the present application. The purposes and other advantages of the embodiments of the present application can be realized and obtained by the structures specifically pointed out in the written description, claims, and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0012] Figure 1 A method flow chart of a touch screen setting method provided by an embodiment of the present application is shown;

[0013] Figure 2 A schematic diagram showing an operation area provided by an embodiment of the present application;

[0014] Figure 3 A schematic diagram of a selection interface provided by an embodiment of the present application is shown;

[0015] Figure 4 A schematic diagram showing first prompt information provided by an embodiment of the present application is shown;

[0016] Figure 5 A schematic diagram showing a user's selection operation on an operation area provided by an embodiment of the present application;

[0017] Figure 6A schematic diagram showing second prompt information provided by an embodiment of the present application is shown;

[0018] Figure 7 A method flow chart of a touch screen setting method provided by another embodiment of the present application is shown;

[0019] Figure 8 A schematic diagram of a target interface provided by an embodiment of the present application is shown;

[0020] Fig. 9 A schematic diagram showing buttons corresponding to a target interface provided by an embodiment of the present application is shown;

[0021] Fig.10 A schematic diagram of a detection model identifying a key provided by an embodiment of the present application is shown;

[0022] Fig.11 A schematic diagram showing a detection frame of a key recognized by a detection model provided in an embodiment of the present application is shown;

[0023] Fig.12 A schematic diagram showing a key recognized by a detection model provided in an embodiment of the present application is shown;

[0024] Fig.13 A schematic diagram showing a merged operation area provided by an embodiment of the present application;

[0025] Fig.14 A method flow chart of a touch screen setting method provided by another embodiment of the present application is shown;

[0026] Fig.15 A module block diagram of a touch screen setting device provided in an embodiment of the present application is shown;

[0027] Fig.16 A structural block diagram of an electronic device provided in an embodiment of the present application is shown;

[0028] Fig.17 A storage unit for storing or carrying a program code for implementing a touch screen setting method according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0029] In order to make those skilled in the art better understand the present application scheme, the technical scheme in the present application embodiment will be clearly and completely described below in conjunction with the drawings in the present application embodiment. Obviously, the described embodiment is only a part of the present application embodiment, rather than all the embodiments. The components of the present application embodiment usually described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the present application for protection, but merely represents the selected embodiment of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present application.

[0030] It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings. At the same time, in the description of this application, the terms "first", "second", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.

[0031] With the development of electronic technology, electronic devices with touch screens (Touch panel, TP) such as mobile phones and tablet computers have become widely popular, and the development of touch technology has undergone great changes. Various touch scenarios such as games and various touch scenarios have made users more and more demanding on touch. In related technologies, the reporting speed is improved to meet the user's usage needs, but the reporting stability is poor, and the screen displayed to the user on the touch screen has a jitter problem.

[0032] The user controls the electronic device by executing touch events on the touch screen, including press (down) events, lift (up) events, and slide (move) events.

[0033] Usually, applications such as game applications need to set certain operation keys to implement corresponding functions. When the user clicks the touch screen, different function keys will trigger different responses. Common key areas are roughly divided into: click area, slide area, and shake area according to different functions. Different areas have different sensitivities in games. Some require high smoothness, some require low click latency, and some require high precision.

[0034] The inventors found in their research that, currently, some applications allow users to adjust the touch parameters of the touch screen while the application is running, thereby adjusting the touch response within the interface of the application. However, the current adjustment method is global adjustment, that is, the touch parameters of the entire interface are adjusted together, making this adjustment method unreasonable. Taking game applications as an example, most games currently usually provide a touch parameter adjustment interface in the game engine interface, allowing users to adjust the touch and chirality and sensitivity in the game, but because it is a global adjustment, it will cause all controllable areas in the current game interface to have the same touch response parameters, and local adjustment cannot be achieved.

[0035] Therefore, in order to overcome the above defects, the embodiment of the present application provides a touch screen setting method, which determines different operation areas by identifying the interface of the target application program, so that the touch response parameters can be set by area. Figure 1 , Figure 1 A touch screen setting method provided in an embodiment of the present application is shown, which is applied to an electronic device having a touch screen. The method includes: S101 to S104.

[0036] S101: When the electronic device displays a target application via the touch screen, obtaining a target image corresponding to a target interface of the target application.

[0037] Displaying the target application through the touch screen of the electronic device means that the target application is installed in the electronic device, the target application runs in the foreground of the electronic device, and the interface of the target application is displayed on the touch screen of the electronic device. The interface of the target application displayed on the touch screen of the electronic device has a touch area, that is, the user can input a touch gesture through the touch screen when the target application is displayed on the touch screen, and the touch gesture triggers the target application to perform an operation corresponding to the touch gesture.

[0038] As an implementation method, it is possible to determine whether the target application is displayed on the touch screen of the electronic device by image recognition of the content displayed on the touch screen of the electronic device. Exemplarily, the content displayed on the touch screen of the electronic device is obtained at a preset time interval and compared with a reference interface image of the target application obtained in advance. If the similarity between the content displayed on the touch screen and the reference interface image of the target application is greater than a specified threshold, it is determined that the target application is displayed on the touch screen, wherein the reference interface image can be a representative interface image of the target application, for example, an interface image of the home page, or through the historical usage record of the target application, the interface of the target application that is displayed on the touch screen for the longest time when the user runs the target application is counted as a reference interface image.

[0039] As another implementation, the touch screen setting method provided in the embodiment of the present application may be a setting module in an electronic device. When the target application is displayed on the touch screen, the target application will send specified information to the setting module, and the setting module can determine that the target application has been displayed on the touch screen through the specified information.

[0040] It should be noted that the target image corresponding to the target interface of the target application can be obtained by, when it is detected that the electronic device displays the target application through the touch screen, detecting the interface displayed by the target application on the touch screen, and if the interface is the target interface, determining the target image of the target interface, wherein the target interface can be an interface with high requirements for touch operation among the multiple interfaces corresponding to the target application, and can be a pre-selected interface. For example, the interface of a specified type corresponding to the target application can be used as the target interface, and the specified type can be a frequently operated type. The interface of the specified type can be pre-defined by the user or the developer of the target application, and is not limited here. Taking a game application as an example, the target interface can be a game scene interface of the game application. Since the user needs to operate the character in the game scene in the game scene interface, there are high requirements for touch operation, so the touch response for the game scene interface can be optimized. Of course, the target interface can also be the current interface of the target application, which is not limited here.

[0041] The target application may be an application that matches an application in a preset whitelist, and the application in the whitelist may be user-defined or predefined by the developer of the electronic device, and after a user of the electronic device updates the whitelist, the server of the electronic device can synchronize the whitelist to other electronic devices. Usually, the application functions in the whitelist belong to applications that are frequently touched by users, which is not limited here. In an embodiment of the present application, the target application may be a game application.

[0042] S102: Identify an operation area in the target image.

[0043] As an implementation mode, the types of operation areas provided in the target interface of the target application may include a sliding hotspot, a click hotspot, a smooth hotspot, and a shaking hotspot, wherein the user's touch operation mode for the sliding hotspot is a sliding operation, the user's touch operation mode for the click hotspot is a click operation, the user's touch operation mode for the smooth hotspot is a sliding operation, and the user's touch operation mode for the shaking hotspot is a click operation. Among them, although the touch operation modes of the sliding hotspot and the smooth hotspot are the same, the response modes of the two are different.

[0044] For example, Figure 2 As shown, taking the target application as a game application as an example, the target interface of the target application is the game scene interface of the game application, and the user can operate the game character 206 in the game scene interface. The operation area in the interface includes a sliding hot zone 201, a click hot zone 202, a click hot zone 203, a smooth hot zone 205, and a jitter hot zone 204. It can be seen that the sliding hot zone 201, the click hot zone 202, and the click hot zone 203 all correspond to buttons, and the user can input a sliding operation on the buttons in the sliding hot zone 201 to control the game character 206 to move in the game scene. The user can trigger the game character to perform the operation corresponding to the button by clicking the buttons in the click hot zone 202 and the click hot zone 203, for example, releasing a skill. The user can control the content displayed on the game interface to change to the adjacent content of the current content by sliding the smooth hot zone 205. For example, by inputting a sliding operation toward the right side in the smooth hot zone 205, the content displayed on the game interface is changed to the adjacent content on the left side of the current content, which is equivalent to displaying the content of the left field of view of the current field of view in the game interface. The shaking hot zone 204 displays the content of the small map of the current game scene. The user can add and display the marked content on the small map by clicking the shaking hot zone 204, and the added content can be synchronized to the small map of the game scene displayed by the terminal of the character associated with the game character 206 in the scene. Generally, the smooth hot zone 205 is the area in the game interface except the sliding hot zone 201, the click hot zone 202, the click hot zone 203 and the shaking hot zone 204. The smooth hot zone 205 displays the picture of the game scene. Relative to the controls in the game scene, the picture of the game scene can be understood as the background picture, wherein the control refers to the aforementioned buttons and the display frame of the small map.

[0045] It can be seen that both the sliding hotspot 201 and the smooth hotspot 205 respond to the sliding operation input by the user, but the response methods of the two are different. The user's sliding operation on the sliding hotspot 201 usually acts on the buttons in the sliding hotspot 201, and the sliding operation in the sliding hotspot 201 keeps pressing at the end position of the sliding track, that is, the user inputs the sliding operation and keeps pressing the touch screen at the stop sliding position, then the sliding direction of the sliding operation controls the moving direction of the game character 206 in the target interface, and the duration of keeping pressing is used to control the distance that the game character 206 moves in the moving direction. The user's sliding operation in the smooth hotspot 205 is used to determine the sliding direction, and the adjacent content of the current content of the game interface is loaded into the game interface based on the sliding direction. It is usually not necessary to keep pressing the operation at the end of the sliding. In addition, both the click hot zone 203 and the shake hot zone 204 respond to click operations. The difference between the two is that the user's click operation on the click hot zone 203 is usually a touch operation input on the button in the click area 203, while the user's click operation on the shake hot zone 204 is usually a touch operation input on the display content in the shake hot zone 204, wherein the display content may be auxiliary content corresponding to the game scene, for example, it may be the mini-map content of the game scene. When the user clicks on the mini-map content, indication information may be added to the mini-map content, and the indication information may be synchronized to other users in the game scene. Of course, the mini-map content may also be enlarged or reduced.

[0046] That is to say, the content in the operation area of ​​the click hot zone is usually a button, and the display content in the jitter hot zone 204 can be the auxiliary content corresponding to the main display content of the target interface, and changes with the change of the main display content, wherein the main display content can be the background display content of the target interface, and the controls corresponding to the aforementioned sliding hot zone, click hot zone, smooth hot zone and jitter hot zone are usually located on the background layer. The main display content is the core content displayed on the target interface. For example, the main display content is the game scene content, and the auxiliary content displayed by the jitter hot zone 204 can be a picture used to assist the main display content. For example, when the main display content is the game content, the auxiliary content is the small map content corresponding to the game scene content, and the small map content is used to assist in explaining the map corresponding to the main display content and the positions of each operation object of the main display content in the game map.

[0047] As an implementation mode, for a target interface, images in different operation areas of the target interface are usually different, such as Figure 2As shown, the graphics of the buttons or the displayed contents in each area are different from each other. Therefore, by recognizing the images of each area, multiple operation areas in the target image can be determined. Of course, each operation area can also be determined by identifying each button in the target image. The recognition method can refer to the description of the subsequent embodiments. Therefore, due to the differences in the images or buttons of each operation area, multiple operation areas in the target image can be identified by image recognition. Of course, multiple operation areas in the target image can also be determined by pre-defining the position range of each operation area in the target interface. For example, the click area is pre-determined to be the lower right corner of the target interface, so the lower right area in the target image is used as the click area.

[0048] It should be noted that the target image can be a screenshot of the target interface, which includes a screen of at least part of the operating area of ​​the target interface. For example, the target image can be a whole screenshot of the target interface, that is, an image containing the entire target interface. The whole screenshot can be called the display image of the target image. The target image can also be the image of the display image excluding the background image.

[0049] S103: Determine a region to be processed based on the operation region.

[0050] After determining the operation area in the target image, the position area of ​​the touch screen corresponding to the operation area of ​​the target interface currently displayed on the touch screen can be determined, so that when setting preset parameters for the operation area in the subsequent time, the parameters within the position area of ​​the touch screen corresponding to the operation area can be set in a targeted manner.

[0051] It should be noted that the number of the operation area can be one or more. If the number of the operation area is one, the area to be processed is the operation area.

[0052] As an implementation mode, the number of the operation areas is multiple, and the area to be processed may be all areas of the multiple operation areas, or may be a part of the area. If the area to be processed is a part of the multiple operation areas, the method for determining the area to be processed is that the user determines the area to be optimized from the multiple operation areas as the area to be processed, for example, a selection interface may be displayed on the target interface.

[0053] In one example, after the electronic device recognizes multiple operation areas in the target image and then determines multiple operation areas corresponding to the target interface, the selection interface can be displayed in the target interface, such as Figure 3 As shown, the selection interface 301 may be displayed on the target interface in the form of a floating window, such as Figure 3As shown, a selection control of multiple operation areas is displayed in the interface. After the user selects the operation area to be optimized, he clicks the confirmation control. After entering the confirmation instruction, the electronic device completes the operation of determining the area to be processed from each of the operation areas.

[0054] In another example, after the electronic device recognizes multiple operation areas, a first prompt information is selected in the target interface, and the first prompt information is used to instruct the user to select the operation area as the area to be processed. Figure 4 As shown, the electronic device displays a first information pop-up window 401 on the target interface, and displays the first prompt information in the form of a pop-up window. Among them, the method of selecting the operation area can include voice selection and touch selection. If the selection method is voice selection, the electronic device detects the voice command input by the user, and determines the identity of the operation area contained in the voice command. The identity can be the type of the operation area, or the orientation of the operation area. The type of the operation area can include a sliding hot area, a click hot area, a smooth hot area, and a jitter hot area. The orientation of the operation area can be the orientation relationship between the various operation areas, or it can include both the type and orientation relationship, such as Figure 2 In the operation area shown, if the user needs to determine that the area to be optimized is the click hotspot 202 by voice input, the input voice instruction may include “the click hotspot below”.

[0055] In addition, the user can also inform the electronic device of the selected area to be processed by inputting a touch gesture for the operation area to be optimized. The touch gesture can be a click operation or a long press operation. In the embodiment of the present application, taking the long press operation as an example, after the electronic device recognizes multiple operation areas, it can determine the area range and position of the multiple operation areas, and then mark the operation area on the target interface, such as Figure 2-Figure 5 The outlines of the various operating areas shown in FIG. Figure 5 As shown, users are targeting Figure 4After entering the confirmation instruction in the first prompt information shown, the user can enter a long press operation on the area outline of the click hot zone 202. After the duration of the long press operation meets the requirement, the electronic device will use the operation area corresponding to the long press operation as the area to be processed, and then detect whether a long press operation on other operation areas is detected within the specified time length. If detected, the operation area corresponding to the long press operation is also used as the area to be processed, and continue to perform the step of detecting whether a long press operation on other operation areas is detected within the specified time length. Until no long press operation on other operation areas is detected within the specified time length after a to-be-processed area is added or all operation areas are set as to-be-processed areas, the operation of determining the area to be processed from each of the operation areas is ended, that is, the confirmation operation of the area to be processed is completed. That is, when the user is targeting Figure 4 After entering the confirmation instruction in the first prompt information shown, the user can long press the operation areas that need to be processed in turn, and the time interval between the long press operations of each operation area is less than or equal to the specified time length, so that the user can determine the area to be processed from multiple operation areas by long pressing the operation area.

[0056] As an embodiment, after the user selects the area to be processed from multiple operation areas by means of a touch gesture (for example, a long press operation), the electronic device may display a second prompt message, and the second prompt message is used to ask the user whether the area selection is completed, that is, whether the operation of selecting the area to be processed from multiple operation areas is completed. If the user inputs a confirmation instruction based on the second prompt message, the operation area selected by the user is used as the area to be processed. If the user inputs a negative instruction based on the second prompt message, the selection operation of the area to be processed is canceled, and the user can re-trigger the operation of determining the area to be processed from each of the operation areas. Of course, the negative instruction can also trigger the display of the aforementioned selection interface, and in the selection interface, the operation area selected by the user through the touch gesture before the negative instruction is input is marked as selected. The user can know the selected operation area in the selection interface and can modify the selected operation area. Figure 3-Figure 6 For example, after the electronic device identifies multiple operation areas in the target image, it displays on the target interface Figure 4 In the first information pop-up window 401 shown in FIG. 1 , the user clicks the confirmation control in the first information pop-up window 401 to input a confirmation instruction, and then the user selects an operation area from the multiple operation areas through a touch gesture, for example, Figure 5 Then, when the user's selection operation is detected to be completed, Figure 6The second information pop-up window 601 shown in the figure displays the second prompt information. If the user clicks the confirmation control in the second information pop-up window 601 to input the confirmation instruction, the electronic device uses the operation area selected by the user this time as the to-be-processed area. If the user clicks the cancel control in the second information pop-up window 602 to input the cancel instruction, the electronic device displays Figure 3 The selection interface shown in FIG. 1 is a selection interface in which the operation area selected by the user is marked as selected. The user can know through the selection interface that the operation area selected by the user is marked as selected. Figure 5 The operation area selected in the interface shown in the figure can also be reselected to other areas or the selected area can be deselected.

[0057] S104: Setting preset parameters corresponding to the area to be processed.

[0058] It can be understood that the preset parameters of the area to be processed are used to adjust the touch feeling and display effect of the area to be processed. The preset parameters may include touch response parameters and display parameters. The display parameters may include a refresh rate, that is, the refresh rate corresponding to the area to be processed refers to the frequency at which the to-be-processed content to be displayed in the area is refreshed to be displayed in the area. The touch response parameters corresponding to the area to be processed may be touch response parameters of the touch area corresponding to the area to be processed on the touch screen. The touch response parameters serve as the underlying parameters of the touch screen. When there are multiple areas to be processed, each area to be processed corresponds to a touch area of ​​the touch screen. That is to say, the touch response parameters of the touch area corresponding to each area to be processed can be set separately.

[0059] As an implementation method, the touch response parameter may include all parameters that can affect the recognition effect of touch gestures, such as touch sensitivity, touch reporting rate and input response time, which are not limited here. Among them, the touch sensitivity of the touch screen refers to the degree to which the touch screen can sense and respond to the user's touch input. In other words, the possibility that the touch signal input by the user can be recognized as a useful signal is related to the touch threshold corresponding to the useful signal. The lower the threshold, the higher the sensitivity, but the easier it is to touch by mistake. Common touch screens include resistive touch screens and capacitive touch screens. Among them, the resistive touch screen adopts a contact method between two layers of conductive film. When the user touches the screen with a finger or other object, a current is formed between the two layers of conductive film, and the screen determines the touch position according to the change of the current. The capacitive touch screen detects the touch position by sensing the change of the human body charge. Therefore, the touch sensitivity of the touch area can be adjusted by adjusting the touch threshold of the touch area.

[0060] The reporting rate of a touch screen refers to the number of valid reporting data that the touch screen can provide per unit time, which characterizes the response speed of the touch screen to touch events. The higher the reporting rate, the faster the response speed (i.e., the better the hand tracking). The reporting rate can directly affect the response speed of the click operation and the smoothness of the sliding operation, i.e., the hand tracking. Generally, the smoothness of the sliding gesture of a touch screen refers to the touch screen being able to provide smooth, coherent, and non-obvious touch feedback when the user uses his finger to slide on the screen. It is very important for the user experience, because a sliding gesture with high smoothness can make the user feel that the operation is natural, smooth, and more comfortable. The smoothness of the sliding gesture is affected by the reporting rate of the touch screen. By setting the reporting rate, the touch screen provides a higher sampling rate, thereby increasing the smoothness of the sliding gesture.

[0061] It should be noted that, when the reporting rate increases, the collected sliding points can be made smoother. For example, taking uniform sliding as an example, assuming that there are multiple screen refresh operations, if there are 2 reporting points between the first screen refresh operation and the second screen refresh operation, the coordinates of the most recent touch point before the first screen refresh operation are 100, and the coordinates of the most recent touch point before the second screen refresh operation are 200, then it means that the starting position between the first screen refresh operation and the second screen refresh operation is 100, and the end position is 200. Note that the coordinates here omit the coordinates corresponding to another coordinate axis, and it is pre-assumed that the coordinate axis of all sliding points is the same, that is, only one coordinate axis has changed, that is, between the first screen refresh operation and the second screen refresh operation, the touch coordinates range from 100 to 200, and there are 3 reporting points between the second screen refresh operation and the third screen refresh operation, with coordinates from 200 to 350, so the difference between the two coordinates is 50. Then, after increasing the reporting rate, if there are 4 reporting points between the first screen refresh operation and the second screen refresh operation, the coordinates are still 100 to 200, and there are 5 reporting points between the second screen refresh operation and the third screen refresh operation, the coordinates are 200 to 325, and the difference between the two coordinates is only 25. It can be seen that the increase in the reporting rate will make the sliding gesture smoother, and the user's subjective feeling is that the sliding is smoother.

[0062] The input response time of a touch screen refers to the time it takes for the screen to quickly sense the touch input and respond after the user touches the screen. A lower response time can provide faster and more immediate touch feedback, thereby improving the user experience. It should be noted that the aforementioned reporting rate and touch sensitivity can affect the input response time. The input response time is used as a control parameter alone because it can be adjusted in the following ways, including: (1) reducing the number of applications running in the background: closing unnecessary background applications and processes to free up system resources; (2) updating the touch screen driver; (3) reducing animations and special effects. The animations and special effects of certain operating systems or applications may cause the touch screen to respond more slowly.

[0063] How to set the preset parameters of the area to be processed can be based on actual usage requirements. For example, through the setting of the above parameters, the sensitivity of the click hot zone can be set higher, the response frequency of detecting clicks can be higher, the sliding hot zone can be more sensitive during the sliding process, the moving distance can be smoother, etc., which are not limited here.

[0064] See also Figure 7 , Figure 7 A touch screen setting method provided in an embodiment of the present application is shown, which is applied to an electronic device having a touch screen. The method includes: S701 to S706.

[0065] S701: When the electronic device displays a target application via the touch screen, obtain a display image corresponding to a target interface of the target application.

[0066] As an implementation, the display image corresponding to the target interface may refer to the image including the entire target interface. For example, when the target application displays the target interface on the touch screen of the electronic device, the electronic device performs a full screenshot operation on the touch screen, and the image obtained after the screenshot is recorded as the display image. Figure 8 As shown, if the target application is a game application, the target interface is the game scene interface of the game application, and the game scene interface is displayed in full screen and immersively on the touch screen, then the display image corresponding to the target interface is the image corresponding to the game scene interface.

[0067] S702: Extract an image other than the background image in the displayed image as the target image.

[0068] It should be noted that the target interface includes controls and background images. Figure 8 It can be seen that the background of the game scene interface is used to display the game video corresponding to the game scene, that is, the user operates the game character in the game scene, and the image content corresponding to the game scene can be displayed in the background.

[0069] It is understandable that, from the perspective of the layer distribution of the target interface, the background image and controls of the target interface are usually located in different layers. For example, the controls are usually located in the upper layer of the background image. The purpose of the embodiment of the present application is to adjust the touch experience of the user operating the controls. Therefore, the touch area of ​​the controls of the target interface can be adjusted, where the controls may include buttons. Therefore, the image other than the background image in the displayed image can be extracted as the target image. Then, when the target image is subsequently processed, it is not necessary to perform recognition operations on the background image, which reduces power consumption and can also reduce the complexity of the detection model. For example, compared Figure 8 and Fig. 9 It can be seen that for Figure 8 The display image of the target interface shown in the figure is separated into layers to obtain an image containing only controls, that is, Fig. 9 The target image is shown.

[0070] S703: Identify a target control in the target image based on a pre-trained detection model.

[0071] As an implementation method, a detection model can be pre-trained, and the detection model can identify controls in each interface. For example, a sample set can be pre-acquired, the sample set includes images corresponding to each interface, and the controls in the image are annotated. The detection model is trained with the sample set so that it has the ability to identify each control in the image.

[0072] It should be noted that the target control may be at least part of all controls in the target interface. For example, controls whose operation frequency by the user in the target interface is greater than a specified frequency may be selected. Figure 8 Taking the interface shown as an example, the designated buttons can be direction keys for controlling the movement of the game character and designated action buttons for controlling the character to perform actions other than movement. The actions other than movement may include releasing skills and using props, etc. Correspondingly, the designated action buttons may include skill buttons and prop use buttons, etc.

[0073] In addition, in order to increase the rate of model detection, the detection model can be deployed in an electronic device. In order to reduce the power consumption of the electronic device while taking into account the processing speed and memory usage, the detection model can be a lightweight model, such as YOLO-V5. Fig.10 As shown, the implementation method of S703 is to determine multiple detection boxes in the target image based on the pre-trained detection model; and determine the target control corresponding to each detection box. The detection box can be understood as a candidate box given by YOLO.

[0074] YOLO (You On ly Look Once) is a target detection algorithm that implements real-time target detection through a single neural network model. In YOLO, a candidate box (bounding box) refers to a rectangular box used to identify and locate the target object. In the target detection process of YOLO, the input image is first divided into multiple grids, and each grid is responsible for detecting whether the target object exists in the grid. For each grid, multiple candidate boxes are predicted, each of which consists of a bounding box and a corresponding confidence score. The candidate box is usually defined as a bounding box surrounding an object and is represented by the coordinates of its upper left corner and lower right corner. In addition to providing location information, the candidate box also estimates the probability score of containing the target object. The probability score is the confidence, that is, the confidence of the detection box is used to characterize the probability that the target control exists in the detection box. Therefore, the implementation method of determining the target control corresponding to each of the detection boxes may include, based on the confidence of each of the detection boxes, determining a detection box with a confidence greater than a specified threshold from the multiple detection boxes as an alternative detection box, and determining the target control based on the alternative detection box. Among them, the confidence of the detection box is used to characterize the probability that the target control exists in the detection box. The specified threshold can be set based on actual needs. Usually, the detection box with a confidence greater than the specified threshold can be considered to have the target control inside it.

[0075] As mentioned above, by selecting a lightweight model as the detection model, the power consumption and memory occupancy of the detection model can be reduced. Furthermore, the complexity of identifying the image through the detection model can be reduced by reducing the resolution of the target image. That is to say, the implementation method of determining multiple detection frames in the target image based on the pre-trained detection model includes reducing the resolution of the target image to obtain the image to be processed; and determining multiple detection frames in the image to be processed based on the pre-trained detection model. Exemplarily, reducing the resolution of the target image to obtain the image to be processed may be reducing the initial resolution of the target image to 1 / N times the initial resolution, where N is a positive integer. For example, if N is 8 or 16, the resolution of the target image may be reduced to 1 / 8 or 1 / 16 times as the input of the detection model.

[0076] In addition, after the alternative detection box is obtained through the confidence mentioned above, the control in the alternative detection box can be identified to determine the target control corresponding to the alternative detection box. In addition, considering that a control may correspond to multiple alternative boxes, it is necessary to determine a box from multiple alternative boxes corresponding to a control as the detection box corresponding to the target control, so as to detect and obtain the target control based on the determined alternative box. Specifically, the implementation method of determining the target control based on the alternative detection box is to determine non-overlapped alternative detection boxes and overlapped alternative detection boxes from the alternative detection boxes; based on the non-maximum suppression processing algorithm, determine an alternative detection box from multiple overlapping alternative detection boxes as the designated detection box; use the non-overlapped alternative detection boxes and the designated detection box as target detection boxes; and determine the target control corresponding to each of the target detection boxes.

[0077] Among them, in YOLO, non-maximum suppression (NMS) is a technique for filtering out overlapping bounding boxes to obtain the final detection result. The goal of NMS is to select the bounding box that is most likely to be the real object and filter out other bounding boxes with a high degree of overlap. Generally, the non-maximum suppression processing steps in YOLO are: for the input image, the YOLO model predicts multiple bounding boxes and their corresponding confidence scores (confidence score), as well as the categories corresponding to each bounding box; set a confidence threshold, and only retain bounding boxes with confidence scores higher than the threshold. Usually, this threshold is determined according to actual needs and model performance; for multiple candidate detection boxes corresponding to each control, perform the following steps: sort the confidence scores, take the detection box with the highest score as the initial selection box, calculate the overlap between the initial selection box and other remaining bounding boxes, filter the detection boxes with overlap with the initial selection box higher than the preset threshold, and remove them from the candidate box list. For the remaining bounding boxes, repeat the above steps until all the candidate boxes corresponding to the target controls are processed. Finally, the unique detection frame corresponding to each target control after screening is obtained, that is, the target detection frame. By using the non-maximum suppression technology, the YOLO algorithm can effectively reduce redundant detection frames and improve the accuracy and efficiency of the target detection frame. Fig.11 As shown, it shows the detection box corresponding to each control of the target interface finally obtained. It can be seen that each control corresponds to a detection box.

[0078] S704: Determine an operation area corresponding to the target control based on a touch area corresponding to the target image of the target control.

[0079] As an implementation method, the touch area of ​​the target control in the target image means that after the detection frame of the target control is obtained, the position of the target control in the target image can be determined based on the position of the detection frame in the target image, and then the area of ​​the preset range containing the target control is used as the touch area of ​​the target control. It can be understood that the touch area will be larger than the size of the contour area of ​​the corresponding target control, so that when the user operates the control, it can provide greater operational convenience without having to operate very accurately within the contour area of ​​the control. However, if there are multiple target controls, that is, there are multiple operation areas, then there may be several target controls that are close to each other, then the touch areas corresponding to the several target controls may overlap, if the types of the several target controls are the same, then the touch areas of these several target controls can be considered to be merged, because when the types of controls are the same, the requirements for touch response may also be the same, and on the basis of merging, the operational consistency of the entire merged area can be improved.

[0080] Exemplarily, the implementation of S704 may include: determining the type of each target control; integrating the touch areas of at least two target controls that meet the specified conditions into a merged area, and using the touch area of ​​the target control that does not meet the specified conditions as the operation area corresponding to the target control. The merged area is used as the operation area commonly corresponding to at least two target controls that meet the specified conditions, and the specified conditions are that the types of at least two target controls are the same and the touch areas of the at least two target controls meet the merge condition.

[0081] As an implementation, the types of target controls may include a first type, a second type, and a third type, wherein the first type of control is a control triggered based on a click operation, the second type of control is a control triggered based on a slide operation, and the third type of control is an area that can respond to a touch operation and has a content display function. Fig.12 As shown, the direction button 1201 is a first type of control, the designated action button 1202a, designated action button 1202b, designated action button 1202c, designated action button 1202d, designated action button 1202e, designated action button 1202f, designated action button 1202g and designated action button 1202h are first type of controls, and the small map control 1203 is a third type of control. It can be seen that the small map control 1203 can display the content of the small map, and the user can also click the small map control 1203 to display the warning information corresponding to the click in the small map, and the warning information can be synchronized to other users' small maps. The user controls the movement of the game character in the game scene interface by sliding the direction button 1201.

[0082] Correspondingly, based on the pre-set mapping relationship between controls and areas, the type of touch area of ​​each type of control can be determined, namely, the aforementioned sliding hot zone, click hot zone, smooth hot zone and jitter hot zone. Specifically, the area type of the touch area corresponding to the first type of control is a click hot zone, the area type of the touch area corresponding to the second type of control is a sliding hot zone, the area type of the touch area corresponding to the third type of control is a jitter hot zone, and the other areas are smooth hot zones.

[0083] After obtaining the type of each target control, the number of types of each target control is determined, that is, the number of target controls corresponding to each control type is determined, and the type with a control number greater than 1 is taken as the specified type, and then, at least two touch areas of the target controls that meet the specified conditions are searched in the specified type, and the touch areas are integrated into a merged area. The touch areas of other unintegrated target controls are taken as the operation areas corresponding to the target controls.

[0084] It should be noted that the touch areas of at least two target controls meet the merging condition if the area interval between the touch areas of the at least two target controls is less than a specified threshold or there is an overlapping area between the touch areas of the at least two target controls, that is, find areas of the same type whose area interval is less than a specified threshold or there is an overlapping area to merge. Fig.13 As shown, Figure 2 By comparison, it can be seen that Figure 2 The click hot zone 202 and the click hot zone 203 in the image satisfy the specified condition, so the click hot zone 202 and the click hot zone 203 are merged into one area, namely, the click area 206.

[0085] S705: Determine an area to be processed based on the operation area.

[0086] S706: Setting preset parameters corresponding to the area to be processed.

[0087] Therefore, the detection model recognizes the controls in the target interface, thereby determining the various operation areas corresponding to the target interface, and merging the touch areas of the space that meet the merging conditions. The merged areas are used together as the operation areas of the controls. By selecting the YOLO-V5 model and reducing the resolution of the target image, the detection model can be deployed in electronic devices to reduce the risk of excessive power consumption and memory usage of the electronic devices.

[0088] See also Fig.14 , Fig.14 A touch screen setting method provided in an embodiment of the present application is shown, which is applied to an electronic device having a touch screen. The method includes: S1401 to S1405.

[0089] S1401: When the electronic device displays a target application via the touch screen, obtain a target image corresponding to a target interface of the target application.

[0090] S1402: Identify an operation area in the target image.

[0091] S1403: Determine an area to be processed based on the operation area.

[0092] S1404: Determine the type of the target control corresponding to the area to be processed.

[0093] It should be noted that the area to be processed corresponds to a target control, and the identification of the target control can refer to the aforementioned embodiment, which will not be described in detail here.

[0094] As an implementation, the type of each target control can be determined based on the position of each target control. Exemplarily, the recognition of the controls of the target interface can be done by inputting a sample image of the target interface or a sample image of an interface similar to the target interface when pre-training the detection model, so that the detection model can identify the distribution positions of each type of controls in the sample image in the sample image, and thus when using the trained detection model to detect the target image of the target interface, the position distribution of each target control on the target image can be determined, and the type of the target control can be determined based on the position distribution of the target control, for example, the control at the lower left of the target image is a direction key, i.e., a control of the second type, and the control at the lower right of the target image is a control of the first type.

[0095] As another implementation, the type of the target control can also be determined based on the image of the target control. Specifically, when pre-training the acquisition model, the model can be allowed to recognize the images of each control so that it can determine the type of the control by recognizing the image of the control, that is, the control can be recognized by the image of the control, so after recognizing the target control in the target image, the type of the target control can be determined based on the image of the target control.

[0096] S1405: Based on the type of the target control corresponding to the area to be processed, set the preset parameters corresponding to each area to be processed.

[0097] After determining the type of the target control corresponding to the area to be processed, the area type of the area to be processed can be determined, and then, based on the area type of the area to be processed, corresponding preset parameters are set for the area to be processed. The preset parameters may include the aforementioned touch response parameters and display parameters, and the specific description can refer to the aforementioned embodiment, which will not be repeated here.

[0098] Due to the different types of target controls, users operate the target controls in different ways, and the corresponding touch requirements are also different. For example, for the click hot zone corresponding to the first type of control, the user's touch requirement is a faster response and easier identification, and for the sliding hot zone corresponding to the second type of control, the user's touch requirement is a smoother sliding. Therefore, corresponding touch adjustment strategies are pre-set for different types. After identifying the area to be processed, the touch adjustment strategy corresponding to each area to be processed is determined based on the correspondence between the pre-set type and the touch adjustment strategy, and the preset parameters corresponding to the area to be processed are set based on the parameters corresponding to the touch adjustment strategy.

[0099] The adjustment method for the first type of target control can be that if the type of target control corresponding to the area to be processed is the first type, at least one of increasing the touch sensitivity of the area to be processed and reducing the touch detection delay of the area to be processed, wherein the first type of control is a control triggered based on a click operation. As mentioned above, the touch sensitivity can improve the touch screen's perception of the user's touch operation, that is, the improvement of the touch sensitivity makes it possible for the user to touch the touch screen without having to touch the touch screen with special force to be recognized by the touch screen, thereby making it easier for the user to input a touch operation to the area to be processed. In addition, reducing the touch detection delay of the area to be processed can be achieved by increasing the touch reporting rate and / or reducing the input response time. Since increasing the touch reporting rate can increase the number of touch points that the touch screen can scan per unit time, when the screen refresh time of the touch screen arrives, the electronic device can promptly collect the user's click operation and respond to the click operation and perform the screen update corresponding to the click operation, that is, the impact of the screen brought about by the click operation can be quickly refreshed on the screen by the electronic device. The reduction of input response time can reduce the time it takes for an electronic device to sense touch input and take corresponding actions. Exemplarily, the input response time of the area to be processed can be reduced by reducing the display quality of the display screen in the area to be processed, for example, reducing the characteristics of the display screen in the area to be processed, etc., for example, by reducing the resolution or turning off picture enhancement, wherein the picture enhancement may include video enhancement processing, and the video enhancement processing may include optimizing image parameters of the display screen, wherein the image parameter optimization includes at least one of exposure enhancement, denoising, edge sharpening, contrast increase or saturation increase.

[0100] The adjustment method for the second type of target control may be, if the type of the target control corresponding to the area to be processed is the second type, at least one of increasing the touch sensitivity of the area to be processed and increasing the touch reporting rate of the area to be processed, wherein the second type is a control triggered based on a sliding operation. The increase in the touch reporting rate may improve the smoothness of the sliding gesture of the area to be processed, and the specific effect may refer to the aforementioned embodiment, which will not be described in detail here.

[0101] If the area to be processed is a jitter hot zone, the preset parameters of the area to be processed are set by increasing the refresh rate of the area to be processed. The screen refresh rate refers to the number of times the display is refreshed per second. The refresh rate of the area to be processed can be understood as the number of times the part of the touch screen corresponding to the area to be processed is refreshed per second. A higher refresh rate can bring a smoother and clearer image display effect and reduce the jitter of the picture. In addition, if the jitter area supports sliding operations, it is also possible to increase the touch sensitivity of the area to be processed and increase the touch reporting rate of the area to be processed, thereby increasing the smoothness of the sliding.

[0102] If the area to be processed is a smooth hot zone, the preset parameters of the area to be processed are set in a manner that at least one of increasing the touch sensitivity of the area to be processed and increasing the touch reporting rate of the area to be processed is increased. That is to say, the parameter setting method of the smooth hot zone can refer to the setting method of the aforementioned sliding area, that is, the same as the setting method of the aforementioned sliding area. Of course, considering that the sliding trajectory of the smooth hot zone is usually a short-term sliding, and the trajectory of the sliding hot zone is usually long-term continuous and irregular, the sensitivity of the sliding hot zone needs to be increased, and the smooth hot zone does not need to be so sensitive. That is to say, the preset parameters of the smooth hot zone are set in a manner that increases the touch reporting rate of the area to be processed.

[0103] It should be noted that the above-mentioned setting method of the preset parameters for different types of areas is only an example. The embodiment of the present application does not limit the setting method of the preset parameters for each area, and it can be set based on actual usage requirements.

[0104] In an embodiment of the present application, the target application may be a game application, and the touch optimization of the operation area of ​​the game application may be distinguished based on the scene of the target application. Specifically, with reference to the above description, the target interface of the target application may be a game scene interface of a game application, but when the target application displays the target interface (i.e., the game scene interface), the target application may be in two states, namely, a control state and a viewing state. Among them, the control state means that the operating device has the control authority over the target interface, and the viewing state means that the operating device does not have the control authority over the target interface. In some embodiments, the aforementioned control authority over the target interface may refer to the control authority over all operable objects of the target interface, and accordingly, the control state has the control authority over all operable objects of the target interface, and the viewing state means that the operating device does not have the control authority over all operable objects of the target interface. In other embodiments, the operating device in the control state has the control authority over the first operating object of the target interface, and the operating device in the viewing state has the control authority over the second operating object of the target interface, wherein the first operating object and the second operating object do not limit the number of operating objects, and specifically, the first operating object and the second operating object may be operating objects of different types. Among them, the second operation object can be an operation object related to the viewing experience such as the viewing angle and the size of the viewing screen, and the control device in the viewing state is used to watch a specified video, and the specified video can be a video generated by the operation of the target interface by the operation device in the control state, which is equivalent to a video recorded when the operation device in the control state controls the first operation object. Then the second operation object is an operation control used when watching the video.

[0105] Taking the target interface as the game scene interface as an example, the first operation object that can be operated by the operating device in the control state can include the game characters, props in the game scene interface, and the operable buttons for each user to control the game characters or operate the props on the game interface. For example, the game screen includes a character operation button (including the aforementioned first type and second type of buttons), a prop operation button, and a game character. Then the character operation button, the prop operation button, and the game character are all operable objects that can be operated by the operating device in the control state, and the above-mentioned first operation object can include the character operation button, the prop operation button, and the game character. The user can operate the character operation button to control the movement of the game character, release the skills corresponding to each skill button, etc., and can also operate the props related to the game character through the prop operation button. Therefore, the operating device in the control state can control participation in the game through the first operation object and experience the gameplay. For example, for the game scene interface in the viewing state, the game screen includes a viewing operation control, and the user can adjust the video screen by operating the viewing operation control. As an implementation, the video screen can be the screen displayed by the operating device in the control state. By operating the viewing operation control, the screen displayed by the operating device in different control states can be switched, so as to switch the screens of different game characters. As another implementation, for the game character corresponding to the operating device in each control state, the server can generate video content under the viewing perspective of the game character. By operating the viewing operation control, the viewing perspective can be adjusted, and the video content under the viewing perspective of different game characters can be switched.

[0106] Therefore, considering that in the viewing state, the user's demand for the control experience in the target interface is much lower than the user's demand for the control experience in the target interface in the control state, therefore, when it is determined that the interface running the target application is the target interface, it is judged whether the target interface is in the viewing state or the control state. If it is in the control state, the subsequent operations in the method provided in the embodiment of the present application are executed.

[0107] In addition, assuming that the multiple operation areas obtained by identifying the target image include a click hotspot corresponding to the first type of target control, determine whether the game character of the game scene is a character of a specified type. If it is a character of a specified type, the character of the game scene is a character operated by the logged-in user of the target application in the game scene, and the character of the specified type refers to a character whose operation frequency of operating the click hotspot is greater than a specified threshold. If it is a character of a specified type, the click hotspot is used as a to-be-processed area. If it is a character of a specified type, the click hotspot is used as a to-be-processed area. If it is not a character of a specified type, the click area may not be used as a to-be-processed area.

[0108] Furthermore, if the character of the game scene is a character of a specified type, it is determined whether there is a combination key corresponding to the character of the game scene in the target interface, wherein the combination key is a key, which is also called a macro definition key. When the user clicks the combination key, the skills of all skill keys in the current interface can be released according to the skill combination sequence of the combination key. Therefore, if there is a combination key corresponding to the character of the game scene in the target interface, the click area may not be used as a pending area. Therefore, in some scenarios, not using the click area as a pending area can reduce the power consumption of electronic devices.

[0109] See also Fig.15 , which shows a structural block diagram of a touch screen setting device 1500 provided in an embodiment of the present application. The device may include: an acquisition unit 1501, an identification unit 1502, a determination unit 1503 and a setting unit 1504.

[0110] The acquisition unit 1501 is configured to acquire a target image corresponding to a target interface of a target application when the electronic device displays the target application through the touch screen.

[0111] Furthermore, the acquisition unit 1501 is also used to acquire a display image corresponding to a target interface of the target application when the electronic device displays the target application through the touch screen; and extract an image other than a background image in the display image as the target image.

[0112] The identification unit 1502 is used to identify the operation area in the target image.

[0113] Furthermore, the recognition unit 1502 is also used to recognize the target control in the target image based on a pre-trained detection model; and determine the operation area corresponding to the target control based on the touch area of ​​the target control in the target image.

[0114] Furthermore, there are multiple operation areas and target controls, and the identification unit 1502 is also used to determine the type of each target control; integrate the touch areas of at least two target controls that meet the specified conditions into a merged area, and the merged area serves as the operation area corresponding to the at least two target controls that meet the specified conditions, and the specified conditions are that the types of at least two target controls are the same and the touch areas of the at least two target controls meet the merged conditions; and use the touch area of ​​the target control that does not meet the specified conditions as the operation area corresponding to the target control.

[0115] Furthermore, the touch areas of the at least two target controls satisfy a merging condition if an area interval between the touch areas of the at least two target controls is smaller than a specified threshold or there is an overlapping area between the touch areas of the at least two target controls.

[0116] Furthermore, the recognition unit 1502 is also used to determine multiple detection boxes in the target image based on a pre-trained detection model; and determine the target control corresponding to each of the detection boxes.

[0117] Furthermore, the recognition unit 1502 is further configured to reduce the resolution of the target image to obtain an image to be processed; and determine a plurality of detection frames in the image to be processed based on a pre-trained detection model.

[0118] The determining unit 1503 is configured to determine a to-be-processed area from each of the operating areas.

[0119] The setting unit 1504 is used to set the preset parameters corresponding to each of the to-be-processed areas.

[0120] Furthermore, the setting unit 1504 is further configured to determine the type of the target control corresponding to the area to be processed; and based on the type of the target control corresponding to the area to be processed, set the preset parameters corresponding to each area to be processed.

[0121] Furthermore, the setting unit 1504 is also used to at least improve the touch sensitivity of the area to be processed and reduce the touch detection delay of the area to be processed if the type of the target control corresponding to the area to be processed is the first type, wherein the first type of control is a control triggered based on a click operation.

[0122] Furthermore, the setting unit 1504 is also used to at least one of improve the touch sensitivity of the area to be processed and improve the touch reporting rate of the area to be processed if the type of the target control corresponding to the area to be processed is the second type, wherein the second type is a control triggered based on a sliding operation.

[0123] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and modules can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.

[0124] In several embodiments provided in the present application, the coupling between modules may be electrical, mechanical or other forms of coupling.

[0125] In addition, each functional module in each embodiment of the present application can be integrated into a processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The above integrated modules can be implemented in the form of hardware or software functional modules.

[0126] Please refer to Fig.16 , which shows a structural block diagram of an electronic device provided in an embodiment of the present application. The electronic device 100 may be an electronic device capable of running applications, such as a smart phone, a tablet computer, an e-book, etc. The electronic device 100 in the present application may include one or more of the following components: a processor 110, a memory 120, and one or more applications, wherein the one or more applications may be stored in the memory 120 and configured to be executed by one or more processors 110, and the one or more programs are configured to execute the method described in the aforementioned method embodiment.

[0127] The processor 110 may include one or more processing cores. The processor 110 uses various interfaces and lines to connect various parts of the entire electronic device 100, and executes various functions and processes data of the electronic device 100 by running or executing instructions, programs, code sets or instruction sets stored in the memory 120, and calling data stored in the memory 120. Optionally, the processor 110 can be implemented in at least one hardware form of digital signal processing (DSP), field programmable gate array (FPGA), and programmable logic array (PLA). The processor 110 can integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. Among them, the CPU mainly processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing display content; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 110, but may be implemented separately through a communication chip.

[0128] The memory 120 may include a random access memory (RAM) or a read-only memory (ROM). The memory 120 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 120 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the following various method embodiments, etc. The data storage area may also store data (such as a phone book, audio and video data, chat record data) created by the electronic device 100 during use.

[0129] Please refer to Fig.17 , which shows a structural block diagram of a computer-readable medium provided in an embodiment of the present application. The computer-readable medium 1700 stores program codes, which can be called by a processor to execute the method described in the above method embodiment.

[0130] The computer readable medium 1700 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read-only memory), an EPROM, a hard disk, or a ROM. Optionally, the computer readable medium 1700 includes a non-transitory computer-readable storage medium. The computer readable medium 1700 has storage space for program code 1710 that performs any method step in the above method. These program codes can be read from or written to one or more computer program products. The program code 1710 can be compressed, for example, in an appropriate form.

[0131] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A touch screen setting method, characterized in that: A touch screen applied to an electronic device, the method comprising: When the electronic device displays a target application through the touch screen, acquiring a target image corresponding to a target interface of the target application; identifying an operation area in the target image; Determine an area to be processed based on the operation area; Set the preset parameters corresponding to the area to be processed.

2. The method according to claim 1, characterized in that The identifying the operation area in the target image includes: identifying a target control in the target image based on a pre-trained detection model; Based on the touch area of ​​the target control in the target image, an operation area corresponding to the target control is determined.

3. The method according to claim 2, characterized in that There are multiple operation areas and multiple target controls, and determining the operation area corresponding to the target control based on the touch area corresponding to the target control in the target image includes: determining the type of each of the target controls; Integrate the touch areas of at least two target controls that meet the specified condition into a merged area, and use the merged area as the operation area commonly corresponding to the at least two target controls that meet the specified condition, wherein the specified condition is that the at least two target controls are of the same type and the touch areas of the at least two target controls meet the merged condition; The touch area of ​​the target control that does not meet the specified condition is used as the operation area corresponding to the target control.

4. The method according to claim 3, characterized in that The touch areas of the at least two target controls satisfy the merging condition if the area interval between the touch areas of the at least two target controls is less than a specified threshold or there is an overlapping area between the touch areas of the at least two target controls.

5. The method according to claim 2, characterized in that: The identifying the target control in the target image based on the pre-trained detection model includes: Determining a plurality of detection boxes in the target image based on a pre-trained detection model; Determine a target control corresponding to each of the detection boxes.

6. The method according to claim 5, characterized in that The pre-trained detection model is used to determine a plurality of detection frames in the target image, including: Reducing the resolution of the target image to obtain an image to be processed; A plurality of detection frames are determined in the image to be processed based on a pre-trained detection model.

7. The method according to claim 1, characterized in that When the electronic device displays a target application through the touch screen, acquiring a target image corresponding to a target interface of the target application includes: When the electronic device displays a target application through the touch screen, acquiring a display image corresponding to a target interface of the target application; An image other than the background image in the display image is extracted as the target image.

8. The method according to claim 1, characterized in that The area to be processed corresponds to a target control, and the setting of preset parameters corresponding to the area to be processed includes: Determine the type of target control corresponding to the area to be processed; Based on the type of the target control corresponding to the area to be processed, the preset parameters corresponding to the area to be processed are set.

9. The method according to claim 8, characterized in that The setting of preset parameters corresponding to the area to be processed based on the type of the target control corresponding to the area to be processed includes: If the type of the target control corresponding to the area to be processed is the first type, at least one of increasing the touch sensitivity of the area to be processed and reducing the touch detection delay of the area to be processed, wherein the first type of control is a control triggered based on a click operation.

10. The method according to claim 8, characterized in that The setting of preset parameters corresponding to the area to be processed based on the type of the target control corresponding to the area to be processed includes: If the type of the target control corresponding to the area to be processed is the second type, at least one of improving the touch sensitivity of the area to be processed and improving the touch reporting rate of the area to be processed, wherein the second type is a control triggered based on a sliding operation.

11. A touch screen setting device, characterized in that: A touch screen applied to an electronic device, the device comprising: An acquisition unit, configured to acquire a target image corresponding to a target interface of the target application when the electronic device displays the target application through the touch screen; An identification unit, used for identifying an operation area in the target image; A determination unit, configured to determine a to-be-processed area based on the operation area; The setting unit is used to set the preset parameters corresponding to the area to be processed.

12. An electronic device, characterized in that: include: one or more processors; Memory; One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, and the one or more applications are configured to execute the method according to any one of claims 1-10.

13. A computer readable medium, characterized in that The computer-readable medium stores a program code executable by a processor, and when the program code is executed by the processor, the processor executes the method according to any one of claims 1 to 10.

Images