Touch control display methods, apparatus, device and storage medium

By receiving and analyzing touch operation instructions, adjusting the display position of the touch control to the user's high-frequency click area, the problem of low efficiency in manual adjustment of touch control position in the prior art is solved, and operation convenience and user experience are improved.

WO2024217127A9PCT designated stage expired Publication Date: 2024-12-05TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/076546
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-04-17
Filing Date
2024-02-07
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

In multiplayer online role-playing games, players need to repeatedly try to manually adjust the display position of the touch controls, resulting in poor operational convenience and low adjustment efficiency.

Method used

By receiving instructions generated by multiple touch operations, the touch operation position is determined, and the display position of the touch control is adjusted based on these positions, thereby adjusting it to the user's high-frequency click area.

Benefits of technology

It improves the matching degree between the layout position of the touch control and the user's operating habits, enhances operation convenience and use efficiency, reduces the user's need for manual adjustments, and improves the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024076546_05122024_PF_FP_ABST
    Figure CN2024076546_05122024_PF_FP_ABST
Patent Text Reader

Abstract

The present application belongs to the field of user interfaces. Disclosed are touch control display methods, an apparatus, a device and a storage medium. A method comprises: using a first position of a user interface as a display position of a touch control, and displaying the touch control; receiving a plurality of touch operation instructions generated by performing a plurality of touch operations on the touch control; determining on the user interface a plurality of touch operation positions respectively corresponding to the plurality of touch operation instructions; and, on the basis of the plurality of touch operation positions, adjusting the display position from the first position to a second position of the user interface and displaying the touch control at the second position. The present application provides the method for adjusting the display position of the touch control on the basis of the plurality of touch operations for the touch control, thereby improving the service efficiency of touch controls, and improving operation convenience.
Need to check novelty before this filing date? Find Prior Art

Description

Touch control display method, device, equipment and storage medium

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on April 17, 2023, with application number 2023104325779 and application name “Display method, device, equipment and storage medium for touch controls”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The embodiments of the present application relate to the field of user interfaces, and in particular to touch control display technology. Background Art

[0003] In online games with a virtual environment, such as multiplayer online role-playing games, players can play one or more virtual characters and control the virtual characters to move in the virtual environment of the game.

[0004] In the related art, multiple touch controls displayed in a touch user interface are used to control the activities of a virtual character in a virtual environment. Generally, the display positions of the touch controls are fixed by default, and players can also adjust the display positions of the touch controls in a customized manner to better suit their operating habits.

[0005] Manually adjusting the display position of the touch controls requires repeated attempts, which requires players to repeatedly switch between multiple user interfaces, making the operation less convenient and the adjustment efficiency lower.

[0006] Summary of the Invention

[0007] This application provides a display method, device, equipment, and storage medium for touch controls. The technical solution is as follows:

[0008] According to one aspect of the present application, a method for displaying a touch control is provided, the method being executed by a terminal, the method comprising:

[0009] Using the first position of the user interface as the display position of the touch control, and displaying the touch control;

[0010] receiving a plurality of touch operation instructions generated by performing a plurality of touch operations on the touch control;

[0011] Determining a plurality of touch operation positions on the user interface corresponding to the plurality of touch operation instructions;

[0012] The display position is adjusted from the first position to a second position of the user interface based on the multiple touch operation positions, and the touch control is displayed at the second position.

[0013] According to one aspect of the present application, a method for displaying a touch control is provided, the method being executed by a server and comprising:

[0014] Receiving an operation record sent by a terminal for indicating a plurality of touch operation positions, wherein the plurality of touch operation positions respectively correspond to a plurality of touch operation instructions, and the plurality of touch operation instructions are generated by performing a plurality of touch operations on the touch control;

[0015] Determining a second position of the touch control in the user interface based on the multiple touch operation positions, where the second position is obtained by adjusting the first position based on the multiple touch operation positions, and the first position is the display position of the touch control in the user interface before the position adjustment;

[0016] Second position information indicating the second position is sent to the terminal to instruct the terminal to display the touch control at the second position.

[0017] According to one aspect of the present application, a display device for a touch control is provided, the device comprising:

[0018] A display module, configured to use the first position of the user interface as the display position of the touch control to display the touch control;

[0019] a receiving module, configured to receive a plurality of touch operation instructions generated by performing a plurality of touch operations on the touch control; and determine a plurality of touch operation positions on the user interface corresponding to the plurality of touch operation instructions;

[0020] The display module is further configured to adjust the display position from the first position to a second position of the user interface based on the multiple touch operation positions, and display the touch control at the second position.

[0021] According to one aspect of the present application, a display device for a touch control is provided, the device comprising:

[0022] a receiving module, configured to receive an operation record sent by a terminal and used to indicate a plurality of touch operation positions, wherein the plurality of touch operation positions respectively correspond to a plurality of touch operation instructions, and the plurality of touch operation instructions are generated by performing a plurality of touch operations on the touch control;

[0023] a determination module, configured to determine a second position of the touch control in the user interface based on the multiple touch operation positions, wherein the second position is obtained by adjusting the first position based on the multiple touch operation positions, and the first position is a display position of the touch control in the user interface before the position adjustment;

[0024] A sending module is used to send second position information indicating the second position to the terminal, so as to instruct the terminal to display the touch control at the second position.

[0025] According to another aspect of the present application, a computer device is provided, comprising: a processor and a memory, wherein at least one computer program is stored in the memory, and the at least one computer program is loaded and executed by the processor to implement the touch control display method as described above.

[0026] According to another aspect of the present application, a computer storage medium is provided, in which at least one computer program is stored. The at least one computer program is loaded and executed by a processor to implement the display method of the touch control as described above.

[0027] According to another aspect of the present application, a computer program product is provided, which includes a computer program stored in a computer-readable storage medium; the computer program is read and executed from the computer-readable storage medium by a processor of a computer device, so that the computer device executes the display method of the touch control as described above.

[0028] The beneficial effects of the technical solution provided by this application include at least:

[0029] In an embodiment of the present application, multiple touch operation instructions generated by performing multiple touch operations on a touch control are received, and the touch operation positions corresponding to each of the multiple touch operation instructions in the user interface are determined. Then, based on the multiple touch operation positions, the display position of the touch control is adjusted from a first position to a second position, and finally the touch control is displayed at the second position. In this way, based on the operation positions of the multiple touch operations triggered by the user on the touch control, the user's high-frequency click area on the touch control is determined, and then the display position of the touch control is adjusted to the user's high-frequency click area, so that the layout position of the touch control is more in line with the user's usage habits, improving the convenience of operation, optimizing the layout of the touch control on the user interface, and facilitating enhanced efficiency of touch control usage; the position of the touch control is adaptively adjusted based on the user's operation record, eliminating the need for the user to make multiple manual adjustments, thereby enhancing the convenience of touch control adjustment, improving user experience, and improving touch control adjustment efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] FIG1 is a schematic diagram of an interface of a method for displaying a touch control provided by an exemplary embodiment of the present application;

[0031] FIG2 is a schematic diagram of an interface of a method for displaying a touch control provided by an exemplary embodiment of the present application;

[0032] FIG3 is a structural block diagram of a computer system provided by an exemplary embodiment of the present application;

[0033] FIG4 is a flowchart of a method for displaying a touch control provided by an exemplary embodiment of the present application;

[0034] FIG5 is a flowchart of a method for displaying a touch control provided by an exemplary embodiment of the present application;

[0035] FIG6 is a schematic diagram of setting candidate sub-regions provided by an exemplary embodiment of the present application;

[0036] FIG7 is a flowchart of a method for displaying a touch control provided by an exemplary embodiment of the present application;

[0037] FIG8 is a flowchart of a method for displaying a touch control provided by an exemplary embodiment of the present application;

[0038] FIG9 is a flowchart of a method for displaying a touch control provided by an exemplary embodiment of the present application;

[0039] FIG10 is a schematic diagram of the interaction between the user interface layer, the client, and the server in a method for displaying a touch control provided by an exemplary embodiment of the present application;

[0040] FIG11 is a block diagram of a display device of a touch control provided by an exemplary embodiment of the present application;

[0041] FIG12 is a block diagram of a display device of a touch control provided by an exemplary embodiment of the present application;

[0042] FIG13 is a schematic diagram of the structure of a computer device provided by an exemplary embodiment of the present application;

[0043] FIG14 is a schematic diagram of the device structure of a computer device provided by an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0044] In order to make the objectives, technical solutions and advantages of this application clearer, the implementation methods of this application will be further described in detail below with reference to the accompanying drawings.

[0045] First, some terms appearing in this application are explained.

[0046] Hotspot: A hotspot is a specific area on the screen where users can perform specific actions, such as clicking or dragging. Hotspots are often used to enhance user interface interactivity and improve the user experience. On mobile devices, hotspots are often designed as larger buttons or gesture areas to facilitate one-handed operation.

[0047] Button adaptation: Button adaptation refers to automatically adjusting the size and layout of buttons on screens of different sizes and device types to adapt to different screen sizes and device types, thereby improving the user experience. Button adaptation usually requires corresponding adjustment and layout according to the size and resolution of the device screen. For example, on a smaller mobile device screen, buttons may need to be shrunk and rearranged to fit the limited screen space; on a large-screen computer, buttons may need to be enlarged and spacing increased to improve readability and ease of use. Button adaptation is an important design principle that can help designers and developers create more flexible user interfaces and improve user experience and satisfaction.

[0048] FIG1 shows a user interface diagram of a method for displaying touch controls provided by an exemplary embodiment of the present application. The method can be executed by a terminal, a client on the terminal, or a server. The diagram takes the client on the terminal as an example of a game application. It should be understood that FIG1 takes the user interface as a game application interface and the touch controls as virtual character manipulation controls in the game application as an example. In actual applications, the user interface can also be the interface of other applications, and the touch controls can also be controls in other applications. The embodiments of the present application do not impose any limitations on this.

[0049] As shown in FIG1(a), a user interface 10 of a game application is displayed on a terminal; this user interface 10 may be a default touch control layout interface of the system, or a touch control layout interface customized by the user. A virtual character 12 and multiple touch controls are displayed on this user interface 10. Each touch control is displayed in its corresponding first position, i.e., its position before adaptive adjustment, such as touch control 11 on the left and touch control 13 on the right, and so on.

[0050] For each touch control on the user interface 10, a prediction area is set for the touch control. The prediction area of ​​a touch control covers the display area of ​​the touch control and is larger than the display area of ​​the touch control. This prediction area is used to record touch operations directed at the touch control. That is, all touch operations directed at the touch control that fall within the prediction area will be recorded. As shown on the left side of Figure 1 (b), a prediction area is set for each touch control on the user interface 10 (the gray rectangle covering the touch control in the figure indicates the prediction area).

[0051] Taking touch control 13 as an example, the right side of Figure 1 (b) shows how its first position and predicted area are set. Circle 15 represents the abstract schematic shape of touch control 13 in user interface 10. In the default scheme, the leftmost side of the first position of touch control 13 (i.e., circle 15 in the figure) is set 280 pixels away from the left edge of the user interface, and a predicted area 16 is set for touch control 13. This predicted area 16 includes the display area of ​​touch control 13 (i.e., circle 15 in the figure) and is larger than the display area of ​​touch control 13.

[0052] During the user's game process, multiple touch operations performed by the user on the touch control are recorded, that is, multiple touch operation instructions generated by performing multiple touch operations on the touch control are received, and based on the touch operation positions on the user interface corresponding to each of the multiple touch operation instructions, a second position corresponding to the touch control is determined, that is, the user's click hot zone for the touch control. For example, in Figure (c) of Figure 1, multiple partially overlapping white circles on the touch control 13 represent the anchor points of the user's touch operations on the touch control 13 (that is, the touch operation positions of the user performing multiple touch operations on the touch control 13). Based on the multiple partially overlapping white circles, a click hot zone is determined, that is, the user's high-frequency click area on the touch control 13. An abstract schematic diagram is shown on the right side of Figure (c) in Figure 1, in which the black solid circle 14 represents the second position of the touch control 13 (i.e., the circle 15 in the figure). The position and size of the black solid circle 14 are determined based on the touch operation positions of the user's multiple touch operations on the touch control 13 (i.e., the aforementioned multiple partially overlapping white circles); the two dotted lines in the figure represent the center lines of the second position, i.e., the intersection of the two dotted lines is the center of the black solid circle 14 (the center point of the click hot zone).

[0053] After determining the second position of the touch control 13 based on the user's multiple touch operation positions on the touch control 13, the display position of the touch control 13 is adjusted to the second position so that the touch control 13 is displayed at the second position. For example, the center of the second position is determined to be the center of the touch control 13. The left side of Figure 1 (d) shows the touch control 13 after position adjustment, with its center position being the center of the second position; the right side of Figure 1 (d) shows an abstract schematic diagram of the position adjustment. After the position adjustment is performed according to the second position, the touch control 13 (i.e., circle 15 in the figure) is displayed at the position of circle 17. The leftmost side of circle 17 is 302 pixels away from the left edge of the user interface, and the predicted area for the touch control 13 is reset according to the new position, as shown by the rectangular box 18 in the figure.

[0054] FIG2 shows a user interface diagram of a method for displaying touch controls provided by another exemplary embodiment of the present application. The method can be executed by a terminal, a client on the terminal, or a server. The diagram takes the client on the terminal as an example of a game application client. It should be understood that FIG2 takes the user interface as a game application interface and the touch controls as virtual character manipulation controls in the game application as an example. In actual applications, the user interface can also be the interface of other applications, and the touch controls can also be controls in other applications. The embodiments of the present application do not impose any limitations on this.

[0055] As shown in FIG. 2 (a), a user interface 20 of a game application is displayed on a terminal. This user interface 20 may be a default touch control layout interface of the system, or a touch control layout interface customized by the user. A virtual character 22 and multiple touch controls are displayed on this user interface 20. Each touch control is displayed in its corresponding first position, i.e., its position before adaptive adjustment, such as touch control 21 on the left and touch control 23 on the right, and so on.

[0056] For each touch control on the user interface 20, a prediction area is set for the touch control. The prediction area of ​​a touch control covers the display area of ​​the touch control and is larger than the display area of ​​the touch control. The prediction area is used to record touch operations on the touch control. That is, all touch operations on the touch control that fall within the prediction area will be recorded. As shown on the left side of Figure 2 (b), a prediction area is set for each touch control on the user interface 20 (the gray rectangle covering the touch control in the figure indicates the prediction area).

[0057] Taking the touch control 21 as an example, the setting method of its initial position and prediction area is shown on the right side of Figure 2 (b). Among them, the circle 25 represents the abstract schematic shape of the touch control 21 in the user interface. In the preset scheme, the leftmost side of the first position of the touch control 21 (i.e., the circle 25 in the figure) is set to be 50 pixels away from the left border of the user interface, and a prediction area 26 is set for the touch control 21. The prediction area 26 includes the display area of ​​the touch control 21 (i.e., the circle 25 in the figure) and is larger than the display area of ​​the touch control 21.

[0058] During the user's game process, multiple touch operations performed by the user on the touch control are recorded, that is, multiple touch operation instructions generated by performing multiple touch operations on the touch control are received, and based on the touch operation positions on the user interface corresponding to each of the multiple touch operation instructions, a second position corresponding to the touch control is determined, that is, the user's click hot zone for the touch control. For example, in Figure (c) of Figure 2, multiple partially overlapping white circles on the touch control 21 represent the anchor points of the user's touch operations on the touch control 21 (that is, the touch operation positions of the user performing multiple touch operations on the touch control 21). Based on the multiple partially overlapping white circles, a click hot zone is determined, that is, the user's high-frequency click area on the touch control 21. An abstract schematic diagram is shown on the right side of Figure (c) in Figure 2, where the black solid circle 24 represents the second position of the touch control 21 (i.e., the circle 25 in the figure). The position and size of the black solid circle 24 are determined based on the touch operation positions of the user's multiple touch operations on the touch control 21 (i.e., the aforementioned multiple partially overlapping white circles); the two dotted lines in the figure represent the center lines of the second position, i.e., the intersection of the two dotted lines is the center of the black solid circle 24 (the center point of the click hot zone).

[0059] After determining the second position of the touch control 21 based on the positions of multiple touch operations performed by the user on the touch control 21, the display position of the touch control 21 is adjusted to the second position so that the touch control 21 is displayed at the second position. For example, the center of the second position is determined to be the center of the touch control 21. The left side of Figure 2 (d) shows the touch control 21 after position adjustment, with its center position being the center of the second position; the right side of Figure 2 (d) shows an abstract schematic diagram of the position adjustment. After position adjustment based on the second position, the touch control 21 (i.e., circle 25 in the figure) is displayed at the position of circle 27. The leftmost side of circle 27 is 32 pixels away from the left border of the user interface, and a predicted area is reset for the touch control 21 based on its new position, as shown by rectangular box 28 in the figure.

[0060] 3 shows a block diagram of a computer system according to an exemplary embodiment of the present application. The computer system 100 includes a first terminal 110 , a server 120 , and a second terminal 130 .

[0061] The first terminal 110 has a client 111 installed and running that supports a virtual environment. This client 111 can be a multiplayer online battle program. When the first terminal 110 runs the client 111, the user interface of the client 111 is displayed on the screen of the first terminal 110. The client 111 can be any of the following applications: a battle royale shooting game, a virtual reality (VR) application, an augmented reality (AR) program, a three-dimensional map program, a virtual reality game, an augmented reality game, a first-person shooter (FPS), a third-person shooter (TPS), a multiplayer online tactical competitive game (MOBA), a simulation game (SLG), and the like. In this embodiment, the client 111 is illustrated as a MOBA game. First terminal 110 is used by first user 112. First user 112 uses first terminal 110 to control a first virtual character in a virtual environment to perform activities, such as controlling a pet virtual character to explore the virtual world. The first virtual character may be referred to as the virtual character of first user 112. First user 112 may assemble, disassemble, and uninstall virtual items owned by the first virtual character, although this application does not limit this. For example, the first virtual character may be a simulated human character or an animated character.

[0062] The second terminal 130 has a client 131 installed and running that supports a virtual environment. This client 131 can be a multiplayer online battle program. When the second terminal 130 runs the client 131, the user interface of the client 131 is displayed on the screen of the second terminal 130. The client can be any of a battle royale shooting game, a VR application, an AR program, a 3D map program, a virtual reality game, an augmented reality game, an FPS, a TPS, a MOBA, a SLG, or the like. In this embodiment, the client 131 is a MOBA game as an example. The second terminal 130 is used by the second user 113. The second user 113 uses the second terminal 130 to control a second virtual character in the virtual environment to perform activities, such as controlling a pet virtual character to explore the virtual world. The second virtual character can be referred to as the virtual character of the second user 113. For example, the second virtual character can be a simulated human character or an anime character.

[0063] Optionally, the first virtual character and the second virtual character may be in the same virtual environment. Optionally, the first virtual character and the second virtual character may belong to the same camp, the same team, the same organization, have a friendship relationship, or have temporary communication permissions. Optionally, the first virtual character and the second virtual character may also belong to different camps, different teams, different organizations, or have a hostile relationship.

[0064] Optionally, the client installed on the first terminal 110 and the second terminal 130 can be the same, or the client installed on the two terminals can be the same type of client on different operating system platforms (Android or iOS). The first terminal 110 can generally refer to one of multiple terminals, and the second terminal 130 can generally refer to another of the multiple terminals. This embodiment only uses the first terminal 110 and the second terminal 130 as an example. The first terminal 110 and the second terminal 130 can be the same or different device types, including but not limited to at least one of a smartphone, a tablet computer, an e-book reader, an MP3 player, an MP4 player, a laptop computer, and a desktop computer.

[0065] FIG3 shows only two terminals, but in different embodiments, multiple other terminals 140 may be connected to the server 120. Optionally, one or more terminals 140 may be terminals corresponding to developers, and a client development and editing platform supporting a virtual environment may be installed on the terminal 140. The developer may edit and update the client on the terminal 140 and transmit the updated client installation package to the server 120 via a wired or wireless network. The first terminal 110 and the second terminal 130 may then download the client installation package from the server 120 to update the client.

[0066] The first terminal 110 , the second terminal 130 , and the other terminals 140 are connected to the server 120 via a wireless network or a wired network.

[0067] Server 120 includes at least one of a single server, multiple servers, a cloud computing platform, and a virtualization center. Server 120 provides backend services for clients supporting virtual environments. Optionally, server 120 performs primary computing tasks, while terminals perform secondary computing tasks; alternatively, server 120 performs secondary computing tasks, while terminals perform primary computing tasks; alternatively, server 120 and terminals utilize a distributed computing architecture for collaborative computing.

[0068] In an illustrative example, the server 120 includes a processor 122, a user account database 123, a battle service module 124, and a user-facing input / output interface (I / O interface) 125. The processor 122 is configured to load instructions stored in the server 120 and process data in the user account database 123 and the battle service module 124. The user account database 123 is configured to store data of user accounts logged into the first terminal 110, the second terminal 130, and other terminals 140, such as user account avatars, user account nicknames, user account combat power indexes, and the service areas where the user accounts are located. The battle service module 124 is configured to provide multiple battle rooms for users to engage in battles, such as 1v1 battles, 3v3 battles, and 5v5 battles. The user-facing I / O interface 125 is configured to establish communication and exchange data with the first terminal 110 and / or the second terminal 130 via a wireless network or a wired network.

[0069] FIG4 is a flow chart of a method for displaying a touch control provided by an exemplary embodiment of the present application. The method may be executed by a terminal in the system shown in FIG3 or a client on the terminal. The method includes:

[0070] Step 220: Using the first position of the user interface as the display position of the touch control, and displaying the touch control;

[0071] The user interface is the interface through which users interact with a terminal or a client on the terminal. For example, if a terminal is running a game application, the user interface includes a virtual character, touch controls, and so on. The virtual character is used to move within the virtual world provided by the game application under user control, and the touch controls support user control of the virtual character. The user interface has pre-set hotspots, which are touch-sensitive areas used to perform control operations on the virtual character. Hotspots can also be understood as areas that respond to touch operations on touch controls.

[0072] The first position refers to the location of the touch control before it is adjusted. For example, on the initial interface of a game, the first position of the touch control is determined according to the system's preset layout; or, if the user customizes the layout of the touch controls on the user interface, the first position of the touch control is determined according to the customized layout.

[0073] Exemplarily, the first position of the touch control is determined according to a default setting of the system or a customized setting of the user; and the touch control is displayed at the first position of the user interface.

[0074] In some embodiments, in order to adapt the display of touch controls to user interfaces of different sizes or resolutions, the size or layout of the touch controls needs to be adjusted accordingly based on the size or resolution of the user interface. For example, the size of the touch controls may be adjusted based on the size and / or resolution of the user interface.

[0075] Exemplarily, based on the size and / or resolution of the user interface, the ratio of the size of the user interface to the preset interface is determined; the size of the touch control is adjusted according to the ratio, where the preset interface is the display mode of the user interface set when the application is developed. For example, the ratio of the height of the user interface to the height of the preset interface is calculated, and the touch control is proportionally enlarged or reduced according to the ratio; or, on a terminal with a smaller user interface, the touch control is reduced and rearranged. This application is not limited to this. In this way, the size of the touch control is adjusted based on the size and / or resolution of the user interface, so that the display of the touch control can adapt to user interfaces of different sizes and / or different resolutions, which makes it easier for users to trigger operations more accurately through the touch control and improves the user experience.

[0076] Step 240: receiving a plurality of touch operation instructions generated by performing a plurality of touch operations on the touch control;

[0077] Step 260: Determine a plurality of touch operation positions on the user interface corresponding to the plurality of touch operation instructions;

[0078] A touch operation refers to an operation triggered by a touch control, which can be at least one of a click operation, a long press operation, a drag operation, a double-click operation, a voice operation, a pressure touch operation, an eye control, and a somatosensory control. This application does not limit this. A touch operation instruction is a computer instruction generated by the terminal in response to a touch operation triggered by the user. The terminal needs to perform the relevant operation based on the touch operation instruction. The touch operation instruction can indicate the control position of the corresponding touch operation in the user interface, that is, the touch operation position.

[0079] A touch operation on a touch control means that the target object of the touch operation is the touch control, but the touch operation may not necessarily fall accurately on the touch control; that is, the touch operation on the touch control includes touch operations falling on the touch control and touch operations falling around the touch control.

[0080] In some embodiments, a predicted area for a touch control is set. The predicted area is an area that is pre-predicted to be where a touch operation on the touch control may fall. The predicted area is an area in the user interface that at least partially includes, preferably completely includes, the touch control and is larger than the touch control. In the embodiments of the present application, any touch operation that falls within the predicted area of ​​the touch control is regarded as a touch operation on the touch control, and the position of the touch operation in the predicted area will be recorded accordingly to provide a reference for subsequent adjustment of the display position of the touch control. In other words, the above-mentioned multiple touch operations on the touch control are all touch operations that fall within the predicted area of ​​the touch control; optionally, the predicted area does not cover the areas of other touch controls. In actual applications, the touch operation triggered by the user on the touch control may fall into a position outside the touch control in the above-mentioned predicted area. When more touch operations triggered by the user on the touch control fall into a position outside the touch control in the predicted area, it can be considered that the display position of the touch control does not conform to the user's operating habits. At this time, the display position of the touch control can be adjusted according to the touch operation positions of multiple touch operations triggered by the user on the touch control, so that the adjusted position conforms to the user's operating habits.

[0081] In actual applications, within a preset time period (such as one day, two days, one week, etc.), based on each touch operation triggered by the user on a certain touch control, the touch operations that fall outside the touch control in the predicted area can be counted, such as counting the number of touch operations that fall outside the touch control, counting the proportion of touch operations that fall outside the touch control in each touch operation, etc. Then, by comparing the size relationship between the statistical results and the preset threshold, if the statistical result is higher than the preset threshold, it means that the touch operations triggered by the user on the touch control fall outside the touch control more often. At this time, the display position of the touch control can be adjusted based on these touch operation positions.

[0082] Exemplarily, after receiving multiple touch operations on the touch control, the terminal determines the adjusted second position of the touch control based on the operation positions of the multiple touch operations; or, after receiving multiple touch operations on the touch control, the terminal sends the operation records of the multiple touch operations to the server, and after the server determines the adjusted second position of the touch control, receives the second position information sent by the server, and the second position information is used to indicate the second position of the touch control.

[0083] Step 280: Adjust the display position from the first position to a second position of the user interface based on the multiple touch operation positions, and display the touch control at the second position.

[0084] The second position is obtained by adjusting the first position based on multiple touch operation positions. Compared with the first position, the second position is more in line with the user's operation habits, that is, the user's touch operations on the touch control are more likely to fall on the second position and its surroundings.

[0085] Exemplarily, the terminal displays the touch control after the position adjustment at the second position of the user interface.

[0086] In some embodiments, the second position is determined based on the first click hot zone, which can be, for example, the center position of the first click hot zone; the first click hot zone is an area where the click rate reaches a first threshold, and the click rate of the first click hot zone is determined based on the number of touch operation positions among multiple touch operation positions that fall into the first click hot zone, and the first threshold is a pre-set click rate threshold.

[0087] In some embodiments, the second position is determined by the terminal. The terminal determines a click rate for each candidate sub-region within the prediction area based on the touch operation positions among the multiple touch operation positions that fall within the prediction area, where the prediction area is an area of ​​the user interface that includes a touch control and has an area larger than the touch control; and determines the candidate sub-region whose click rate reaches a first threshold as a first click hot zone.

[0088] In some embodiments, the second position is determined by a server. The terminal sends an operation record indicating the plurality of touch operation positions to the server. After the server determines the second position, the terminal receives second position information sent by the server, the second position information indicating the second position. The second position information is determined by the server based on the operation record. The server determines a click rate for each candidate sub-region within the predicted region based on the touch operation positions that fall within the predicted region among the plurality of touch operation positions, and determines the candidate sub-region whose click rate reaches the first threshold as a first click hotspot.

[0089] In other embodiments, the second position is determined based on the second click hot zone, which can be, for example, the center position of the second click hot zone. The second click hot zone is the area where the number of clicks reaches a second threshold. The number of clicks in the second click hot zone is the number of touch operation positions that fall into the second click hot zone among multiple touch operation positions. The second threshold is a pre-set click number threshold.

[0090] In some embodiments, the second position is determined by the terminal. A number of clicks for each candidate sub-region within the predicted area is determined based on the touch operation positions among the multiple touch operation positions, where the predicted area is an area of ​​the user interface that includes a touch control and is larger than the touch control; and a candidate sub-region whose number of clicks reaches a second threshold is determined as a second click hotspot.

[0091] In some embodiments, the second position is determined by a server. The terminal sends an operation record indicating multiple touch operation positions to the server. After the server determines the second position, the terminal receives second position information sent by the server, where the second position information is used to indicate the second position. The second position information is determined by the server based on the operation record. The server is used to determine the number of clicks for each candidate sub-region within the predicted area based on the touch operation positions that fall within the predicted area among the multiple touch operation positions, and determine the candidate sub-region whose number of clicks reaches a second threshold as the second click hot zone.

[0092] In other embodiments, the second position is the center position of the circumscribed circle or circumscribed regular polygon of multiple third click hot zones, and the multiple third click hot zones are areas in multiple grid areas where the click rate and / or number of clicks reaches a threshold value, and the multiple grid areas are obtained by dividing the predicted area into grids.

[0093] Optionally, the second location information received by the terminal is the coordinates of the second location; or, the second location information is offset data of the second location relative to the first location.

[0094] In summary, the method provided in this embodiment receives multiple touch operation instructions generated by performing multiple touch operations on a touch control, and determines the touch operation positions corresponding to each of these multiple touch operation instructions in the user interface. Then, based on the multiple touch operation positions, the display position of the touch control is adjusted from a first position to a second position, and finally the touch control is displayed at the second position. In this way, based on the operation positions of the multiple touch operations triggered by the user on the touch control, the user's high-frequency click area on the touch control is determined, and then the display position of the touch control is adjusted to the user's high-frequency click area, so that the layout position of the touch control is more in line with the user's usage habits, improving the convenience of operation, optimizing the layout of the touch control on the user interface, and facilitating enhanced efficiency of touch control usage; the position of the touch control is adaptively adjusted based on the user's operation record, eliminating the need for the user to make multiple manual adjustments, thereby enhancing the convenience of touch control adjustment, improving user experience, and improving touch control adjustment efficiency.

[0095] FIG5 is a flow chart of a method for displaying a touch control provided by an exemplary embodiment of the present application. The method can be executed by a terminal in the system shown in FIG3 or a client on the terminal. The method includes:

[0096] Step 420: Using the first position of the user interface as the display position of the touch control, and displaying the touch control;

[0097] The user interface is an interface for users to interact with the terminal or the client on the terminal.

[0098] The first position refers to the location of the touch control before it is adjusted. For example, on the initial interface of a game, the first position of the touch control is determined according to the system's preset layout; or, if the user customizes the layout of the touch controls on the user interface, the first position of the touch control is determined according to the customized layout.

[0099] Exemplarily, the first position of the touch control is determined according to a default setting of the system or a customized setting of the user; and the touch control is displayed at the first position of the user interface.

[0100] Step 430: receiving a plurality of touch operation instructions generated by performing a plurality of touch operations on the touch control; determining a plurality of touch operation positions on the user interface corresponding to the plurality of touch operation instructions;

[0101] A touch operation refers to an operation triggered by a touch control, which can be at least one of a click operation, a long press operation, a drag operation, a double-click operation, a voice operation, a pressure touch operation, an eye control, and a somatosensory control. This application does not limit this. A touch operation instruction is a computer instruction generated by the terminal in response to a touch operation triggered by the user. The terminal needs to perform the relevant operation based on the touch operation instruction. The touch operation instruction can indicate the control position of the corresponding touch operation in the user interface, that is, the touch operation position.

[0102] A touch operation on a touch control means that the target object of the touch operation is the touch control, but the touch operation may not necessarily fall accurately on the touch control; that is, the touch operation on the touch control includes touch operations falling on the touch control and touch operations falling around the touch control.

[0103] Exemplarily, the terminal receives multiple touch operations on the touch control.

[0104] In some embodiments, a predicted area for a touch control is set. This predicted area is the area where a touch operation on the touch control is predicted to fall. In this embodiment of the present application, any touch operation that falls within the predicted area of ​​the touch control will be considered an operation on the touch control and will be recorded accordingly to provide a reference for subsequent adjustment of the touch control display position. That is, the multiple touch operations on the touch control mentioned above are all touch operations that fall within the predicted area of ​​the touch control. The predicted area includes the touch control and is larger than the area of ​​the touch control. Optionally, the predicted area does not cover the areas of other touch controls.

[0105] In order to record the distribution of multiple touch operations in the prediction area, that is, how many touch operations are performed at different positions in the prediction area, the prediction area needs to be divided into multiple candidate sub-areas. The candidate sub-areas can be set in any of the following ways: dividing the prediction area into multiple non-overlapping rectangular candidate sub-areas, for example, dividing the prediction area into multiple non-overlapping rectangular candidate sub-areas in a tic-tac-toe manner; dividing the prediction area into multiple non-overlapping sector-shaped candidate sub-areas, for example, dividing the prediction area into multiple non-overlapping candidate sub-areas corresponding to the sector angle according to a preset sector angle; taking the center of the prediction area as the reference position, setting multiple circular candidate sub-areas with the same radius and partially overlapping in the prediction area; taking the center of the touch control as the reference position, setting multiple circular candidate sub-areas with the same radius and partially overlapping in the prediction area; taking the operation position of each touch operation as the center, setting multiple circular candidate sub-areas with the same radius in the prediction area.

[0106] Figure 6 shows a schematic diagram of setting multiple candidate sub-regions in the prediction area. In (a), taking the prediction area as a rectangle as an example, a tic-tac-toe grid segmentation method is used to divide the prediction area into multiple non-overlapping rectangular candidate sub-regions. In (b), taking the prediction area as a circle as an example, a fan-shaped segmentation method is used to divide the prediction area into multiple non-overlapping fan-shaped candidate sub-regions. In (c), the dotted circle indicates the touch control, the rectangular frame indicates the prediction area, and the solid circle indicates the candidate sub-region; with the center of the prediction area (i.e., the rectangular frame) as the reference position, multiple circular candidate sub-regions with the same radius and partially overlapping are set in the prediction area. In (d), the dotted circle indicates the touch control, the rectangular frame indicates the prediction area, and the solid circle indicates the candidate sub-region; with the center of the touch control (i.e., the dotted circle) as the reference position, multiple circular candidate sub-regions with the same radius and partially overlapping are set in the prediction area; wherein, if the set candidate sub-region exceeds the prediction area, only valid operation records falling within the prediction area are counted, and invalid operation records outside the prediction area are ignored.

[0107] In addition, the methods (a) and (b) in FIG6 can also be implemented as partially overlapping candidate sub-regions, and the methods (c) and (d) can also be implemented as non-overlapping candidate sub-regions. This application does not impose any restrictions on this.

[0108] In addition to the method of setting candidate sub-regions shown in FIG6 , candidate sub-regions can also be dynamically set based on the user's touch operation. For example, multiple circular candidate sub-regions with the same radius or multiple rectangular candidate sub-regions of the same size can be set in the prediction area with the operation location of each touch operation as the center.

[0109] By setting the candidate sub-areas in the above manner, it can be ensured that the set candidate sub-areas reasonably cover the prediction area, so that the distribution of touch operations that fall into the prediction area among multiple touch operations can be more accurately determined within the prediction area, that is, how many touch operations are there at different positions within the prediction area. This helps to determine the display position of the touch control that is more in line with the user's operating habits.

[0110] It should be noted that only one of the following steps 442 to 444 and steps 446 to 448 needs to be performed. Steps 442 to 444 are performed when the second position is determined based on the click rate, and steps 446 to 448 are performed when the second position is determined based on the number of clicks.

[0111] Step 442: determining a click rate of each candidate sub-region within the prediction region according to the touch operation positions among the multiple touch operation positions that fall within the prediction region;

[0112] Exemplarily, based on the touch operation positions that fall into the predicted area among multiple touch operation positions, the number of clicks on each candidate sub-area is counted, that is, the number of touch operations falling into each candidate sub-area; the click rate of each candidate sub-area is determined based on the number of clicks on each candidate sub-area and the total number of touch operations.

[0113] It should be noted that the number of clicks is counted within the time length L. For example, the number of clicks in the operation record can be counted every time length L; or a sliding window with a size of time length L can be set to count the number of clicks for the operation records in the sliding window.

[0114] Exemplarily, the quotient obtained by dividing the number of clicks on each candidate sub-region by the total number of clicks falling into the predicted region is used as the click rate of the candidate sub-region.

[0115] Step 444: Determine the candidate sub-region whose click rate reaches the first threshold as the first click hot zone;

[0116] The first threshold is a preset click-through rate threshold; or the first threshold is a dynamically adjusted click-through rate threshold. For example, the first threshold may be preset to 50%; or, the click-through rates of all candidate sub-regions may be sorted from high to low, with the third-ranked click-through rate being determined as the first threshold, etc. This application is not limited to this.

[0117] Exemplarily, the candidate sub-region whose click rate reaches a first threshold is determined as a first click hot zone, that is, a high-frequency click area of ​​the user on the touch control.

[0118] In some embodiments, when there are multiple non-adjacent candidate sub-regions whose click-through rates reach a first threshold, the candidate sub-regions whose click-through rates reach the first threshold are sorted in descending order of click-through rates, and the adjacent candidate sub-regions among the first n candidate sub-regions are determined as the first click hot zones, where n is a natural number.

[0119] In some embodiments, the candidate sub-regions whose click rates reach a first threshold are sorted in descending order of click rates, and the first n candidate sub-regions are determined as first click hotspots, where n is a natural number.

[0120] That is, according to step 442, the click rate of each candidate sub-region within the predicted region is determined, and then in this step, a first click hotspot is determined based on the click rate. Finally, in the following step 460, the touch control is displayed at the second position determined based on the first click hotspot. In this way, determining the first click hotspot based on the click rate can ensure that the determined first click hotspot is the area that users frequently click when triggering touch operations on the control. Accordingly, determining the second position based on the first click hotspot and adjusting the control to display at the second position can ensure that the adjusted control is more in line with the user's operating habits.

[0121] Step 446: determining the number of clicks on each candidate sub-region within the prediction region according to the touch operation position that falls within the prediction region among the multiple touch operation positions;

[0122] Exemplarily, according to the touch operation positions that fall within the prediction area among the multiple touch operation positions, the number of clicks on each candidate sub-area is counted.

[0123] It should be noted that the number of clicks is counted within the time length L. For example, the number of clicks in the operation record can be counted every time length L; or a sliding window with a size of time length L can be set to count the number of clicks for the operation records in the sliding window.

[0124] Step 448: Determine the candidate sub-region whose click count reaches the second threshold as the second click hot zone;

[0125] The second threshold value may be a preset click count threshold value; or a dynamically adjusted click rate threshold value. For example, the second threshold value may be preset to 10 clicks; or, the number of clicks for all candidate sub-regions may be sorted from high to low, and the number of clicks ranked third may be determined as the second threshold value, etc. This application is not limited to this.

[0126] Exemplarily, the candidate sub-region where the number of clicks reaches a second threshold is determined as a second click hot zone, that is, a high-frequency click area of ​​the user on the touch control.

[0127] In some embodiments, when there are multiple non-adjacent candidate sub-regions whose number of clicks reaches the second threshold, the candidate sub-regions whose number of clicks reaches the second threshold are sorted in descending order according to the number of clicks, and the adjacent candidate sub-regions among the first n candidate sub-regions are determined as the second click hot zones, where n is a natural number.

[0128] In some embodiments, the candidate sub-regions whose click rates reach the second threshold are sorted in descending order of click rates, and the first n candidate sub-regions are determined as second click hotspots, where n is a natural number.

[0129] That is, the number of clicks on each candidate sub-region within the prediction area is determined according to step 446, and then a second click hotspot is determined based on the number of clicks in this step, and finally, the touch control is displayed at the second position determined based on the second click hotspot in the following step 460. In this way, by counting the number of clicks on each candidate sub-region within the prediction area and determining the second click hotspot based on the number of clicks, it is possible to ensure that the determined second click hotspot is an area that the user frequently clicks when triggering a touch operation on the touch control. Accordingly, the second position is determined based on the second click hotspot, and the touch control is adjusted to be displayed at the second position, which can ensure that the adjusted touch control is more in line with the user's operating habits.

[0130] Step 460: Adjust the display position from the first position to a second position of the user interface based on the multiple touch operation positions, and display the touch control at the second position.

[0131] When the second position is determined based on the click rate, that is, when steps 442 to 444 are executed, the second position may be the center position of the first click hot zone; when the second position is determined based on the number of clicks, that is, when steps 446 to 448 are executed, the second position may be the center position of the second click hot zone.

[0132] Exemplarily, the terminal displays a position touch control at a second position of the user interface.

[0133] In some embodiments, if the number of invalid touch operations that fall within the predicted area but not on the touch control exceeds the first invalid threshold within a first time threshold, the second position determination process is triggered. The first time threshold is a preset time threshold, and the first invalid threshold is a preset click count threshold. That is, if the user's touch operation positions frequently fall around the touch control within a period of time, adaptive position adjustment of the touch control is initiated.

[0134] In some embodiments, within a second time threshold, if the distance between the center of multiple touch operation positions and the center of the touch control is greater than a second invalidation threshold, the second position determination process is triggered; the second time threshold is a preset time threshold, and the second invalidation threshold is a preset distance threshold. That is, if within a period of time, the user's high-frequency touch operation area is far from the center of the touch control, adaptive position adjustment of the touch control is initiated.

[0135] In this way, through the above-mentioned judgment mechanism, the display position of the touch control is adjusted in time according to the user's operating habits, so that the display position of the touch control adapts to the user's operating habits as quickly as possible.

[0136] In addition to adjusting the position of the touch control as described above, the size of the touch control can also be adjusted.

[0137] In some embodiments, the size of the touch control is adjusted based on the size and / or resolution of the user interface. For example, the ratio of the user interface size to a preset interface size is determined based on the size and / or resolution of the user interface, and the size of the touch control is adjusted based on the ratio. The preset interface can be, for example, a template interface set for the user interface when the application is developed.

[0138] In some embodiments, the size of the touch controls is adjusted based on the distance between adjacent touch controls. For example, if the distance between adjacent touch controls is less than a distance threshold, the touch controls are reduced in size; if the distance between adjacent touch controls is greater than the distance threshold, the touch controls are enlarged in size.

[0139] In some embodiments, the size of the touch control is adjusted based on the operation positions of multiple touch operations; or, the size of the touch control is adjusted based on the operation positions of invalid operations that fall outside the touch control but within the predicted area in multiple touch operations.

[0140] For example, the size of the touch control is adjusted based on the size of the click hot zone; the click hot zone is an area where the click rate and / or number of clicks reaches the click threshold, the click rate is determined based on the number of times the touch control falls into the click hot zone during multiple touch operations, and the click hot zone can specifically be the first click hot zone or the second click hot zone mentioned above. Optionally, the size of the click hot zone is used as the size of the touch control; or the size of the smallest circle including the click hot zone is determined as the size of the touch control; or the size of the smallest rectangle including the click hot zone is determined as the size of the touch control; or, if the size of the click hot zone is much smaller than the size of the touch control, the size of the touch control is reduced; or, if the size of the click hot zone is similar to that of the touch control, the size of the touch control is appropriately increased, and so on.

[0141] For another example, the size of the touch control can be adjusted based on the location of invalid operations that fall within the predicted area but not on the touch control. For example, the size of the touch control can be appropriately expanded based on the distribution of invalid operations to ensure that as many touch operations as possible fall within the valid area without affecting other touch controls.

[0142] In this way, through the above method, the size of the touch control is adjusted based on the size and / or resolution of the user interface, the distance between adjacent touch controls, or the operation position of multiple touch operations, so that the size of the touch control can be adapted to the user interface and / or user operation habits, thereby making it more convenient for users to trigger accurate operations on the touch control.

[0143] In some embodiments, after the touch control is resized based on the operating positions of multiple touch operations, the click threshold (such as the first threshold or the second threshold described above) used to measure the click hotspot is adjusted based on the distance between adjacent touch controls. For example, if the distance between the resized touch control and the adjacent touch control is less than the distance threshold, the click threshold is increased; if the distance between the resized touch control and the adjacent touch control is greater than the distance threshold, the click threshold is decreased. In this way, by adjusting the click threshold, the adjustment of the display position of the touch control is limited, avoiding frequent adjustments to the display position of the touch control affecting the use of other adjacent touch controls.

[0144] In addition to adjusting the size of the touch control, you can also adjust transparency to ensure that the touch control displayed in the second position does not obstruct the virtual character in the user interface. The virtual character is a character in the three-dimensional virtual world. When determining the display position of the virtual character on the user interface, it is necessary to map the virtual character model onto the imaging plane of the two-dimensional virtual screen and then calculate the intersection with the display area of ​​the touch control to determine whether obstruction occurs.

[0145] In some embodiments, when a touch control obscures a virtual character in a user interface, the touch control is reduced in size; or, when a touch control obscures a virtual character in a user interface, the touch control is displayed in a semi-transparent manner; or, when a touch control obscures a virtual character in a user interface, only the outline of the touch control is displayed.

[0146] In some embodiments, when the touch control is reduced to the minimum size but still obscures the virtual character, the touch control is displayed in a semi-transparent manner; or, when the touch control is reduced to the minimum size but still obscures the virtual character, only the outline of the touch control is displayed.

[0147] In this way, through the above method, the display mode of the touch control is adjusted according to the relationship between the touch control and the virtual character, so as to avoid the display of the touch control from blocking the virtual character, thereby improving the user experience of the application.

[0148] To sum up, the method provided in this embodiment adjusts the position of the touch control to the click hot zone, that is, the user's high-frequency click area, so that the layout of the touch control is more in line with the user's usage habits, improves the convenience of operation, optimizes the layout of the touch control on the user interface, and enhances the user experience.

[0149] In addition, the method provided in this embodiment sets candidate sub-regions in the prediction region in a static or dynamic manner, and can flexibly select candidate sub-regions based on a preset method or the landing point of the touch operation, thereby improving the accuracy and efficiency of determining the second position.

[0150] In addition, the method provided in this embodiment adjusts the size of the touch control so as to maximize the use of the user interface space without affecting the use of other touch controls, thereby improving the efficiency of touch control use and optimizing the user experience.

[0151] In the exemplary embodiment shown in FIG5 , the second position is determined by the terminal or a client running on the terminal; in addition, the second position may also be determined by the server, and this method is demonstrated through the following embodiments.

[0152] FIG7 is a flow chart of a method for displaying a touch control provided by an exemplary embodiment of the present application. The method can be executed by a terminal in the system shown in FIG3 or a client on the terminal. The method includes:

[0153] Step 320: Using the first position of the user interface as the display position of the touch control, and displaying the touch control;

[0154] The user interface is an interface for users to interact with the terminal or the client on the terminal.

[0155] The first position refers to the location of the touch control before it is adjusted. For example, on the initial interface of a game, the first position of the touch control is determined according to the system's preset layout; or, if the user customizes the layout of the touch controls on the user interface, the first position of the touch control is determined according to the customized layout.

[0156] Exemplarily, the first position of the touch control is determined according to a default setting of the system or a customized setting of the user; and the touch control is displayed at the first position of the user interface.

[0157] Step 330: receiving a plurality of touch operation instructions generated by performing a plurality of touch operations on the touch control; determining a plurality of touch operation positions on the user interface corresponding to the plurality of touch operation instructions;

[0158] A touch operation refers to an operation triggered by a touch control, which can be at least one of a click operation, a long press operation, a drag operation, a double-click operation, a voice operation, a pressure touch operation, an eye control, and a somatosensory control. This application does not limit this. A touch operation instruction is a computer instruction generated by the terminal in response to a touch operation triggered by the user. The terminal needs to perform the relevant operation based on the touch operation instruction. The touch operation instruction can indicate the control position of the corresponding touch operation in the user interface, that is, the touch operation position.

[0159] A touch operation on a touch control means that the target object of the touch operation is the touch control, but the touch operation may not necessarily fall accurately on the touch control; that is, the touch operation on the touch control includes touch operations falling on the touch control and touch operations falling around the touch control.

[0160] In some embodiments, a predicted area for a touch control is set. The predicted area is a pre-predicted area where a touch operation on the touch control is likely to fall. In this embodiment of the present application, any touch operation that falls within the predicted area of ​​the touch control will be considered an operation on the touch control and will be recorded accordingly to provide a reference for subsequent adjustment of the display position of the touch control. That is, the multiple touch operations on the touch control are all touch operations that fall within the predicted area of ​​the touch control. The predicted area is an area in the user interface that includes the touch control and is larger than the touch control. Optionally, the predicted area does not cover areas of other touch controls. In actual applications, the touch operation triggered by the user on the touch control may fall outside the touch control in the predicted area. When many touch operations triggered by the user on the touch control fall outside the touch control in the predicted area, it can be considered that the display position of the touch control does not conform to the user's operating habits. In this case, the display position of the touch control can be adjusted based on the touch operation positions of the multiple touch operations triggered by the user on the touch control so that the adjusted position conforms to the user's operating habits.

[0161] Step 340: Sending an operation record indicating the multiple touch operation positions to a server;

[0162] Exemplarily, after receiving multiple touch operation instructions generated by multiple touch operations on a touch control, the terminal sends an operation record containing the touch operation positions corresponding to each of the multiple touch operation instructions to the server. The operation record includes the operation positions of the multiple touch operations, such as the click position of a click operation.

[0163] Step 350: Receive second location information sent by the server;

[0164] The second position information is used to indicate the second position of the touch control after the position adjustment. The second position information is the coordinates of the second position; or the second position information is the offset data of the second position relative to the first position.

[0165] Exemplarily, after the server determines the second position according to the touch operation positions of the multiple touch operations, the server includes the second position in second position information and sends it to the terminal. The terminal receives the second position information sent by the server.

[0166] In some embodiments, the terminal receives second position information sent by the server, and the second position information is used to indicate the second position. The second position information is determined by the server based on the operation record of the touch operation position for indicating multiple touch operations, that is, the server can determine the click rate of each candidate sub-area in the predicted area based on the touch operation position that falls into the predicted area among the multiple touch operation positions; the candidate sub-area whose click rate reaches the first threshold is determined as the first click hot zone. The predicted area is an area in the user interface that includes touch controls and has an area larger than the touch controls. The way in which the server specifically determines the first click hot zone based on the click rate is similar to the way in which the terminal determines the first click hot zone based on the click rate described above. For details, please refer to the relevant introduction above.

[0167] In other embodiments, the terminal receives second position information sent by the server, and the second position information is used to indicate the second position. The second position information is determined by the server based on the operation record of the touch operation position for indicating multiple touch operations, that is, the server can determine the number of clicks for each candidate sub-area in the predicted area based on the touch operation position that falls into the predicted area among the multiple touch operation positions; the candidate sub-area whose click count reaches the second threshold is determined as the second click hot zone. The predicted area is an area in the user interface that includes touch controls and has an area larger than the touch controls. The way in which the server specifically determines the second click hot zone based on the number of clicks is similar to the way in which the terminal determines the second click hot zone based on the number of clicks described above. For details, please refer to the relevant introduction above.

[0168] Step 360: Adjust the display position from the first position to a second position of the user interface based on the multiple touch operation positions, and display the touch control at the second position.

[0169] Exemplarily, the terminal determines the second position according to the received second position information; and displays the touch control after position adjustment at the second position of the user interface.

[0170] In summary, the method provided in this embodiment, through the server determining the adjusted display position of the touch control based on the touch operation position of multiple touch operations, can reduce the processing pressure on the terminal, reduce terminal resource consumption, and avoid affecting other services on the terminal. Furthermore, by adjusting the position of the touch control to the click hot zone, that is, the user's high-frequency click area, the layout of the touch control is more consistent with the user's usage habits, improving the convenience of operation, optimizing the layout of the touch control on the user interface, and enhancing the user experience.

[0171] FIG8 is a flow chart of a method for displaying a touch control provided by an exemplary embodiment of the present application. The method may be executed by a server in the system shown in FIG3 . The method includes:

[0172] Step 520: receiving an operation record sent by the terminal indicating multiple touch operation positions;

[0173] The above-mentioned multiple touch operation positions correspond to multiple touch operation instructions respectively, and the multiple touch operation instructions are generated by performing multiple touch operations on the touch control. Touch operation refers to the operation triggered on the touch control, which can be at least one of a click operation, a long press operation, a drag operation, a double-click operation, a voice operation, a pressure touch operation, an eye control, and a somatosensory control. This application does not limit this. The touch operation instruction is a computer instruction generated by the terminal in response to the touch operation triggered by the user, and the terminal needs to perform related operations based on the touch operation instruction. The touch operation instruction can indicate the control position of the corresponding touch operation in the user interface, that is, the touch operation position.

[0174] A touch operation on a touch control refers to a touch operation whose target object is the touch control, but the touch operation may not necessarily fall precisely on the touch control; that is, a touch operation on a touch control includes touch operations on the touch control as well as touch operations around the touch control. For example, a server receives an operation record sent by a terminal that indicates the locations of multiple touch operations. The operation record may also indicate the operation time, operation type, and other information of the multiple touch operations.

[0175] Step 540: Determine a second position of the touch control in the user interface based on the multiple touch operation positions;

[0176] The second position is obtained by adjusting the first position based on multiple touch operation positions, and the first position is the display position of the above-mentioned touch control in the user interface before the position adjustment; that is, the second position is obtained by adjusting the first position where the touch control was originally displayed based on the operation positions of multiple touch operations, and the first position is the position of the touch control before the position adjustment.

[0177] In some embodiments, the second position is determined based on the first click hotspot, and may be, for example, the center of the first click hotspot. The first click hotspot is an area where the click rate reaches a first threshold, and the click rate of the first click hotspot is determined based on the number of touch operation positions that fall within the first click hotspot among the multiple touch operation positions.

[0178] Exemplarily, based on the touch operation positions that fall into the prediction area among multiple touch operation positions, the click rate of each candidate sub-area in the prediction area is determined, and the prediction area is an area in the user interface that includes touch controls and has an area larger than the touch controls; the candidate sub-area whose click rate reaches a first threshold is determined as the first click hot zone.

[0179] In this way, by statistically analyzing the click rates of each candidate sub-area in the prediction area and determining the first click hot zone based on the click rate, it can be ensured that the determined first click hot zone is the area that the user frequently clicks when triggering a touch operation on the touch control. Accordingly, the second position is determined based on the first click hot zone, and the touch control is adjusted to be displayed at the second position, which can ensure that the adjusted touch control is more in line with the user's operating habits.

[0180] In some embodiments, the second position is determined based on the second click hot zone, for example, it can be the center position of the second click hot zone, the second click hot zone is the area where the number of clicks reaches the second threshold, and the number of clicks in the second click hot zone is the number of multiple touch operation positions belonging to the second click hot zone among multiple touch operation positions.

[0181] Exemplarily, based on the touch operation positions that fall into the predicted area among multiple touch operation positions, the number of clicks for each candidate sub-area in the predicted area is determined, where the predicted area is an area in the user interface that includes touch controls and has an area larger than the touch controls; the candidate sub-area whose number of clicks reaches a second threshold is determined as a second click hot zone.

[0182] In this way, by counting the number of clicks on each candidate sub-area in the predicted area and determining the second click hot zone based on the number of clicks, it can be ensured that the determined second click hot zone is the area that the user frequently clicks when triggering a touch operation on the touch control. Accordingly, the second position is determined based on the second click hot zone, and the touch control is adjusted to be displayed at the second position, which can ensure that the adjusted touch control is more in line with the user's operating habits.

[0183] In some embodiments, a predicted area is set for a touch control. The predicted area is a pre-predicted area where a touch operation on the touch control may fall. The predicted area is an area in the user interface that includes the touch control and is larger than the touch control. In the embodiments of the present application, any touch operation that falls within the predicted area of ​​the touch control will be considered a touch operation on the touch control and will be recorded accordingly to provide a reference for subsequent adjustment of the display position of the touch control. That is, the multiple touch operations on the touch control are all touch operations that fall within the predicted area of ​​the touch control. Optionally, the predicted area does not cover the areas of other touch controls. In actual applications, the touch operation triggered by the user on the touch control may fall outside the touch control in the predicted area. When many touch operations triggered by the user on the touch control fall outside the predicted area, it can be considered that the display position of the touch control does not conform to the user's operating habits. In this case, the display position of the touch control can be adjusted based on the touch operation positions of the multiple touch operations triggered by the user on the touch control so that the adjusted position conforms to the user's operating habits.

[0184] In some embodiments, the prediction area is divided into a plurality of candidate sub-areas. The candidate sub-areas are arranged in any of the following ways: dividing the prediction area into a plurality of non-overlapping rectangular candidate sub-areas; dividing the prediction area into a plurality of non-overlapping sector-shaped candidate sub-areas; setting a plurality of circular candidate sub-areas with the same radius and partially overlapping in the prediction area with the center of the prediction area as a reference position; setting a plurality of circular candidate sub-areas with the same radius and partially overlapping in the prediction area with the center of the touch control as a reference position; and setting a plurality of circular candidate sub-areas with the same radius in the prediction area with the operation position of each touch operation as the center.

[0185] Figure 6 shows a schematic diagram of setting multiple candidate sub-regions in the prediction area. In (a), taking the prediction area as a rectangle as an example, the tic-tac-toe grid segmentation method is used to divide the prediction area into multiple non-overlapping rectangular candidate sub-regions. In (b), taking the prediction area as a circle as an example, the fan-shaped segmentation method is used to divide the prediction area into multiple non-overlapping fan-shaped candidate sub-regions. In (c), the dotted circle indicates the touch control, the rectangular frame indicates the prediction area, and the solid circle indicates the candidate sub-region; with the center of the prediction area (i.e., the rectangular frame) as the reference position, multiple circular candidate sub-regions with the same radius and partially overlapping are set in the prediction area. In (d), the dotted circle indicates the touch control, the rectangular frame indicates the prediction area, and the solid circle indicates the candidate sub-region; with the center of the touch control (i.e., the dotted circle) as the reference position, multiple circular candidate sub-regions with the same radius and partially overlapping are set in the prediction area. If the set candidate sub-region exceeds the prediction area, only valid operation records falling within the prediction area are counted, and invalid operation records outside the prediction area are ignored.

[0186] In addition, the methods (a) and (b) in FIG6 can also be implemented as partially overlapping candidate sub-regions, and the methods (c) and (d) can also be implemented as non-overlapping candidate sub-regions. This application does not impose any restrictions on this.

[0187] In addition to the method of setting candidate sub-regions shown in FIG6 , candidate sub-regions can also be dynamically set based on the user's touch operation. For example, multiple circular candidate sub-regions with the same radius or multiple rectangular candidate sub-regions of the same size can be set in the prediction area with the operation location of each touch operation as the center.

[0188] By setting the candidate sub-regions described above, the distribution of operation records within the prediction region during multiple touch operations can be determined, namely, the number of operation records at different locations within the prediction region. This facilitates the calculation of click rates or click counts for different candidate sub-regions within the prediction region, thereby more accurately determining the first or second click hotspots.

[0189] In some embodiments, if the number of invalid touch operations that fall within the predicted area but not on the touch control within a first time threshold exceeds the first invalid threshold, the second position determination process is triggered. The first time threshold is a preset time threshold, and the first invalid threshold is a preset click count threshold. That is, if the user's touch operation positions frequently fall around the touch control within a period of time, adaptive position adjustment of the touch control is initiated.

[0190] In some embodiments, within a second time threshold, if the distance between the center of multiple touch operation positions and the center of the touch control is greater than a second invalidation threshold, the second position determination process is triggered; the second time threshold is a preset time threshold, and the second invalidation threshold is a preset distance threshold. That is, if the user's high-frequency touch operation area is far from the center of the touch control within a period of time, adaptive position adjustment of the touch control is initiated.

[0191] In this way, through the above-mentioned judgment mechanism, the display position of the touch control is adjusted in time according to the user's operating habits, so that the display position of the touch control adapts to the user's operating habits as quickly as possible.

[0192] In addition to adjusting the position of the touch control as described above, the size of the touch control can also be adjusted.

[0193] In some embodiments, the size of the touch control is adjusted based on the size and / or resolution of the user interface. For example, based on the size and / or resolution of the user interface, a ratio of the user interface to a preset interface size is determined; and the size of the touch control is adjusted based on the ratio.

[0194] In some embodiments, the size of a touch control is adjusted based on the distance between adjacent touch controls. For example, if the distance between a touch control and its adjacent touch controls is less than a distance threshold, the touch control is reduced; if the distance between a touch control and its adjacent touch controls is greater than the distance threshold, the touch control is enlarged.

[0195] In some embodiments, the size of the touch control is adjusted based on the operation positions of multiple touch operations; or, the size of the touch control is adjusted based on the operation positions of invalid operations that fall outside the touch control but within the predicted area in multiple touch operations.

[0196] For example, the size of the touch control is adjusted based on the size of the click hot zone; the click hot zone is an area where the click rate and / or number of clicks reaches a click threshold, the click rate is determined based on the number of touch operations that fall into the click hot zone in multiple touch operations, and the click hot zone can specifically be the first click hot zone or the second click hot zone mentioned above. Optionally, the size of the click hot zone is used as the size of the touch control; or the size of the smallest circle including the click hot zone is determined as the size of the touch control; or the size of the smallest rectangle including the click hot zone is determined as the size of the touch control; or, if the size of the click hot zone is much smaller than the size of the touch control, the size of the touch control is reduced; or, if the size of the click hot zone is similar to that of the touch control, the size of the touch control is appropriately expanded, and so on.

[0197] For another example, the size of the touch control can be adjusted based on the location of invalid operations that fall within the predicted area but not on the touch control. For example, the size of the touch control can be appropriately expanded based on the distribution of invalid operations to ensure that as many touch operations as possible fall within the valid area without affecting other touch controls.

[0198] In some embodiments, after the touch control is resized based on the operating positions of multiple touch operations, the click threshold is adjusted based on the distance between adjacent touch controls. The click threshold can be a click threshold used to trigger determination of the second position, or a click threshold used to determine a click hotspot. For example, if the distance between the resized touch control and its adjacent touch controls is less than a distance threshold, the click threshold is increased; if the distance between the resized touch control and its adjacent touch controls is greater than the distance threshold, the click threshold is decreased.

[0199] In addition to adjusting the size of the touch control, you can also adjust the transparency of the touch control so that it does not obstruct the user interface. For example, if the touch control obstructs the virtual character in the user interface, the touch control can be reduced in size; or, if the touch control obstructs the virtual character in the user interface, the touch control can be displayed in a semi-transparent manner; or, if the touch control obstructs the virtual character in the user interface, only the outline of the touch control can be displayed.

[0200] In some embodiments, when the touch control is reduced to the minimum size but still obscures the virtual character, the touch control is displayed in a semi-transparent manner; or, when the touch control is reduced to the minimum size but still obscures the virtual character, only the outline of the touch control is displayed.

[0201] Step 560: Send second position information indicating the second position to the terminal to instruct the terminal to display the touch control at the second position.

[0202] Exemplarily, after determining the second position of the touch control, the server sends second position information indicating the second position to the terminal, instructing the terminal to display the touch control at the second position. The second position information is the coordinates of the second position or the offset between the second position and the first position; the first position refers to the position of the touch control before the position adjustment.

[0203] In some embodiments, the server further sends size information of the touch control to the terminal.

[0204] In summary, the method provided in the embodiments of the present application, through the server determining the adjusted display position of the touch control based on the touch operation positions of multiple touch operations, can reduce the processing pressure on the terminal, reduce the terminal's resource consumption, and avoid affecting the operation of other services on the terminal. Furthermore, based on the terminal's multiple touch operation positions for the touch control, the second position of the touch control is determined, allowing the touch control to be adjusted based on the user's high-frequency click areas, thereby improving the efficiency of touch control use, optimizing the layout of the user interface, and enhancing the user experience.

[0205] FIG9 is a flow chart of a method for displaying a touch control provided by an exemplary embodiment of the present application. The method includes:

[0206] Step 601: Display the current control layout;

[0207] Exemplarily, a user interface is displayed; the current control layout is displayed on the user interface, that is, a touch control is displayed at the first position of the user interface.

[0208] Step 602: Determine whether the player has enabled the system's automatic adjustment controls;

[0209] For example, the player is asked whether he agrees to enable the system to automatically adjust the touch control function. If yes, step 604 is executed; if no, step 603 is executed.

[0210] It should be noted that the user information and data involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions.

[0211] Step 603: Display the preset solution without dynamic adjustment;

[0212] If the player does not agree to enable the system's automatic adjustment of touch controls, the preset touch control layout will be displayed on the user interface, and no dynamic adjustment of the touch controls will be performed.

[0213] Step 604: The program presets the prediction area of ​​each key control;

[0214] If the player agrees to enable the system's automatic adjustment of touch controls, the application (e.g., a game application) presets a prediction area for each key touch control; the prediction area covers the touch control and is larger than the touch control. Key controls refer to touch controls that have important functions or may be used frequently when users perform operations.

[0215] For example, according to the screen resolution and ratio of the terminal, the screen area is divided into multiple rectangular areas, each rectangular area represents a hot zone, and is used to record the player's click position.

[0216] Step 605: Determine the frequency of player operation records;

[0217] Record touch operations that fall within the predicted area of ​​the touch control, and determine the distribution of operation frequencies based on the player's operation records. For example, each time a player clicks a touch control, the number of times the hot zone is clicked is recorded based on the hot zone where the click location is located.

[0218] For a high-frequency operation region, step 607 is executed; for a low-frequency operation region, step 606 is executed.

[0219] Step 606: The control position is not processed;

[0220] For touch controls on areas with low-frequency operation, their positions are not changed.

[0221] Alternatively, in another embodiment, the touch controls in the low-frequency operation area are adjusted to other areas without touch controls to release more space for the touch controls in the high-frequency operation area.

[0222] Step 607: Adjust the position of the control with the player's high-frequency click area as the center.

[0223] For touch controls in high-frequency operation areas, the high-frequency click area (i.e., click hot zone) for the touch control is determined based on the player's touch operation records, and the touch control is adjusted to the high-frequency click area to make the player's touch operation more accurate.

[0224] In some embodiments, adjustable customization options are provided. In order to meet the personalized needs of different players, adjustable customization options can be provided, allowing players to manually adjust the position of the touch controls to better suit their operating habits.

[0225] In some embodiments, the algorithm is continuously optimized and adjusted. To better adapt to players' operating habits and changes in game scenarios, the algorithm can be continuously optimized and adjusted. Based on player feedback and data analysis, the hot zone division and adaptive adjustment mechanism are continuously improved to enhance the player's gaming experience.

[0226] FIG10 is a schematic diagram of the interaction between a user interface (UI) layer, a client, and a server in a method for displaying a touch control provided by an exemplary embodiment of the present application.

[0227] The UI layer is the final experience layer, which players can perceive and interact with in real time. It generates visual representations of differentiated solutions based on front-end and back-end data processing. Players use the UI layer to interact with daily operations. In its initial state, the UI layer uses the system's preset layout.

[0228] The client is used to preset the predicted area of ​​the touch control and set the conditions for dynamic adjustment of the touch control, such as the click rate threshold. The client records the click location and frequency of the player's touch operation and feeds the operation record back to the server.

[0229] After receiving the operation record sent by the client, the server records the relevant data, summarizes the client's operation record, and feeds back instructions to the client based on preset conditions, that is, instructing the client to adjust the position of the touch control.

[0230] Finally, the client dynamically adjusts the position of the touch control in real time based on the server's feedback instructions and presents it in the UI layer.

[0231] FIG11 shows a schematic diagram of the structure of a display device for a touch control provided by an exemplary embodiment of the present application. The device can be implemented as all or part of a computer device through software, hardware, or a combination of both. The device includes:

[0232] A display module 720 is configured to use the first position of the user interface as the display position of the touch control to display the touch control;

[0233] The receiving module 740 is configured to receive a plurality of touch operation instructions generated by performing a plurality of touch operations on the touch control; and determine a plurality of touch operation positions on the user interface corresponding to the plurality of touch operation instructions;

[0234] The display module 720 is further configured to adjust the display position from the first position to a second position of the user interface based on the multiple touch operation positions, and display the touch control at the second position.

[0235] In one possible embodiment, the second position is determined based on a first click hot zone, where the first click hot zone is an area where the click rate reaches a first threshold, and the click rate of the first click hot zone is determined based on the number of touch operation positions among the multiple touch operation positions that fall into the first click hot zone.

[0236] In a possible embodiment, the display module 720 is also used to determine the click rate of each candidate sub-area in the predicted area based on the touch operation positions among the multiple touch operation positions that fall into the predicted area, and the predicted area is an area that includes the touch control and is larger than the touch control; and the candidate sub-area whose click rate reaches the first threshold is determined as the first click hot zone.

[0237] In one possible implementation, the apparatus further includes a sending module 760. The sending module 760 is configured to send an operation record indicating the multiple touch operation positions to a server; the receiving module 740 is configured to receive second position information sent by the server, where the second position information indicates the second position, and the second position information is determined by the server based on the operation record. The server is configured to determine a click rate for each candidate sub-region within the predicted region based on the touch operation positions among the multiple touch operation positions that fall within the predicted region, and determine the candidate sub-region whose click rate reaches the first threshold as the first click hot zone.

[0238] In one possible implementation, the second position is determined based on a second click hot zone, where the second click hot zone is an area where the number of clicks reaches a second threshold, and the number of clicks in the second click hot zone is the number of touch operation positions among the multiple touch operation positions that belong to the second click hot zone.

[0239] In a possible embodiment, the display module 720 is also used to determine the number of clicks for each candidate sub-area within the predicted area based on the touch operation positions among the multiple touch operation positions that fall within the predicted area, where the predicted area is an area that includes the touch control and is larger than the touch control; and determine the candidate sub-area whose number of clicks reaches the second threshold as the second click hot zone.

[0240] In a possible embodiment, the sending module 760 is used to send an operation record indicating the multiple touch operation positions to the server; the receiving module 740 is used to receive second position information sent by the server, the second position information is used to indicate the second position, and the second position information is determined by the server based on the operation record. The server is used to determine the number of clicks for each candidate sub-area in the predicted area based on the touch operation positions falling into the predicted area among the multiple touch operation positions, and determine the candidate sub-area whose number of clicks reaches the second threshold as the second click hot zone. The predicted area is an area in the user interface that includes the touch control and has an area larger than the touch control.

[0241] In a possible implementation manner, the second position information is the coordinates of the second position; or, the second position information is offset data of the second position relative to the first position.

[0242] In a possible embodiment, the candidate sub-areas are set in any one of the following ways: dividing the prediction area into multiple non-overlapping rectangular candidate sub-areas; dividing the prediction area into multiple non-overlapping sector-shaped candidate sub-areas; taking the center of the prediction area as the reference position, setting multiple circular candidate sub-areas with the same radius and partially overlapping in the prediction area; taking the center of the touch control as the reference position, setting multiple circular candidate sub-areas with the same radius and partially overlapping in the prediction area; taking each of the touch operation positions as the center, setting multiple circular candidate sub-areas with the same radius in the prediction area.

[0243] In a possible implementation, the display module 720 is further configured to adjust the size of the touch control based on the size and / or resolution of the user interface.

[0244] In one possible embodiment, the display module 720 is also used to adjust the size of the touch control based on the operation positions of the multiple touch operations; or, to adjust the size of the touch control based on the touch operation positions of invalid operations among the multiple touch operation positions that fall outside the touch control but belong to the predicted area; the predicted area is an area in the user interface that includes the touch control and has an area larger than the touch control.

[0245] FIG12 shows a schematic diagram of the structure of a display device for a touch control provided by an exemplary embodiment of the present application. The device can be implemented as all or part of a computer device through software, hardware, or a combination of both. The device includes:

[0246] A receiving module 820 is configured to receive an operation record sent by a terminal and indicating a plurality of touch operation positions, wherein the plurality of touch operation positions respectively correspond to a plurality of touch operation instructions, and the plurality of touch operation instructions are generated by performing a plurality of touch operations on the touch control;

[0247] a determination module 840 configured to determine a second position of the touch control in the user interface based on the multiple touch operation positions, where the second position is obtained by adjusting the first position based on the multiple touch operation positions, and the first position is a display position of the touch control in the user interface before the position adjustment;

[0248] The sending module 860 is configured to send second position information indicating the second position to the terminal, so as to instruct the terminal to display the touch control at the second position.

[0249] In one possible embodiment, the second position is determined based on a first click hot zone, where the first click hot zone is an area where the click rate reaches a first threshold, and the click rate of the first click hot zone is determined based on the number of touch operation positions among the multiple touch operation positions that fall into the first click hot zone.

[0250] In one possible embodiment, the determination module 840 is used to determine the click rate of each candidate sub-area in the prediction area based on the touch operation positions among the multiple touch operation positions that fall within the prediction area, where the prediction area is an area in the user interface that includes the touch control and has an area larger than the touch control; and determine the candidate sub-area whose click rate reaches the first threshold as the first click hot zone.

[0251] In one possible implementation, the second position is determined based on a second click hot zone, where the second click hot zone is an area where the number of clicks reaches a second threshold, and the number of clicks in the second click hot zone is the number of touch operation positions among the multiple touch operation positions that belong to the second click hot zone.

[0252] In one possible embodiment, the determination module 840 is used to determine the number of clicks for each candidate sub-area within the prediction area based on the touch operation positions among the multiple touch operation positions that fall within the prediction area, where the prediction area is an area in the user interface that includes the touch control and has an area larger than the touch control; and determine the candidate sub-area whose number of clicks reaches the second threshold as the second click hot zone.

[0253] FIG13 illustrates a block diagram of a computer device 1700 according to an exemplary embodiment of the present application. Computer device 1700 may be a portable mobile terminal, such as a smartphone, tablet computer, or MP3 (Moving Picture Experts Group Audio Layer III) or MP4 (Moving Picture Experts Group Audio Layer IV) player. Computer device 1700 may also be referred to as a user device, portable terminal, or other similar terminology.

[0254] Typically, the computer device 1700 includes a processor 1701 and a memory 1702 .

[0255] The processor 1701 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 1701 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field Programmable Gate Array), or PLA (Programmable Logic Array). The processor 1701 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 1701 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 1701 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0256] The memory 1702 may include one or more computer-readable storage media, which may be tangible and non-transitory. The memory 1702 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices and flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 1702 is used to store at least one instruction, which is executed by the processor 1701 to implement the display method of the touch control provided in the embodiment of the present application.

[0257] In some embodiments, the computer device 1700 may further include a peripheral device interface 1703 and at least one peripheral device. Specifically, the peripheral device may include at least one of a radio frequency circuit 1704 , a touch screen display 1705 , a camera assembly 1706 , an audio circuit 1707 , and a power supply 1708 .

[0258] The peripheral device interface 1703 can be used to connect at least one I / O (Input / Output)-related peripheral device to the processor 1701 and the memory 1702. In some embodiments, the processor 1701, the memory 1702, and the peripheral device interface 1703 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 1701, the memory 1702, and the peripheral device interface 1703 can be implemented on separate chips or circuit boards, which is not limited in this embodiment.

[0259] RF circuit 1704 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. RF circuit 1704 communicates with communication networks and other communication devices via electromagnetic signals. RF circuit 1704 selects electrical signals for transmission as electromagnetic signals, or selects received electromagnetic signals for transmission as electrical signals. RF circuit 1704 optionally includes an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. RF circuit 1704 can communicate with other terminals via at least one wireless communication protocol. Such wireless communication protocols include, but are not limited to, the World Wide Web, metropolitan area networks, intranets, various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and / or WiFi (Wireless Fidelity) networks. In some embodiments, RF circuit 1704 may also include circuitry related to Near Field Communication (NFC), although this application does not limit this.

[0260] The touchscreen display 1705 is used to display a user interface (UI). This UI can include graphics, text, icons, videos, or any combination thereof. The touchscreen display 1705 is also capable of collecting touch signals on or above the surface of the touchscreen display 1705. These touch signals can be input as control signals to the processor 1701 for processing. The touchscreen display 1705 is used to provide virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, there can be a single touchscreen display 1705, located on the front panel of the computer device 1700. In other embodiments, there can be at least two touchscreen displays 1705, located on different surfaces of the computer device 1700 or in a foldable design. In some embodiments, the touchscreen display 1705 can be a flexible display, located on a curved or foldable surface of the computer device 1700. Furthermore, the touchscreen display 1705 can be configured as a non-rectangular, irregular shape, also known as a special-shaped screen. The touchscreen display 1705 can be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).

[0261] The camera assembly 1706 is used to capture images or videos. Optionally, the camera assembly 1706 includes a front camera and a rear camera. Typically, the front camera is used to enable video calls or selfies, and the rear camera is used to enable photo or video shooting. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth of field camera, and a wide-angle camera, so as to realize the fusion of the main camera and the depth of field camera to realize the background blur function, and the fusion of the main camera and the wide-angle camera to realize panoramic shooting and VR (Virtual Reality) shooting function. In some embodiments, the camera assembly 1706 may also include a flash. The flash can be a monochrome temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which can be used for light compensation at different color temperatures.

[0262] Audio circuit 1707 provides an audio interface between the user and computer device 1700. Audio circuit 1707 may include a microphone and a speaker. The microphone collects sound waves from the user and the environment and converts them into electrical signals for input to processor 1701 for processing, or to RF circuit 1704 for voice communication. For stereo sound acquisition or noise reduction, multiple microphones may be provided, located in different locations within computer device 1700. The microphone may also be an array microphone or an omnidirectional microphone. The speaker converts electrical signals from processor 1701 or RF circuit 1704 into sound waves. The speaker may be a traditional thin-film speaker or a piezoelectric ceramic speaker. A piezoelectric ceramic speaker can convert electrical signals not only into audible sound waves but also into inaudible sound waves for purposes such as distance measurement. In some embodiments, audio circuit 1707 may also include a headphone jack.

[0263] Power supply 1708 is used to power various components in computer device 1700. Power supply 1708 can be AC ​​power, DC power, a disposable battery, or a rechargeable battery. When power supply 1708 includes a rechargeable battery, the rechargeable battery can be wired or wirelessly rechargeable. A wired rechargeable battery is charged via a wired line, while a wireless rechargeable battery is charged via a wireless coil. The rechargeable battery can also support fast charging technology.

[0264] In some embodiments, the computer device 1700 further includes one or more sensors 1709 , including but not limited to an acceleration sensor 1710 , a gyroscope sensor 1711 , a pressure sensor 1712 , an optical sensor 1713 , and a proximity sensor 1714 .

[0265] The accelerometer 1710 can detect the magnitude of acceleration along the three coordinate axes of the coordinate system established by the computer device 1700. For example, the accelerometer 1710 can be used to detect the components of gravity acceleration along the three coordinate axes. The processor 1701 can control the touch screen display 1705 to display the user interface in a landscape or portrait view based on the gravity acceleration signal collected by the accelerometer 1710. The accelerometer 1710 can also be used to collect game or user motion data.

[0266] The gyroscope sensor 1711 can detect the orientation and rotation angle of the computer device 1700. It can also work with the accelerometer 1710 to collect 3D motions of the user on the computer device 1700. Based on the data collected by the gyroscope sensor 1711, the processor 1701 can implement the following functions: motion sensing (e.g., changing the UI based on the user's tilt), image stabilization during shooting, game control, and inertial navigation.

[0267] Pressure sensor 1712 can be installed on the side frame of computer device 1700 and / or below touch screen display 1705. When pressure sensor 1712 is installed on the side frame of computer device 1700, it can detect the user's grip signal of computer device 1700 and perform left-hand recognition or shortcut operations based on the grip signal. When pressure sensor 1712 is installed below touch screen display 1705, it can control the operational controls on the UI interface based on the user's pressure operation on touch screen display 1705. Operational controls include at least one of button controls, scroll bar controls, icon controls, and menu controls.

[0268] Optical sensor 1713 is used to detect ambient light intensity. In one embodiment, processor 1701 can control the display brightness of touchscreen display 1705 based on the ambient light intensity detected by optical sensor 1713. Specifically, when the ambient light intensity is high, the display brightness of touchscreen display 1705 is increased; when the ambient light intensity is low, the display brightness of touchscreen display 1705 is decreased. In another embodiment, processor 1701 can also dynamically adjust the shooting parameters of camera assembly 1706 based on the ambient light intensity detected by optical sensor 1713.

[0269] Proximity sensor 1714, also known as a distance sensor, is typically located on the front of computer device 1700. Proximity sensor 1714 is used to detect the distance between the user and the front of computer device 1700. In one embodiment, when proximity sensor 1714 detects that the distance between the user and the front of computer device 1700 is gradually decreasing, processor 1701 controls touchscreen display 1705 to switch from the screen-on state to the screen-off state. When proximity sensor 1714 detects that the distance between the user and the front of computer device 1700 is gradually increasing, processor 1701 controls touchscreen display 1705 to switch from the screen-off state to the screen-on state.

[0270] Those skilled in the art will appreciate that the structure shown in FIG. 13 does not limit the computer device 1700 , and may include more or fewer components than shown, or combine certain components, or adopt a different component arrangement.

[0271] Figure 14 is a schematic diagram illustrating the structure of a server according to an exemplary embodiment. The server 1300 includes a central processing unit (CPU) 1301, a system memory 1304 including a random access memory (RAM) 1302 and a read-only memory (ROM) 1303, and a system bus 1305 connecting the system memory 1304 and the CPU 1301. The computer device 1300 also includes a basic input / output system (I / O system) 1306 for facilitating information transmission between various components within the computer device, and a mass storage device 1307 for storing an operating system 1313, application programs 1314, and other program modules 1315.

[0272] The basic input / output system 1306 includes a display 1308 for displaying information and an input device 1309, such as a mouse or keyboard, for user input. Both the display 1308 and the input device 1309 are connected to the central processing unit 1301 via an input / output controller 1310 connected to the system bus 1305. The basic input / output system 1306 may also include an input / output controller 1310 for receiving and processing input from a variety of other devices, such as a keyboard, mouse, or electronic stylus. Similarly, the input / output controller 1310 also provides output to a display screen, printer, or other types of output devices.

[0273] The mass storage device 1307 is connected to the central processing unit 1301 via a mass storage controller (not shown) connected to the system bus 1305. The mass storage device 1307 and its associated computer-readable medium provide non-volatile storage for the computer device 1300. In other words, the mass storage device 1307 may include computer-readable media (not shown) such as a hard disk or a CD-ROM drive.

[0274] Without loss of generality, the computer device readable medium may include computer device storage media and communication media. Computer device storage media include volatile and non-volatile, removable and non-removable media implemented by any method or technology for storing information such as computer device readable instructions, data structures, program modules or other data. Computer device storage media include RAM, ROM, Erasable Programmable Read Only Memory (EPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), CD-ROM, Digital Video Disc (DVD) or other optical storage, tape cassettes, magnetic tapes, disk storage or other magnetic storage devices. Of course, those skilled in the art will appreciate that the computer device storage media are not limited to the above-mentioned ones. The above-mentioned system memory 1304 and mass storage device 1307 can be collectively referred to as memory.

[0275] According to various embodiments of the present disclosure, the server 1300 may also be connected to a remote computer device on a network such as the Internet for operation. That is, the computer device 1300 may be connected to the network 1311 via the network interface unit 1312 connected to the system bus 1305, or the network interface unit 1312 may be used to connect to other types of networks or remote computer device systems (not shown).

[0276] The memory also includes one or more programs, which are stored in the memory. The central processing unit 1301 implements all or part of the steps of the above-mentioned touch control display method by executing the one or more programs.

[0277] An embodiment of the present application also provides a computer device, which includes: a processor and a memory, wherein at least one computer program is stored in the memory, and the at least one computer program is loaded and executed by the processor to implement the display method of the touch control provided by the above-mentioned method embodiments.

[0278] An embodiment of the present application also provides a computer storage medium, in which at least one computer program is stored. The at least one computer program is loaded and executed by a processor to implement the display method of the touch control provided by the above-mentioned method embodiments.

[0279] An embodiment of the present application also provides a computer program product, which includes a computer program stored in a computer-readable storage medium; the computer program is read and executed from the computer-readable storage medium by a processor of a computer device, so that the computer device executes the display method of the touch control provided by the above-mentioned method embodiments.

[0280] It should be understood that the term "plurality" used herein refers to two or more. "And / or" describes a relationship between associated objects, indicating that three possible relationships exist. For example, "A and / or B" can mean: A exists alone, A and B exist simultaneously, or B exists alone. The character " / " generally indicates an "or" relationship between the associated objects.

[0281] Those skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware, or by a program to instruct the relevant hardware, and the program may be stored in a computer-readable storage medium, which may be a read-only memory, a disk, or an optical disk, etc.

[0282] The above description is merely an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent switches, improvements, etc. made within the spirit and principles of the present application shall be included in the scope of protection of the present application.

Claims

1. A method for displaying a touch control, the method being executed by a terminal, the method comprising: Using the first position of the user interface as the display position of the touch control, and displaying the touch control; Receiving a plurality of touch operation instructions generated by performing a plurality of touch operations on the touch control; Determine a plurality of touch operation positions on the user interface corresponding to the plurality of touch operation instructions respectively; The display position is adjusted from the first position to a second position of the user interface based on the multiple touch operation positions, and the touch control is displayed at the second position.

2. According to the method according to claim 1, the second position is determined based on a first click hot zone, the first click hot zone is an area where the click rate reaches a first threshold, and the click rate of the first click hot zone is determined based on the number of touch operation positions among the multiple touch operation positions that fall into the first click hot zone.

3. The method according to claim 1 or 2, further comprising: Determining a click rate of each candidate sub-region within the prediction region according to the touch operation position that falls within the prediction region among the multiple touch operation positions, wherein the prediction region is a region of the user interface that includes the touch control and has an area larger than the touch control; The candidate sub-region whose click rate reaches the first threshold is determined as the first click hot zone.

4. The method according to any one of claims 1 to 3, further comprising: Sending an operation record indicating the plurality of touch operation positions to a server; Receive second position information sent by the server, where the second position information is used to indicate the second position, and the second position information is determined by the server according to the operation record. The server is used to determine the click rate of each candidate sub-area in the prediction area according to the touch operation position that falls into the prediction area among the multiple touch operation positions, and determine the candidate sub-area whose click rate reaches the first threshold as the first click hot zone, and the prediction area is an area in the user interface that includes the touch control and has an area larger than the touch control.

5. According to the method described in any one of claims 1 to 4, the second position is determined based on a second click hot zone, the second click hot zone is an area where the number of clicks reaches a second threshold, and the number of clicks in the second click hot zone is the number of touch operation positions among the multiple touch operation positions belonging to the second click hot zone.

6. The method according to any one of claims 1 to 5, further comprising: Determining the number of clicks of each candidate sub-region within the prediction region according to the touch operation position among the multiple touch operation positions that falls within the prediction region, wherein the prediction region is a region of the user interface that includes the touch control and has an area larger than the touch control; The candidate sub-region whose click times reach the second threshold is determined as the second click hot zone.

7. The method according to any one of claims 1 to 6, further comprising: Sending an operation record indicating the plurality of touch operation positions to a server; Receive second location information sent by the server, where the second location information is used to indicate the second location, and the second location information is determined by the server based on the operation record. The server is used to determine the number of clicks for each candidate sub-area in the prediction area based on the touch operation position that falls into the prediction area among the multiple touch operation positions, and determine the candidate sub-area whose number of clicks reaches the second threshold as the second click hot zone, and the prediction area is an area in the user interface that includes the touch control and has an area larger than the touch control.

8. The method according to any one of claims 1 to 7, wherein the second position information is the coordinates of the second position; or The second position information is offset data of the second position relative to the first position.

9. According to the method according to any one of claims 1 to 8, the candidate sub-regions are set in any one of the following ways: Dividing the prediction area into a plurality of mutually non-overlapping rectangular candidate sub-areas; Dividing the prediction area into a plurality of non-overlapping sector-shaped candidate sub-areas; Taking the center of the prediction region as a reference position, setting a plurality of circular candidate sub-regions with the same radius and partially overlapping in the prediction region; Taking the center of the touch control as a reference position, setting a plurality of circular candidate sub-regions with the same radius and partially overlapping in the prediction region; Taking each of the touch operation positions as the center, a plurality of circular candidate sub-regions with the same radius are set in the prediction region.

10. The method according to any one of claims 1 to 9, further comprising: The touch control is resized based on the size and / or resolution of the user interface.

11. The method according to any one of claims 1 to 10, further comprising: Adjusting the size of the touch control based on the multiple touch operation positions; or, The size of the touch control is adjusted based on a touch operation position of an invalid operation among the multiple touch operation positions that falls outside the touch control but belongs to a predicted area; the predicted area is an area in the user interface that includes the touch control and has an area larger than the touch control.

12. A method for displaying a touch control, the method being executed by a server, the method comprising: Receiving an operation record sent by a terminal for indicating a plurality of touch operation positions, wherein the plurality of touch operation positions respectively correspond to a plurality of touch operation instructions, and the plurality of touch operation instructions are generated by performing a plurality of touch operations on the touch control; Determine a second position of the touch control in the user interface based on the multiple touch operation positions, wherein the second position is obtained by adjusting the first position based on the multiple touch operation positions, and the first position is a display position of the touch control in the user interface before the position adjustment; Second position information indicating the second position is sent to the terminal to instruct the terminal to display the touch control at the second position.

13. According to the method of claim 12, the second position is determined based on a first click hot zone, the first click hot zone is an area where the click rate reaches a first threshold, and the click rate of the first click hot zone is determined based on the number of touch operation positions among the multiple touch operation positions that fall into the first click hot zone.

14. The method according to claim 12 or 13, further comprising: Determining a click rate of each candidate sub-region within the prediction region according to the touch operation position that falls within the prediction region among the multiple touch operation positions, wherein the prediction region is a region of the user interface that includes the touch control and has an area larger than the touch control; The candidate sub-region whose click rate reaches the first threshold is determined as the first click hot zone.

15. According to the method described in any one of claims 12 to 14, the second position is determined based on a second click hot zone, the second click hot zone is an area where the number of clicks reaches a second threshold, and the number of clicks in the second click hot zone is the number of touch operation positions among the multiple touch operation positions belonging to the second click hot zone.

16. The method according to any one of claims 12 to 15, further comprising: Determining the number of clicks of each candidate sub-region within the prediction region according to the touch operation position among the multiple touch operation positions that falls within the prediction region, wherein the prediction region is a region of the user interface that includes the touch control and has an area larger than the touch control; The candidate sub-region whose click times reach the second threshold is determined as the second click hot zone.

17. A display device for a touch control, the device comprising: A display module, configured to use the first position of the user interface as the display position of the touch control to display the touch control; A receiving module, configured to receive a plurality of touch operation instructions generated by performing a plurality of touch operations on the touch control; and determine a plurality of touch operation positions on the user interface corresponding to the plurality of touch operation instructions; The display module is further used to adjust the display position from the first position to a second position of the user interface based on the multiple touch operation positions, and display the touch control at the second position.

18. A display device for a touch control, the device comprising: A receiving module, used for receiving an operation record sent by a terminal for indicating a plurality of touch operation positions, wherein the plurality of touch operation positions respectively correspond to a plurality of touch operation instructions, and the plurality of touch operation instructions are generated by performing a plurality of touch operations on the touch control; a determination module, configured to determine a second position of the touch control in the user interface based on the multiple touch operation positions, wherein the second position is obtained by adjusting the first position based on the multiple touch operation positions, and the first position is a display position of the touch control in the user interface before the position adjustment; A sending module is used to send second position information indicating the second position to the terminal, so as to instruct the terminal to display the touch control at the second position.

19. A computer device, comprising: A processor and a memory, wherein at least one computer program is stored in the memory, and at least one of the computer programs is loaded and executed by the processor to implement the display method of the touch control as described in any one of claims 1 to 11 or the display method of the touch control as described in any one of claims 12 to 16.

20. A computer storage medium, wherein at least one computer program is stored in the computer-readable storage medium, and the at least one computer program is loaded and executed by a processor to implement the display method of the touch control as described in any one of claims 1 to 11 or the display method of the touch control as described in any one of claims 12 to 16.

21. A computer program product, comprising a computer program, wherein the computer program is stored in a computer-readable storage medium; the computer program is read and executed from the computer-readable storage medium by a processor of a computer device, so that the computer device executes the display method of a touch control as described in any one of claims 1 to 11 or the display method of a touch control as described in any one of claims 12 to 16.