Touch control display methods, devices, equipment, and computer programs

The method and system adapt touch control positions in virtual environments based on user operation patterns, addressing inefficiencies in manual adjustment by aligning controls with high-frequency click areas, thus improving convenience and efficiency.

JP7910864B2Active Publication Date: 2026-08-25TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2025513438
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2023-04-17
Filing Date
2024-02-07
Publication Date
2026-08-25
Estimated Expiration
2044-02-07

AI Technical Summary

Technical Problem

Existing touch control display systems in virtual environments, such as multiplayer online role-playing games, require manual adjustment of touch control positions, leading to poor operational convenience and low adjustment efficiency due to the need for repeated switching between user interfaces.

Method used

A method and system that adjusts touch control display positions based on user operation patterns, determining high-frequency click areas and adapting touch control positions to match user habits by analyzing multiple touch operations and adjusting the display accordingly.

Benefits of technology

Improves operational convenience and efficiency by automatically aligning touch controls with user habits, optimizing their placement and reducing the need for manual adjustments, thereby enhancing the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007910864000001
    Figure 0007910864000001
  • Figure 0007910864000002
    Figure 0007910864000002
  • Figure 0007910864000003
    Figure 0007910864000003
Patent Text Reader

Abstract

This application discloses a touch control display method, device, equipment, and storage medium, belonging to the field of user interfaces. The method includes the steps of displaying a touch control at a first position on a user interface as a display position of the touch control, receiving a plurality of touch operation commands generated by performing a plurality of touch operations on the touch control, determining a plurality of touch operation positions on the user interface corresponding to the plurality of touch operation commands, and adjusting the display position from the first position to a second position on the user interface based on the plurality of touch operation positions, and displaying the touch control at the second position. This application provides a method for adjusting the display position of a touch control based on a plurality of touch operations on the touch control, thereby improving the use efficiency of the touch control and increasing the convenience of operation.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application claims the priority of a Chinese patent application filed with the China National Intellectual Property Administration on April 17, 2023, with the application number 2023104325779 and the application title "Touch Control Display Method, Device, Equipment and Storage Medium", and all its contents are incorporated herein by reference.

[0002] Embodiments of this application relate to the field of user interfaces, and particularly to touch control display technology.

Background Art

[0003] In a network game with a virtual environment, such as a multiplayer online role-playing game, a player controls one or more virtual characters to act in the virtual environment of the game.

[0004] In related technologies, virtual characters are controlled to act in a virtual environment by touching a plurality of touch controls displayed on a user interface. Generally, the display positions of the touch controls are defaulted and fixed, but players can adjust the display positions of the touch controls in a custom manner to suit their own operation habits.

[0005] Regarding the manual adjustment of the display positions of touch controls, since it has to be tried many times, players need to repeatedly switch between multiple user interfaces, resulting in poor operational convenience and low adjustment efficiency.

Summary of the Invention

Problems to be Solved by the Invention

[0006] This application provides a touch control display method, device, equipment and storage medium.

Means for Solving the Problems

[0007] The aforementioned technical proposal is as follows: According to one aspect of this application, a method for displaying touch controls performed by a terminal is provided, the method is: The steps include setting the first position of the user interface as the display position of the touch control and displaying the touch control, The steps include receiving multiple touch operation commands generated by performing multiple touch operations on the aforementioned touch control, The steps include determining a plurality of touch operation positions on the user interface corresponding to each of the plurality of touch operation commands, The process includes the steps of adjusting the display position from the first position to the second position of the user interface based on the plurality of touch operation positions, and displaying the touch control at the second position.

[0008] According to one aspect of this application, a method for displaying touch controls performed by a server is provided, the method is: A step of receiving an operation record transmitted from a terminal for indicating multiple touch operation locations, wherein each of the multiple touch operation locations corresponds to a plurality of touch operation commands, and the plurality of touch operation commands are generated by performing multiple touch operations on the touch control. A step of determining a second position of the touch control in the user interface based on the plurality of touch operation positions, wherein the second position is obtained by adjusting the first position based on the plurality of touch operation positions, and the first position is the display position of the touch control in the user interface before the position adjustment. The method includes the step of instructing the terminal to display the touch control at the second location by transmitting a second location information to the terminal for indicating the second location.

[0009] According to one aspect of this application, a touch control display device is provided, the device is The first position of the user interface is set as the display position of the touch control, and a display module for displaying the touch control is provided. The system includes a receiving module for receiving a plurality of touch operation commands generated by performing multiple touch operations on the touch control, and for determining a plurality of touch operation positions on the user interface corresponding to each of the plurality of touch operation commands, The display module further adjusts the display position from the first position to the second position of the user interface based on the plurality of touch operation positions, and displays the touch control at the second position.

[0010] According to one aspect of this application, a touch control display device is provided, the device is A receiving module for receiving operation records for instructing multiple touch operation locations transmitted from a terminal, wherein each of the multiple touch operation locations corresponds to a multiple touch operation command, and the multiple touch operation commands are generated by performing multiple touch operations on the touch control. A determination module for determining a second position of the touch control in a user interface based on the plurality of touch operation positions, wherein the second position is obtained by adjusting the first position based on the plurality of touch operation positions, and the first position is the display position of the touch control in the user interface before the position adjustment. The system includes a transmitting module for instructing the terminal to display the touch control at the second location by transmitting a second location information to the terminal for indicating the second location.

[0011] According to another aspect of this application, a computer device is provided, the computer device including a processor and memory, the memory storing at least one computer program, and the at least one computer program being read and executed by the processor, thereby realizing the touch control display method described above.

[0012] According to another aspect of this application, a computer storage medium is provided, wherein at least one computer program is stored in the computer-readable storage medium, and the at least one computer program is read and executed by a processor, thereby realizing the touch control display method described above.

[0013] According to another aspect of this application, a computer program product is provided, the computer program product includes a computer program, the computer program is stored in a computer-readable storage medium, and the computer program is read from the computer-readable storage medium and executed by the processor of a computer device, thereby causing the computer device to perform the touch control display method described in the above aspect. [Effects of the Invention]

[0014] The beneficial effects of the technical proposal provided in this application include at least the following: In the embodiment of this application, multiple touch operation commands generated by performing multiple touch operations on a touch control are received, the user interface determines the corresponding touch operation position for each of these multiple touch control commands, and further adjusts the display position of the touch control from a first position to a second position based on the multiple touch operation positions, and finally displays the touch control at the second position. In this way, the user determines the high-frequency click area of ​​the touch control based on the operation positions of multiple touch operations triggered by the user on the touch control, and further adjusts the display position of the touch control to the high-frequency click area by the user, thereby improving the convenience of operation by matching the placement of the touch control to the user's usage habits, optimizing the placement of touch controls on the user interface, enhancing the efficiency of touch control use, adaptively adjusting the position of the touch control based on the user's operation record, eliminating the need for multiple manual adjustments by the user, enhancing the convenience of touch control adjustment, improving the user experience, and increasing the efficiency of touch control adjustment. [Brief explanation of the drawing]

[0015] [Figure 1] This is a schematic diagram of the interface of a touch control display method provided in one exemplary embodiment of this application. [Figure 2] This is a schematic diagram of the interface of a touch control display method provided in one exemplary embodiment of this application. [Figure 3] This is a structural block diagram of a computer system provided by one exemplary embodiment of this application. [Figure 4] This is a flowchart of a method for displaying touch controls provided in one exemplary embodiment of this application. [Figure 5] This is a flowchart of a method for displaying touch controls provided in one exemplary embodiment of this application. [Figure 6]A schematic diagram of setting candidate sub - regions provided by one exemplary embodiment of the present application. [Figure 7] A flowchart of a touch control display method provided by one exemplary embodiment of the present application. [Figure 8] A flowchart of a touch control display method provided by one exemplary embodiment of the present application. [Figure 9] A flowchart of a touch control display method provided by one exemplary embodiment of the present application. [Figure 10] In the touch control display method provided by one exemplary embodiment of the present application, it is a schematic diagram of the interaction between the user interface layer, the client and the server. [Figure 11] A block diagram of a touch control display device provided by one exemplary embodiment of the present application. [Figure 12] A block diagram of a touch control display device provided by one exemplary embodiment of the present application. [Figure 13] A schematic diagram of the device structure of a computer device provided by one exemplary embodiment of the present application. [Figure 14] A schematic diagram of the device structure of a computer device provided by one exemplary embodiment of the present application.

Embodiments for Carrying out the Invention

[0016] For the purpose of making the objectives, technical solutions and advantages of the present application clearer, the embodiments of the present application will be described in more detail below in conjunction with the drawings.

[0017] First, some terms in the present application are interpreted. Operation Hotzone: An operation hotzone is a specific area on the screen where the user can perform certain actions, such as clicking or dragging. Operation hotzones are generally used to enhance the interactivity of the user interface and improve the user experience. On mobile devices, operation hotzones are typically designed as large buttons or gesture areas, making one-handed operation convenient for the user. Button Adaptive: Button adaptiveness automatically adjusts the size and placement of buttons on screens of different sizes and device types to suit different screen sizes and device types, thereby improving the user experience. Generally, button adaptiveness needs to be adjusted and placed accordingly based on the size and resolution of the device's screen. For example, on the screen of a small mobile device, buttons are made smaller and rearranged to suit the limited screen space. On a computer with a large screen, buttons are made larger and their pitch is increased to improve readability and ease of use. Button adaptiveness is an important design principle that helps designers and developers create more flexible user interfaces, improving user experience and satisfaction.

[0018] Figure 1 is a schematic diagram of a user interface for a method of displaying touch controls provided by one exemplary embodiment of the present application, the method being executed by a terminal, a client on the terminal, or a server, and in the schematic diagram, the client on the terminal is an example of a client of a game application. In Figure 1, the user interface is an example of a game application interface, and the touch controls are examples of controls operated and controlled by a virtual character in the game application, but in actual application, the user interface may be an interface of another application, and the touch controls may be controls in another application, and the embodiments of the present application are not limited to these.

[0019] As shown in Figure 1(a), the terminal displays the user interface 10 of the game application, which is the system's default touch control layout interface or a user-customized touch control layout interface. The user interface 10 displays a virtual character 12 and multiple touch controls, in which case each touch control is displayed in its corresponding first position, i.e., the position before self-adaptive adjustment, such as the touch control 11 on the left and the touch control 13 on the right.

[0020] For each touch control on the user interface 10, a prediction area for the touch control is set. The prediction area of ​​a touch control covers the display area of ​​the touch control and is larger than the display area of ​​the touch control. The prediction area records touch operations on the touch control; that is, any touch operation on the touch control that falls within the prediction area is recorded. As shown on the left side of Figure 1(b), a prediction area is set for each touch control on the user interface 10 (in the drawing, the prediction area is shown as a gray rectangle covering the touch control).

[0021] Using touch control 13 as an example, the setting method for its first position and prediction area is shown on the right side of drawing (b) in Figure 1. The circle 15 shows the abstract schematic shape of touch control 13 in the user interface 10. In the preset scheme, the distance from the leftmost position of touch control 13 (i.e., circle 15 in the drawing) to the left boundary of the user interface is set to 280 pixels, and a prediction area 16 is set for touch control 13, which includes the display area of ​​touch control 13 (i.e., circle 15 in the drawing) and is larger than the display area of ​​touch control 13.

[0022] During the user's gameplay, multiple touch operations on the touch control are recorded. That is, multiple touch operation commands generated by multiple touch operations on the touch control are received, and a second position corresponding to the touch control, i.e., the user's click hot zone for the touch control, is determined based on the corresponding touch operation position on the user interface for each of the multiple touch operation commands. For example, in Figure 1(c), multiple partially overlapping white circles on the touch control 13 indicate the anchor points of the user's touch operations on the touch control 13 (i.e., the touch operation positions of multiple touch operations by the user on the touch control 13), and the click hot zone, i.e., the high-frequency click area of ​​the touch control 13, is determined based on these multiple partially overlapping white circles. The right side of drawing (c) in Figure 1 shows an abstract schematic diagram, where the black solid circle 14 indicates the second position of the touch control 13 (i.e., circle 15 in the drawing), the position and size of the black solid circle 14 are determined based on the touch operation positions of multiple touch operations by the user on the touch control 13 (i.e., the multiple partially overlapping white circles), the two dotted lines in the drawing indicate the center line of the second position, i.e., the intersection of the two dotted lines is the center of the black solid circle 14 (center point of the click hot zone).

[0023] After determining a second position for the touch control 13 based on the positions of multiple touch operations performed by the user on the touch control 13, the display position of the touch control 13 is adjusted to the second position, thereby displaying the touch control 13 at the second position, for example, by determining the center of the second position to be the center of the touch control 13. The left side of Figure 1(d) shows the touch control 13 after position adjustment, and its center position is the center of the second position. The right side of Figure 1(d) shows an abstract schematic diagram of the position adjustment. After adjusting the position based on the second position, the touch control 13 (i.e., circle 15 in the diagram) is displayed at the position of circle 17, and the distance from the leftmost part of circle 17 to the left boundary of the user interface is 302 pixels. The prediction area is then redefined based on the new position of the touch control 13, as shown in the rectangular frame 18 in the diagram.

[0024] Figure 2 is a schematic diagram of a user interface for a method of displaying touch controls provided by another exemplary embodiment of the present application, the method being performed by a terminal, a client on the terminal, or a server, and in the schematic diagram, the client on the terminal is an example of a client of a game application. Here, in Figure 2, the user interface is an example of a game application interface, and the touch controls are examples of controls controlled by a virtual character in the game application, but in actual application, the user interface may be an interface of another application, and the touch controls may be controls of another application, and the embodiments of the present application are not limited to this.

[0025] As shown in Figure 2(a), the terminal displays a user interface 20 for a game application, which is either the system's default touch control layout interface or a user-customized touch control layout interface. The user interface 20 displays a virtual character 22 and multiple touch controls, in which case each touch control is displayed in its corresponding first position, i.e., the position before self-adaptive adjustment, such as touch control 21 on the left and touch control 23 on the right.

[0026] For each touch control on the user interface 20, a prediction area for the touch control is set. The range of the prediction area for a touch control covers the display area of ​​the touch control and is larger than the display area of ​​the touch control. The prediction area records touch operations on the touch control; that is, any touch operation on the touch control that falls within the prediction area is recorded. As shown on the left side of diagram (b) in Figure 2, a prediction area (shown as a gray rectangle covering the touch control in the diagram) is set for each touch control on the user interface 20.

[0027] Using touch control 21 as an example, the right side of drawing (b) in Figure 2 shows the method for setting its initial position and prediction area. Circle 25 shows the abstract schematic shape of touch control 21 in the user interface. In the preset scheme, the distance from the leftmost position of the first position of touch control 21 (i.e., circle 25 in the drawing) to the left boundary of the user interface is set to 50 pixels, and a prediction area 26 is set for touch control 21. This prediction area 26 includes the display area of ​​touch control 21 (i.e., circle 25 in the drawing) and is larger than the display area of ​​touch control 21.

[0028] During the user's gameplay, multiple touch operations on the touch control are recorded. That is, multiple touch operation commands generated by multiple touch operations on the touch control are received, and a second position corresponding to the touch control, i.e., the user's click hot zone for the touch control, is determined based on the corresponding touch operation position on the user interface for each of the multiple touch operation commands. For example, in Figure 2(c), multiple partially overlapping white circles on the touch control 21 indicate the anchor points of the user's touch operations on the touch control 21 (i.e., the touch operation positions of multiple touch operations on the touch control 21 by the user), and the click hot zone, i.e., the high-frequency click area of ​​the touch control 21, is determined based on these multiple partially overlapping white circles. The right side of drawing (c) in Figure 2 shows an abstract schematic diagram, where the black solid circle 24 indicates the second position of the touch control 21 (i.e., circle 25 in the drawing), the position and size of the black solid circle 24 are determined based on the touch operation positions of multiple touch operations by the user on the touch control 21 (i.e., the multiple partially overlapping white circles), the two dotted lines in the drawing indicate the center line of the second position, i.e., the intersection of the two dotted lines is the center of the black solid circle 24 (center point of the click hot zone).

[0029] After determining a second position of the touch control 21 based on the positions of multiple touch operations performed by the user on the touch control 21, the display position of the touch control 21 is adjusted to the second position, thereby displaying the touch control 21 at the second position, for example, by determining the center of the second position to be the center of the touch control 21. The left side of Figure 2(d) shows the touch control 21 after the position adjustment, and its center position is the center of the second position. The right side of Figure 2(d) shows an abstract schematic diagram of the position adjustment, where the touch control 21 (i.e., circle 25 in the diagram) is displayed at the position of circle 27 after the position adjustment based on the second position, and the distance from the leftmost part of circle 27 to the left boundary of the user interface is 32 pixels. Based on the new position of the touch control 21, the prediction area is set again and shown in the rectangular frame 28 in the diagram.

[0030] Figure 3 is a structural block diagram of a computer system provided by one exemplary embodiment of the present application. The computer system 100 includes a first terminal 110, a server 120, and a second terminal 130.

[0031] The first terminal 110 has a client 111 installed and running that supports a virtual environment, and this client 111 may be a multiplayer online battle program. When the first terminal 110 runs the client 111, the user interface of the client 111 is displayed on the screen of the first terminal 110. This client 111 may be any one of the following applications: battle royale shooting games, virtual reality (VR) application programs, augmented reality (AR) programs, 3D map programs, virtual reality games, augmented reality games, first-person shooting games (FPS), third-person shooting games (TPS), multiplayer online battle arena games (MOBA), simulation games (SLG), etc. In this embodiment, the example of the client 111 being a MOBA game will be used for explanation. The first terminal 110 is a terminal used by the first user 112, who uses the first terminal 110 to control the first virtual character in the virtual environment to make it active, for example, by controlling a pet virtual character to explore in the virtual world, and the first virtual character may be called the first user 112's virtual character. The first user 112 may perform operations such as assembling, disassembling, and uninstalling virtual items owned by the first virtual character, and this application is not limited thereto. In general terms, the first virtual character may be, for example, a simulated human character or an anime character.

[0032] The second terminal 130 has a client 131 installed and running that supports the virtual environment, and this client 131 may be a multiplayer online battle program. When the second terminal 130 runs the client 131, the user interface of the client 131 is displayed on the screen of the second terminal 130. This client may be any one of the following applications: battle royale shooting games, VR application programs, AR programs, 3D map programs, virtual reality games, augmented reality games, FPS, TPS, MOBA, SLG, etc. In this embodiment, the client 131 will be described as a MOBA game as an example. The second terminal 130 is a terminal used by the second user 113, and the second user 113 uses the second terminal 130 to control the activity of a second virtual character in the virtual environment, for example, controlling a pet virtual character to explore the virtual world, and the second virtual character may be called the second user 113's virtual character. In general terms, the second virtual character may be, for example, a simulated human character or an anime character.

[0033] Optionally, the first and second virtual characters may reside in the same virtual environment. Optionally, the first and second virtual characters may belong to the same faction, the same team, or the same organization, and may have a friendship or temporary communication privilege. Optionally, the first and second virtual characters may belong to different factions, different teams, different organizations, or be in a hostile relationship.

[0034] Optionally, the clients installed on the first terminal 110 and the second terminal 130 may be the same, or the clients installed on the two terminals may be the same type of client on different operating system platforms (Android or iOS). The first terminal 110 may generally refer to one of several terminals, and the second terminal 130 may generally refer to another of several terminals; however, in this embodiment, only the first terminal 110 and the second terminal 130 will be described as examples. The device types of the first terminal 110 and the second terminal 130 may be the same or different, and such device types include, but are not limited to, at least one of smartphones, tablets, e-readers, MP3 players, MP4 players, laptop computers, and desktop computers.

[0035] Although Figure 3 shows only two terminals, in different embodiments, there may be multiple other terminals 140 that can access the server 120. Optionally, there may be one or more additional terminals 140 that correspond to developers. Terminals 140 have a client development and editing platform that supports the virtual environment installed. Developers edit and update clients on terminals 140, and transmit the updated client installation package to the server 120 via a wired or wireless network. The first terminal 110 and the second terminal 130 then download the client installation package from the server 120 to update the clients.

[0036] The first terminal 110, the second terminal 130, and the other terminals 140 are connected to the server 120 via a wireless or wired network.

[0037] Server 120 includes at least one of a single server, multiple servers, a cloud computing platform, and a virtualization center. Server 120 provides background services to clients that support the virtual environment. Optionally, Server 120 performs the primary computing tasks and the terminal performs secondary computing tasks, or Server 120 performs secondary computing tasks and the terminal performs primary computing tasks, or collaborative computing is performed between Server 120 and the terminal using a distributed computing architecture.

[0038] In one schematic example, server 120 includes a processor 122, a user account database 123, a battle service module 124, and a user input / output interface (I / O interface) 125. The processor 122 reads commands stored in server 120 and processes data in the user account database 123 and the battle service module 124. The user account database 123 stores data for user accounts logged in by a first terminal 110, a second terminal 130, and other terminals 140, such as the user account's avatar, nickname, combat power index, and service area where the user account is located. The battle service module 124 provides multiple battle rooms for user battles, such as 1v1, 3v3, and 5v5 battles. The user I / O interface 125 establishes communication with the first terminal 110 and / or the second terminal 130 via a wireless or wired network to exchange data.

[0039] Figure 4 is a flowchart of a method for displaying touch controls provided by one exemplary embodiment of the present application. This method is performed by a terminal in the system shown in Figure 3, or by a client on the terminal. The method includes the following steps: Step 220: Display the touch control, with the first position of the user interface as the display position of the touch control; A user interface is an interface for interaction between a user and a terminal or a client on a terminal. Taking the example of a game application program running on a terminal, the user interface includes a virtual character, touch controls, etc. The virtual character operates in a virtual world provided by the game application under the user's control, and the touch controls support the user in controlling the virtual character. The user interface is pre-configured with a hot zone, which is a touch area for performing control operations on the virtual character, and the hot zone may also be considered an area for responding to touch operations on the touch controls.

[0040] The first position is the position where the touch control is located before any adjustments are made. For example, in the initial interface at the start of a game, the first position where the touch control is located is determined based on the system's preset placement, or, if the user makes a custom placement for the touch control on the user interface, the first position where the touch control is located is determined based on that custom placement.

[0041] For example, the system determines a first position for the touch control based on its default settings or the user's custom settings, and displays the touch control at a first position in the user interface.

[0042] In some embodiments, in order to adapt the display of touch controls to user interfaces having different sizes or resolutions, it is necessary to adjust the size or placement of the touch controls accordingly based on the size or resolution of the user interface. For example, the size of the touch controls is adjusted based on the size and / or resolution of the user interface.

[0043] For example, the size ratio of the user interface to a preset interface is determined based on the size and / or resolution of the user interface, and the size of the touch controls is adjusted based on this ratio, where the preset interface is the display method of the user interface set when developing the application. For example, the ratio of the height of the user interface to the height of the preset interface is calculated, and the touch controls are zoomed in or out proportionally based on this ratio. Alternatively, on terminals with small user interfaces, the touch controls are zoomed out and repositioned. This application is not limited to these examples. By adjusting the size of the touch controls based on the size and / or resolution of the user interface in this way, the display of the touch controls can be adapted to user interfaces with different sizes and / or resolutions, allowing users to more accurately trigger operations with the touch controls and improving the experience.

[0044] Step 240: Receive multiple touch operation commands generated by performing multiple touch operations on the touch control; Step 260: Determine the number of touch operation positions on the user interface that correspond to each of the number of touch operation commands.

[0045] A touch operation is an operation triggered on a touch control and may be, but is not limited to, at least one of the following: a click, a long press, a drag, a double-click, a voice command, a pressure touch, eye-tracking control, or a somatosensory control. A touch operation command is a computer command generated by the terminal in response to a touch operation triggered by the user, and the terminal performs the associated operation based on the touch operation command. The touch operation command indicates the control location of the corresponding touch operation in the user interface, i.e., the touch operation location.

[0046] A touch operation on a touch control indicates that the target object of the touch operation is that touch control, but the touch operation does not necessarily land precisely on the touch control; that is, a touch operation on a touch control includes touch operations that land on the touch control and touch operations that land around the touch control.

[0047] In some embodiments, a prediction area is set for a touch control, which is a predicted area where touch operations on the touch control may occur. This prediction area is an area in the user interface that includes at least part, preferably all, of the touch control and has a larger area than the touch control itself. In embodiments of this application, any touch operation that falls within the prediction area of ​​the touch control is considered a touch operation on the touch control, and the position of the touch operation within the prediction area is recorded accordingly to provide a reference when adjusting the display position of the touch control thereafter. In other words, any multiple touch operations on the above-mentioned touch control are touch operations that fall within the prediction area of ​​the touch control, and optionally, the prediction area does not cover the areas of other touch controls. In actual application, user-triggered touch operations on a touch control may fall outside the predicted area of ​​the touch control. When many user-triggered touch operations on a touch control fall outside the predicted area of ​​the touch control, the display position of the touch control is considered inconsistent with the user's operating habits. In this case, the display position of the touch control is adjusted based on the positions of multiple touch operations triggered by the user on the touch control, and the adjusted position is made to match the user's operating habits.

[0048] In actual application, within a predetermined period (e.g., 1 day, 2 days, 1 week, etc.), statistics are collected on each touch operation triggered by the user on a certain touch control, specifically the number of touch operations that fall outside the touch control's predicted area. For example, the number of touch operations that fall outside the touch control and the proportion of touch operations that fall outside the touch control in each individual touch operation are statistically calculated. Furthermore, the relationship between the statistical results and a predetermined threshold is compared. If the statistical results are higher than the predetermined threshold, it is considered that most of the touch operations triggered by the user on the touch control fall outside the touch control's area. In this case, the display position of the touch control is adjusted based on the positions of these touch operations.

[0049] For example, after receiving multiple touch operations on a touch control, the terminal determines a second adjusted position of the touch control based on the operation locations of the multiple touch operations, or after receiving multiple touch operations on a touch control, the terminal sends an operation record of the multiple touch operations to the server, and after the server determines a second adjusted position of the touch control, the terminal receives second position information sent from the server, and this second position information indicates the second position of the touch control.

[0050] Step 280: Based on the plurality of touch operation positions, the display position is adjusted from the first position to the second position of the user interface, and the touch control is displayed at the second position.

[0051] The second position is obtained by adjusting the first position based on multiple touch operation positions, and the second position better matches the user's operating habits than the first position, meaning that most of the user's touch operations on the touch control fall in the second position and its surrounding area.

[0052] For example, the device displays the repositioned touch controls in a second location on the user interface.

[0053] In some embodiments, the second position is determined based on the first click hot zone, which may be, for example, the center of the first click hot zone, the first click hot zone is an area where the click rate reaches a first threshold, the click rate of the first click hot zone is determined based on the number of touch operation positions among a plurality of touch operation positions that fall within the first click hot zone, and the first threshold is a preset click rate threshold.

[0054] In some embodiments, the second position is determined by the terminal. The terminal determines the click rate of each candidate sub-region within the prediction region based on the touch operation position that falls within the prediction region from among multiple touch operation positions. The prediction region is an area in the user interface that includes a touch control and has a larger area than the touch control. Candidate sub-regions whose click rate reaches a first threshold are designated as the first click hot zone.

[0055] In some embodiments, the second position is determined by the server. The terminal transmits an operation record to the server to indicate the multiple touch operation positions described above. After the server determines the second position, the terminal receives the second position information transmitted from the server. The second position information indicates the second position. The second position information is determined by the server based on the operation record. The server determines the click rate of each candidate sub-region within the prediction region based on the touch operation positions that fall within the prediction region, and determines the candidate sub-region whose click rate reaches the first threshold as the first click hot zone.

[0056] In some other embodiments, the second position is determined based on a second click hot zone, which may be, for example, the center of the second click hot zone, the second click hot zone is an area where the number of clicks reaches a second threshold, the number of clicks in the second click hot zone is the number of touch operation positions among multiple touch operation positions that fall into the second click hot zone, and the second threshold is a preset threshold for the number of clicks.

[0057] In some embodiments, the second position is determined by the terminal. Based on the touch operation position that falls within the prediction area from among the plurality of touch operation positions, the number of clicks for each candidate sub-region within the prediction area is determined. The prediction area is a region in the user interface that includes a touch control and has an area larger than the touch control, and candidate sub-regions whose number of clicks reaches a second threshold are determined as the second click hot zone.

[0058] In some embodiments, the second position is determined by the server. The terminal sends an operation record to the server to indicate multiple touch operation positions. After the server determines the second position, the terminal receives the second position information sent from the server, which indicates the second position. The second position information is determined by the server based on the operation record, and the server determines the number of clicks for each candidate sub-region within the prediction region based on the touch operation positions that fall within the prediction region, and determines the candidate sub-regions whose click count reaches a second threshold as the second click hot zone.

[0059] In some other embodiments, the second position is the center of the circumscribed circle or circumscribed regular polygon of a plurality of third click hot zones, the plurality of third click hot zones are regions among a plurality of grid regions where the click rate and / or number of clicks have reached a threshold, and the plurality of grid regions are regions obtained by dividing the prediction region according to the grid.

[0060] Optionally, the second location information received by the terminal is the coordinates of the second location, or the second location information is offset data of the second location relative to the first location.

[0061] As described above, the method provided by this embodiment receives multiple touch operation commands generated by performing multiple touch operations on a certain touch control, determines the corresponding touch operation position on the user interface for each of these multiple touch control commands, further adjusts the display position of the touch control from a first position to a second position based on the multiple touch operation positions, and finally displays the touch control at the second position. In this way, the user's high-frequency click area for the touch control is determined based on the operation positions of multiple touch operations triggered by the user on the touch control, and further adjusts the display position of the touch control to the user's high-frequency click area, thereby improving the convenience of operation, optimizing the placement of touch controls on the user interface, enhancing the efficiency of touch control use, and self-adaptively adjusting the position of the touch control based on the user's operation record, eliminating the need for multiple manual adjustments by the user, thereby enhancing the convenience of touch control adjustment, improving the user experience, and increasing the efficiency of touch control adjustment.

[0062] Figure 5 is a flowchart of a method for displaying touch controls provided by one exemplary embodiment of the present application. This method is performed by a terminal in the system of Figure 3, or by a client on the terminal. The method includes the following steps: Step 420: Display the touch control, with the first position of the user interface as the display position of the touch control; A user interface is an interface that allows a user to interact with a device or a client on a device. The first position is the position where the touch control is located before any adjustments are made. For example, in the initial interface at the start of a game, the first position where the touch control is located is determined based on the system's preset placement, or, if the user makes a custom placement for the touch control on the user interface, the first position where the touch control is located is determined based on that custom placement.

[0063] For example, the system determines a first position for the touch control based on its default settings or the user's custom settings, and displays the touch control at a first position in the user interface.

[0064] Step 430: Receive a plurality of touch operation commands generated by performing multiple touch operations on the touch control, and determine a plurality of touch operation positions on the user interface corresponding to each of the plurality of touch operation commands; A touch operation is an operation triggered on a touch control and may be, but is not limited to, at least one of the following: a click, a long press, a drag, a double-click, a voice command, a pressure touch, eye-tracking control, or a somatosensory control. A touch operation command is a computer command generated by the terminal in response to a touch operation triggered by the user, and the terminal performs the associated operation based on the touch operation command. The touch operation command indicates the control location of the corresponding touch operation in the user interface, i.e., the touch operation location.

[0065] A touch operation on a touch control indicates that the target object of the touch operation is that touch control, but the touch operation does not necessarily land precisely on the touch control; that is, a touch operation on a touch control includes touch operations that land on the touch control and touch operations that land around the touch control.

[0066] For example, a device receives multiple touch operations on its touch controls.

[0067] In some embodiments, a predicted area for a touch control is set, which is a predicted area where touch operations on the touch control may occur. In embodiments of this application, any touch operation that falls within the predicted area of ​​the touch control is considered an operation on the touch control and is recorded accordingly, thereby providing a reference when adjusting the display position of the touch control thereafter. That is, multiple touch operations on the touch control are all touch operations that fall within the predicted area of ​​the touch control, and the predicted area includes the touch control but is larger than the area of ​​the touch control. Optionally, the predicted area does not cover the areas of other touch controls.

[0068] To record the distribution of multiple touch operations within the prediction area, that is, to record how many times each touch operation occurs at different locations within the prediction area, it is necessary to divide the prediction area into multiple candidate sub-areas. The method for setting candidate sub-areas is one of the following: Divide the prediction area into multiple non-overlapping rectangular candidate sub-areas, for example, according to a grid pattern; Divide the prediction area into multiple non-overlapping sector-shaped candidate sub-areas, for example, according to a preset sector angle, dividing the prediction area into multiple non-overlapping candidate sub-areas corresponding to the sector angle; Set multiple circular candidate sub-areas with the same radius and partially overlapping within the prediction area, using the center of the prediction area as the reference position; Set multiple circular candidate sub-areas with the same radius and partially overlapping within the prediction area, using the center of the touch control as the reference position; Set multiple circular candidate sub-areas with the same radius and partially overlapping within the prediction area, centered on the operation position of each touch operation.

[0069] Figure 6 is a schematic diagram of setting up multiple candidate sub-regions in the prediction region. In (a), taking the prediction region as a rectangle as an example, the prediction region is divided into multiple non-overlapping rectangular candidate sub-regions using a grid division method. In (b), taking the prediction region as a circle as an example, the prediction region is divided into multiple non-overlapping sector-shaped candidate sub-regions using a sector division method. In (c), the dotted circle indicates touch control, the rectangular frame indicates the prediction region, and the solid circle indicates a candidate sub-region; using the center of the prediction region (i.e., the rectangular frame) as the reference position, multiple circular candidate sub-regions with the same radius and partially overlapping are set in the prediction region. In (d), the dotted circle indicates a touch control, the rectangular frame indicates the prediction area, and the solid circle indicates a candidate sub-area; using the center of the touch control (i.e., the dotted circle) as the reference position, multiple circular candidate sub-areas with the same radius and partially overlapping are set in the prediction area; if the set candidate sub-areas exceed the prediction area, only valid operation records that enter the prediction area are statistically recorded, and invalid operation records outside the prediction area are ignored.

[0070] Furthermore, methods (a) and (b) in Figure 6 may be implemented as partially overlapping candidate sub-regions, while methods (c) and (d) may be implemented as non-overlapping candidate sub-regions. This application is not limited to these methods.

[0071] In addition to the candidate sub-region setting method shown in Figure 6, candidate sub-regions may also be dynamically set based on user touch operations. For example, multiple circular candidate sub-regions with the same radius, or multiple rectangular candidate sub-regions of the same size, may be set in the prediction region centered on the operation position of each touch operation.

[0072] The above method for setting candidate sub-regions ensures that the set candidate sub-regions reasonably cover the prediction region, allowing for a more accurate determination of the distribution of touch operations within the prediction region among multiple touch operations. In other words, it is possible to determine how many times each touch operation occurs at different locations within the prediction region, and based on this, the display position of the touch controls can be determined to better suit the user's operating habits.

[0073] Here, you only need to select and execute one of the following steps 442-444 and steps 446-448. If you want to determine the second position based on the click-through rate, execute steps 442-444; if you want to determine the second position based on the number of clicks, execute steps 446-448.

[0074] Step 442: Based on the touch operation position among the plurality of touch operation positions that falls within the prediction area, the click rate of each candidate sub-region within the prediction area is determined.

[0075] For example, based on the touch operation location that falls within the predicted area among multiple touch operation locations, the number of clicks for each candidate sub-region, i.e., the number of touch operations that enter each candidate sub-region, is statistically calculated, and the click rate for each candidate sub-region is determined based on the number of clicks for each candidate sub-region and the total number of touch operations.

[0076] Here, the click count is the click count statistically calculated within a time length L. For example, the click count in the operation record is statistically calculated for each time length L, or a slide window with a size equal to the time length L is set, and the click count is statistically calculated for the operation record in the slide window.

[0077] For example, the click-through rate for a candidate sub-region is calculated by dividing the number of clicks for each candidate sub-region by the total number of clicks for the predicted region.

[0078] Step 444: Determine the candidate sub-regions where the click-through rate reaches the first threshold as the first click-hot zone; The first threshold is a preset click-through rate threshold or a dynamically adjusted click-through rate threshold. For example, the first threshold may be preset to 50%, or the click-through rates of all candidate sub-regions may be sorted in order of size, and the click-through rate ranked third may be determined as the first threshold. However, this application is not limited to these.

[0079] For example, a candidate sub-region whose click-through rate reaches a first threshold is designated as the first click-hot zone, i.e., the area where the user frequently clicks on that touch control.

[0080] In some embodiments, if there are multiple candidate sub-regions whose click-through rate reaches a first threshold and they are not adjacent, the candidate sub-regions whose click-through rate reaches the first threshold are sorted in order of click-through rate, and the adjacent candidate sub-regions among the first n candidate sub-regions are determined to be the first click hot zone, where n is a natural number.

[0081] In some embodiments, candidate sub-regions whose click-through rate reaches a first threshold are sorted in order of click-through rate, and the first n candidate sub-regions are determined to be the first click-hot zone, where n is a natural number.

[0082] Specifically, based on step 442, the click-through rate of each candidate sub-region within the prediction region is determined, and in that step, a first click hot zone is determined based on the click-through rate. Finally, in step 460 below, the touch control is displayed at a second position determined based on the first click hot zone. In this way, by determining the first click hot zone based on the click-through rate, it is possible to ensure that the determined first click hot zone is an area that users frequently click when triggering a touch operation on the control. Correspondingly, by determining a second position based on the first click hot zone and adjusting and displaying the control at that second position, it is possible to ensure that the adjusted control is more aligned with the user's operating habits.

[0083] Step 446: Based on the touch locations among multiple touch locations that fall within the prediction area, determine the number of clicks for each candidate sub-region within the prediction area.

[0084] For example, the number of clicks for each candidate sub-region is statistically calculated based on the touch position that falls within the predicted region among multiple touch positions.

[0085] Here, the click count is the click count statistically calculated within a time length L. For example, the click count in the operation record is statistically calculated for each time length L, or a slide window with a size equal to the time length L is set, and the click count is statistically calculated for the operation record in the slide window.

[0086] Step 448: Determine the candidate sub-regions where the number of clicks has reached the second threshold as the second click hot zone; The second threshold is a preset threshold for the number of clicks, or a dynamically adjusted click-through rate threshold. For example, the second threshold could be preset to 10 clicks, or the click counts for all candidate sub-regions could be sorted in order of size, and the click count ranked third could be determined as the second threshold. However, this application is not limited to these.

[0087] For example, a candidate sub-region where the number of clicks reaches a second threshold is designated as a second click hot zone, i.e., a high-frequency click area for that touch control.

[0088] In some embodiments, if there are multiple candidate subregions whose click count has reached the second threshold and they are not adjacent, the candidate subregions whose click count has reached the second threshold are sorted in order of click count, and the adjacent candidate subregions among the first n candidate subregions are determined to be the second click hot zone, where n is a natural number.

[0089] In some embodiments, candidate sub-regions whose click-through rate reaches a second threshold are sorted in order of click-through rate, and the first n candidate sub-regions are determined to be the second click-hot zone, where n is a natural number.

[0090] Specifically, based on step 446, the number of clicks for each candidate sub-region within the prediction region is determined, and in that step, a second click hot zone is determined based on the number of clicks. Finally, in step 460 below, the touch control is displayed at the second position determined based on the second click hot zone. In this way, by statistically analyzing the number of clicks for each candidate sub-region within the prediction region and determining the second click hot zone based on the number of clicks, it is possible to ensure that the determined second click hot zone is an area that users frequently click when triggering a touch operation on the touch control. Correspondingly, by determining a second position based on the second click hot zone and adjusting and displaying the touch control at that second position, it is possible to ensure that the adjusted touch control is more aligned with the user's operating habits.

[0091] Step 460: Based on the plurality of touch operation positions, the display position is adjusted from the first position to the second position of the user interface, and the touch control is displayed at the second position.

[0092] When determining the second position based on the click-through rate, i.e., when steps 442 to 444 are performed, the second position may be the center of the first click hot zone. When determining the second position based on the number of clicks, i.e., when steps 446 to 448 are performed, the second position may be the center of the second click hot zone.

[0093] For example, the device displays touch controls in a second location on the user interface.

[0094] In some embodiments, if, within a first time threshold, the number of invalid operations—where multiple touch operations enter the predicted area but do not enter the touch control—exceeds a first invalid threshold, the second position determination process is triggered, where the first time threshold is a preset time threshold and the first invalid threshold is a preset click count threshold. That is, if the user's touch operation position frequently enters the vicinity of the touch control within a predetermined time, a self-adaptive position adjustment for the touch control is activated.

[0095] In some embodiments, if, within a second time threshold, the distance between the center positions of multiple touch operation locations and the center position of the touch control is greater than a second invalid threshold, the second position determination process described above is triggered, where the second time threshold is a preset time threshold and the second invalid threshold is a preset distance threshold. That is, if, within a predetermined time, the high-frequency operation area of ​​the user's touch operations is far from the center of the touch control, a self-adaptive position adjustment for that touch control is activated.

[0096] In this way, the above determination mechanism instantly adjusts the display position of the touch controls based on the user's operating habits, thereby aligning the display position of the touch controls with the user's operating habits as quickly as possible.

[0097] In addition to adjusting the position of the touch controls as described above, you may also adjust the size of the touch controls.

[0098] In some embodiments, the size of the touch controls is adjusted based on the size and / or resolution of the user interface. For example, the size ratio of the user interface to a preset interface is determined based on the size and / or resolution of the user interface, and the size of the touch controls is adjusted based on this ratio, where the preset interface may be, for example, a template interface set for the user interface when developing an application.

[0099] In some embodiments, the size of a touch control is adjusted based on the distance between adjacent touch controls. For example, if the distance between adjacent touch controls is less than a distance threshold, the touch control is zoomed out; if the distance between adjacent touch controls is greater than a distance threshold, the touch control is zoomed in.

[0100] In some embodiments, the size of the touch control is adjusted based on the operation position of multiple touch operations, or based on the operation position of an invalid operation among multiple touch operations that falls outside the touch control area but belongs to the prediction area.

[0101] For example, the size of the touch control may be adjusted based on the size of the click hot zone, where the click rate and / or number of clicks reach a click threshold, the click rate is determined based on the number of touch operations that enter the click hot zone out of multiple touch operations, and the click hot zone may specifically be the first or second click hot zone described above. Optionally, the size of the click hot zone may be set to the size of the touch control, or the size of the smallest circle containing the click hot zone may be set to the size of the touch control, or the size of the smallest rectangle containing the click hot zone may be set to the size of the touch control, or if the size of the click hot zone is much smaller than the size of the touch control, the size of the touch control may be reduced, or if the size of the click hot zone is close to the size of the touch control, the size of the touch control may be appropriately increased.

[0102] Furthermore, the size of touch controls is adjusted based on the location of invalid operations that fall within the prediction area but are not located on the touch controls themselves. For example, the size of touch controls is appropriately enlarged based on the distribution of invalid operations, and as many touch operations as possible are placed within the valid area without affecting other touch controls.

[0103] In this way, the size of the touch controls is adjusted based on the size and / or resolution of the user interface, the distance between adjacent touch controls, or the position of multiple touch operations. This adjusts the size of the touch controls to match the user interface and / or the user's operating habits, making it easier for the user to trigger precise operations on the touch controls.

[0104] In some embodiments, the size of a touch control is adjusted based on the position of multiple touch operations, and then a click threshold (e.g., the first or second threshold described above) for evaluating the click hot zone is adjusted based on the distance between adjacent touch controls. For example, if the distance between the resized touch control and an adjacent touch control is less than the distance threshold, the click threshold is increased; if the distance between the resized touch control and an adjacent touch control is greater than the distance threshold, the click threshold is decreased. By adjusting the click threshold in this way, adjustments to the display position of the touch control are limited, and frequent adjustments to the display position of the touch control can interfere with the use of other adjacent touch controls.

[0105] In addition to adjusting the size of the touch controls, the transparency and other properties are also adjusted to prevent the touch controls displayed in the second position from obscuring the virtual character in the user interface. The virtual character is a character in a 3D virtual world. When the display position of the virtual character on the user interface is determined, the model of the virtual character is mapped onto the imaging plane of the 2D virtual screen, and then the common area with the display area of ​​the touch controls is found to determine whether occlusion has occurred.

[0106] In some embodiments, if the touch control obscures a virtual character in the user interface, the touch control is zoomed out, or if the touch control obscures a virtual character in the user interface, the touch control is displayed in a semi-transparent manner, or if the touch control obscures a virtual character in the user interface, only the outline of the touch control is displayed.

[0107] In some embodiments, if the touch control is zoomed out to its minimum size but still obscures the virtual character, the touch control is displayed in a semi-transparent manner, or if the touch control is zoomed out to its minimum size but still obscures the virtual character, only the outline of the touch control is displayed.

[0108] In this way, the display method of the touch controls is adjusted based on the relationship between the touch controls and the virtual character, preventing the touch controls from obscuring the virtual character and improving the user experience for the application program.

[0109] As described above, in the method provided by this embodiment, by adjusting the position of the touch controls to the click hot zone, i.e., the area where the user clicks frequently, the placement of the touch controls is tailored to the user's usage habits, improving the convenience of operation, optimizing the placement of touch controls on the user interface, and improving the user experience.

[0110] Furthermore, in the method provided by this embodiment, candidate sub-regions are statically or dynamically set in the prediction region, and candidate sub-regions are flexibly selected based on a preset method or the landing point of a touch operation, thereby improving the accuracy and efficiency of the second position determination.

[0111] Furthermore, in the method provided by this embodiment, by adjusting the size of the touch controls, the space of the user interface is utilized as much as possible, and the efficiency of using the touch controls is improved without affecting the use of other touch controls, thereby optimizing the user experience.

[0112] In the exemplary embodiment shown in Figure 5, the second position is determined by the terminal or a client running on the terminal, and the second position may also be determined by the server, a method which is shown in the following embodiment.

[0113] Figure 7 is a flowchart of a method for displaying touch controls provided by one exemplary embodiment of the present application. This method is performed by a terminal or a client on a terminal in the system shown in Figure 3. The method includes the following steps: Step 320: Display the touch control, with the first position of the user interface as the display position of the touch control; A user interface is an interface that allows a user to interact with a device or a client on a device. The first position is the position where the touch control is located before any adjustments are made. For example, in the initial interface at the start of a game, the first position where the touch control is located is determined based on the system's preset placement, or, if the user makes a custom placement for the touch control on the user interface, the first position where the touch control is located is determined based on that custom placement.

[0114] For example, the system determines a first position for the touch control based on its default settings or the user's custom settings, and displays the touch control at a first position in the user interface.

[0115] Step 330: Receive multiple touch operation commands generated by performing multiple touch operations on the touch control, and determine the multiple touch operation positions on the user interface corresponding to each of the multiple touch operation commands.

[0116] A touch operation is an operation triggered on a touch control and may be, but is not limited to, at least one of the following: a click, a long press, a drag, a double-click, a voice command, a pressure touch, eye-tracking control, or a somatosensory control. A touch operation command is a computer command generated by the terminal in response to a touch operation triggered by the user, and the terminal must perform the associated operation based on the touch operation command. The touch operation command indicates the control location of the corresponding touch operation in the user interface, i.e., the touch operation location.

[0117] A touch operation on a touch control indicates that the target object of the touch operation is that touch control, but the touch operation does not necessarily land precisely on the touch control; that is, a touch operation on a touch control includes touch operations that land on the touch control and touch operations that land around the touch control.

[0118] In some embodiments, a predictive area is set for a touch control, which is a predetermined area where touch operations on the touch control may occur. In embodiments of this application, any touch operation that falls within the predictive area of ​​the touch control is considered an operation on the touch control and is recorded accordingly, thereby providing a reference when adjusting the display position of the touch control thereafter. That is, multiple touch operations on the touch control are all touch operations that fall within the predictive area of ​​the touch control, and the predictive area is an area in the user interface that includes the touch control and has an area larger than the touch control. Optionally, the predictive area does not cover the areas of other touch controls. In actual application, a touch operation triggered by a user on a touch control may fall outside the touch control within the predictive area. If many touch operations triggered by the user on a touch control all fall outside the touch control within the predictive area, the display position of the touch control is considered not to match the user's operating habits. In this case, the display position of the touch control is adjusted based on the touch operation positions of multiple touch operations triggered by the user on the touch control to match the adjusted position to the user's operating habits.

[0119] Step 340: Send an operation record to the server to indicate the multiple touch operation locations.

[0120] For example, after receiving multiple touch commands generated by making multiple touch operations on a touch control, the terminal sends an operation record to the server that includes the corresponding touch locations for each of the multiple touch commands. The operation record includes the locations of the multiple touch operations, for example, the click locations for a click operation.

[0121] Step 350: Receive the second location information sent from the server; The second position information indicates the second position after the touch control has been adjusted. The second position information is either the coordinates of the second position or the offset data of the second position relative to the first position.

[0122] For example, the server determines a second location based on the touch positions of multiple touch operations, and then includes this second location in the second location information and sends it to the terminal. The terminal receives the second location information sent from the server.

[0123] In some embodiments, the terminal receives second location information transmitted from the server, which indicates a second location. The second location information is determined by the server based on an operation record that indicates the touch operation locations for multiple touch operations. Specifically, the second location information is obtained by the server determining the click rate of each candidate sub-region within the prediction region based on the touch operation locations that fall within the prediction region from among multiple touch operation locations, and determining the candidate sub-region whose click rate reaches a first threshold as the first click hot zone. The prediction region is an area in the user interface that includes touch controls and has an area larger than the touch controls. The method by which the server specifically determines the first click hot zone based on the click rate is similar to the method by which the terminal determines the first click hot zone based on the click rate described above, and details can be found in the related descriptions above.

[0124] In some other embodiments, the terminal receives second location information transmitted from the server, which indicates a second location. The second location information is determined by the server based on an operation record indicating the touch operation locations for multiple touch operations. Specifically, the second location information is obtained by the server determining the number of clicks for each candidate sub-region within the prediction region based on the touch operation locations that fall within the prediction region among multiple touch operation locations, and determining the candidate sub-regions whose click count reaches a second threshold as the second click hot zone. The prediction region is an area in the user interface that includes touch controls and has an area larger than the touch controls. The method by which the server specifically determines the second click hot zone based on the click count is similar to the method by which the terminal determines the second click hot zone based on the click count described above, and details can be found in the related descriptions above.

[0125] Step 360: Based on the plurality of touch operation positions, the display position is adjusted from the first position to the second position of the user interface, and the touch control is displayed at the second position.

[0126] For example, the terminal determines a second location based on the received second location information and displays the adjusted touch controls at the second location on the user interface.

[0127] As described above, in the method provided by this embodiment, the server reduces the processing pressure on the terminal, decreases the terminal's resource consumption, and avoids affecting the progress of other services on the terminal by determining the adjusted display position of the touch control based on the touch operation positions of multiple touch operations. Furthermore, by adjusting the position of the touch control to the click hot zone, i.e., the area where the user clicks frequently, the placement of the touch control is tailored to the user's usage habits, improving the convenience of operation, optimizing the placement of touch controls on the user interface, and improving the user experience.

[0128] Figure 8 is a flowchart of a method for displaying touch controls provided by one exemplary embodiment of the present application. This method is performed by a server in the system shown in Figure 3. The method includes the following steps: Step 520: Receive the operation record sent from the terminal, which indicates multiple touch operation locations; The above-mentioned multiple touch operation locations each correspond to multiple touch operation commands, and these multiple touch operation commands are generated by performing multiple touch operations on a touch control. A touch operation is an operation triggered on a touch control and may be, but is not limited to, at least one of the following: click operation, long press operation, drag operation, double-click operation, voice operation, pressure touch operation, gaze control, and somatosensory control. A touch operation command is a computer command generated by the terminal in response to a touch operation triggered by the user, and the terminal must perform the relevant operation based on the touch operation command. A touch operation command indicates the control location of the corresponding touch operation in the user interface, i.e., the touch operation location.

[0129] A touch operation on a touch control indicates that the target object of the touch operation is that touch control, but the touch operation does not necessarily occur precisely on the touch control; that is, a touch operation on a touch control includes touch operations that occur on the touch control and touch operations that occur around the touch control. For example, the server receives an operation record from a terminal indicating the locations of multiple touch operations, and the operation record may further indicate the duration and type of operation of multiple touch operations.

[0130] Step 540: Determine the second position of the touch control in the user interface based on the plurality of touch operation positions; The second position is obtained by adjusting the first position based on multiple touch operation positions, the first position being the display position of the touch control in the user interface before the position adjustment; that is, the second position is obtained by adjusting the first position that originally displays the touch control based on the operation positions of multiple touch operations, the first position being the position where the touch control is located before the position adjustment.

[0131] In some embodiments, the second position is determined based on the first click hot zone, which may be, for example, the center of the first click hot zone. The first click hot zone is an area where the click rate reaches a first threshold, and the click rate of the first click hot zone is determined based on the number of touch operation positions among a plurality of touch operation positions that fall within the first click hot zone.

[0132] For example, based on the touch operation position that falls within the prediction region from among multiple touch operation positions, the click rate of each candidate sub-region within the prediction region is determined. The prediction region is an area in the user interface that includes a touch control and has a larger area than the touch control. Candidate sub-regions whose click rate reaches a first threshold are determined to be the first click hot zone.

[0133] In this way, by statistically analyzing the click-through rate of each candidate sub-region within the prediction region and determining a first click hot zone based on the click-through rate, it is possible to ensure that the determined first click hot zone is an area that users frequently click when triggering a touch operation on the touch control. Correspondingly, a second position is determined based on the first click hot zone, and the touch control is adjusted and displayed at the second position, ensuring that the adjusted touch control is more aligned with the user's operating habits.

[0134] In some embodiments, the second position is determined based on a second click hot zone, which may be, for example, the center position of the second click hot zone, the second click hot zone being an area where the number of clicks reaches a second threshold, and the number of clicks in the second click hot zone being the number of touch operation positions belonging to the second click hot zone out of a plurality of touch operation positions.

[0135] For example, based on the touch operation position that falls within the prediction region from among multiple touch operation positions, the number of clicks for each candidate sub-region within the prediction region is determined. The prediction region is an area in the user interface that includes a touch control and has a larger area than the touch control. Candidate sub-regions whose number of clicks reaches a second threshold are designated as the second click hot zone.

[0136] In this way, by statistically analyzing the number of clicks for each candidate sub-region within the prediction region and determining a second click hot zone based on the number of clicks, it is possible to ensure that the determined second click hot zone is an area that users frequently click when triggering touch operations on the touch control. Correspondingly, a second position is determined based on the second click hot zone, and the touch control is adjusted and displayed at that second position, ensuring that the adjusted touch control is more aligned with the user's operating habits.

[0137] In some embodiments, a predictive area is set for a touch control, which is a predicted area where touch operations on the touch control may occur. This predictive area is an area in the user interface that includes the touch control and has a larger area than the touch control itself. In embodiments of this application, any touch operation that falls within the predictive area of ​​the touch control is considered a touch operation on the touch control and is recorded accordingly, providing a reference when adjusting the display position of the touch control thereafter. That is, multiple touch operations on the touch control are all touch operations that fall within the predictive area of ​​the touch control, and optionally, the predictive area does not cover the areas of other touch controls. In actual application, a touch operation triggered by a user on a touch control may fall outside the touch control within the predictive area. If many touch operations triggered by the user on a touch control all fall outside the touch control within the predictive area, the display position of the touch control is considered not to match the user's operating habits. In this case, the display position of the touch control is adjusted based on the touch operation positions of multiple touch operations triggered by the user on the touch control to match the adjusted position to the user's operating habits.

[0138] In some embodiments, the prediction region is divided into multiple candidate sub-regions. The method for setting the candidate sub-regions is one of the following: dividing the prediction region into multiple non-overlapping rectangular candidate sub-regions; dividing the prediction region into multiple non-overlapping fan-shaped candidate sub-regions; setting multiple circular candidate sub-regions with the same radius and partially overlapping within the prediction region, using the center of the prediction region as the reference position; setting multiple circular candidate sub-regions with the same radius and partially overlapping within the prediction region, using the center of the touch control as the reference position; setting multiple circular candidate sub-regions with the same radius within the prediction region, centered on the operation position of each touch operation.

[0139] Figure 6 is a schematic diagram of setting up multiple candidate sub-regions in the prediction region. In (a), taking the prediction region as a rectangle as an example, the prediction region is divided into multiple non-overlapping rectangular candidate sub-regions using a grid division method. In (b), taking the prediction region as a circle as an example, the prediction region is divided into multiple non-overlapping sector-shaped candidate sub-regions using a sector division method. In (c), the dotted circle indicates touch control, the rectangular frame indicates the prediction region, and the solid circle indicates a candidate sub-region; using the center of the prediction region (i.e., the rectangular frame) as the reference position, multiple circular candidate sub-regions with the same radius and partially overlapping are set in the prediction region. In (d), the dotted circle indicates touch control, the rectangular frame indicates the prediction region, and the solid circle indicates a candidate sub-region; using the center of the touch control (i.e., the dotted circle) as the reference position, multiple circular candidate sub-regions with the same radius and partially overlapping are set in the prediction region. Furthermore, if the set candidate sub-region exceeds the prediction region, only valid operation records within the prediction region will be statistically analyzed, and invalid operation records outside the prediction region will be ignored.

[0140] Furthermore, methods (a) and (b) in Figure 6 may be implemented as partially overlapping candidate sub-regions, while methods (c) and (d) may be implemented as non-overlapping candidate sub-regions. This application is not limited to these methods.

[0141] In addition to the candidate sub-region setting method shown in Figure 6, candidate sub-regions may also be dynamically set based on user touch operations. For example, multiple circular candidate sub-regions with the same radius, or multiple rectangular candidate sub-regions of the same size, may be set in the prediction region centered on the operation position of each touch operation.

[0142] The above method for setting candidate sub-regions allows for the determination of the distribution of operation records that fall within the prediction region from among multiple touch operations, that is, how many times each operation record appears at different locations within the prediction region. Based on this, the click-through rate or number of clicks for different candidate sub-regions within the prediction region is statistically analyzed, and the first or second click hot zone described above is determined more accurately.

[0143] In some embodiments, if, within a first time threshold, the number of invalid touch operations that enter the predicted area but do not enter the touch control exceeds a first invalid threshold, a second position determination process is triggered, where the first time threshold is a preset time threshold, and the first invalid threshold is a preset click count threshold. That is, if the user's touch operation position frequently enters the vicinity of the touch control within a predetermined time, a self-adaptive position adjustment for the touch control is activated.

[0144] In some embodiments, if, within a second time threshold, the distance between the center positions of multiple touch operation locations and the center position of the touch control is greater than a second invalid threshold, a second position determination process is triggered, where the second time threshold is a preset time threshold and the second invalid threshold is a preset distance threshold. That is, if, within a predetermined time, the high-frequency area of ​​the user's touch operations is far from the center of the touch control, a self-adaptive position adjustment for that touch control is initiated.

[0145] In this way, the above determination mechanism instantly adjusts the display position of the touch controls based on the user's operating habits, thereby aligning the display position of the touch controls with the user's operating habits as quickly as possible.

[0146] In addition to adjusting the position of the touch controls as described above, you may also adjust the size of the touch controls.

[0147] In some embodiments, the size of the touch controls is adjusted based on the size and / or resolution of the user interface. For example, the size ratio of the user interface to the preset interface is determined based on the size and / or resolution of the user interface, and the size of the touch controls is adjusted based on this ratio.

[0148] In some embodiments, the size of a touch control is adjusted based on the distance between adjacent touch controls. For example, if the distance between a touch control and an adjacent touch control is less than a distance threshold, the touch control is zoomed out; if the distance between a touch control and an adjacent touch control is greater than a distance threshold, the touch control is zoomed in.

[0149] In some embodiments, the size of the touch control is adjusted based on the operation position of multiple touch operations, or based on the operation position of an invalid operation among multiple touch operations that falls outside the touch control area but belongs to the prediction area.

[0150] For example, the size of the touch control is adjusted based on the size of the click hot zone, where the click rate and / or number of clicks reach a click threshold, the click rate is determined based on the number of touch operations that enter the click hot zone out of multiple touch operations, and the click hot zone may specifically be the first click hot zone or the second click hot zone described above. Optionally, the size of the touch control may be set to the size of the click hot zone, or the size of the smallest circle containing the click hot zone may be set to the size of the touch control, or the size of the smallest rectangle containing the click hot zone may be set to the size of the touch control, or if the size of the click hot zone is much smaller than the size of the touch control, the size of the touch control may be reduced, or if the size of the click hot zone is close to the size of the touch control, the size of the touch control may be appropriately increased.

[0151] Furthermore, the size of touch controls is adjusted based on the location of invalid operations that fall within the prediction area but are not located on the touch controls themselves. For example, the size of touch controls is appropriately enlarged based on the distribution of invalid operations, and as many touch operations as possible are placed within the valid area without affecting other touch controls.

[0152] In some embodiments, after adjusting the size of a touch control based on the position of multiple touch operations, the click threshold is adjusted based on the distance between adjacent touch controls. This click threshold may be a click threshold to trigger the determination of a second position, or it may be a click threshold that serves as the basis for determining a click hot zone. For example, if the distance between the resized touch control and an adjacent touch control is less than a distance threshold, the click threshold is increased; and if the distance between the resized touch control and an adjacent touch control is greater than the distance threshold, the click threshold is decreased.

[0153] In addition to adjusting the size of the touch controls, the transparency and other properties can be adjusted to prevent the touch controls displayed in the second position from obscuring the user interface. For example, if the touch controls obscure a virtual character in the user interface, the touch controls can be zoomed out, or displayed semi-transparently, or only the outline of the touch controls can be displayed.

[0154] In some embodiments, if the touch control is zoomed out to its minimum size but still obscures the virtual character, the touch control is displayed in a semi-transparent manner, or if the touch control is zoomed out to its minimum size but still obscures the virtual character, only the outline of the touch control is displayed.

[0155] Step 560: The terminal is instructed to display the touch control at the second location by transmitting second location information to the terminal to indicate the second location.

[0156] For example, after the server determines a second position for the touch control, it instructs the terminal to display the touch control at that second position by transmitting second position information to the terminal to indicate the second position. This second position information is either the coordinates of the second position or the displacement of the second position relative to the first position, where the first position is the position where the touch control is located before the position adjustment.

[0157] In some embodiments, the server further transmits touch control size information to the terminal.

[0158] As described above, according to the method provided by the embodiments of this application, the server reduces the processing pressure on the terminal, decreases the terminal's resource consumption, and avoids affecting the progress of other services on the terminal by determining the adjusted display position of the touch control based on the touch operation positions of multiple touch operations. Furthermore, by determining the second position of the touch control based on multiple touch operation positions on the touch control, the touch control can adjust its position based on the user's high-frequency click areas, improving the efficiency of touch control usage, optimizing the user interface layout, and enhancing the user experience.

[0159] Figure 9 is a flowchart of a method for displaying touch controls provided by one exemplary embodiment of the present application. The method includes the following steps: Step 601: Display the current control layout.

[0160] For example, a user interface is displayed, which shows the current control layout, i.e., the first position on the user interface displays a touch control.

[0161] Step 602: The player decides whether to activate the system's automatic adjustment of touch controls.

[0162] For example, ask the player if they agree to enable the system's automatic touch control adjustment feature. If YES, proceed to step 604; if NO, proceed to step 603.

[0163] Herein, all user information and data relating to this application are either authorized by the user or obtained with the full permission of each party concerned, and the collection, use, and processing of the relevant data must comply with the relevant laws, regulations, and standards of the relevant countries and regions.

[0164] Step 603: Do not adjust dynamically, display the preset scheme; If the player has not agreed to enable the system's automatic touch control adjustment feature, the touch controls will not be dynamically adjusted, and a preset touch control array scheme will be displayed in the user interface.

[0165] Step 604: The program presets the prediction area for each key control; If the player agrees to enable the system's automatic adjustment function for touch controls, the application program (e.g., a game application program) will preset a prediction area for each key touch control, where the prediction area covers the touch control, is larger in area than the touch control, and the key control is one that has an important function or is a touch control that the user is likely to use frequently when operating it.

[0166] For example, based on the device's screen resolution and aspect ratio, the screen area is divided into multiple rectangular regions, each representing a hot zone for recording the player's click positions.

[0167] Step 605: Determine the frequency of player operation recordings; The system records touch operations that fall within the predicted area of ​​a touch control and determines the distribution of operation frequencies based on the player's operation records. For example, when a player clicks a touch control, the system records the number of times that hot zone is clicked, based on the hot zone where the click occurred.

[0168] Step 607 is performed for the high-frequency operating region, and step 606 is performed for the low-frequency operating region.

[0169] Step 606: Do not process the position of the control; For touch controls in low-frequency operation areas, their position will not be changed.

[0170] Alternatively, in another embodiment, touch controls on low-frequency operation areas are repositioned to other areas without touch controls, thereby releasing more space for frequently operated touch controls.

[0171] Step 607: Adjust the control positions around the areas where players click frequently. For touch controls located in high-frequency operation areas, the system determines high-frequency click areas (i.e., click hot zones) for those touch controls based on the player's touch operation records, and adjusts the touch controls to these high-frequency click areas, thereby making the player's touch operations more accurate.

[0172] In some implementations, adjustable custom options are provided. To meet the personalized needs of different players, adjustable custom options are offered, allowing players to manually adjust the position of the touch controls to better suit their own operating habits.

[0173] In some implementations, the adjustment algorithm is continuously optimized. To better adapt to changes in player behavior and game scenarios, the adjustment algorithm is continuously optimized, and the hot zone division and adaptive adjustment mechanisms are continuously improved based on player feedback and data analysis to enhance the player's game experience.

[0174] Figure 10 is a schematic diagram of the user interface (UI) layer, client, and server interaction in a method for displaying touch controls provided by one exemplary embodiment of this application.

[0175] The UI layer is the final experience layer, where players can sense and interact in real time. Based on front-end and back-end data processing, it generates a visual representation of the differential solution, and players interact through the UI layer for normal operations. In its initial state, the UI layer is the system's preset configuration.

[0176] The client pre-sets the predicted area for touch controls and configures the conditions for dynamic adjustment of touch controls, such as a click rate threshold. The client records the click locations and frequencies of touch operations performed by the player and feeds this operation record back to the server.

[0177] After receiving the operation log sent from the client, the server records the relevant data, compiles and statistically analyzes the client's operation log, and, based on predetermined conditions, feeds back commands to the client, instructing the client on the adjusted position of the touch control.

[0178] Finally, the client dynamically adjusts the position of the touch controls in real time based on the server's feedback commands and displays them on the UI layer.

[0179] Figure 11 is a schematic diagram of the structure of a touch-control display device provided by one exemplary embodiment of the present application. The device is implemented as all or part of a computer device by software, hardware, or a combination thereof, and the device is The first position of the user interface is set as the display position of the touch control, and a display module 720 for displaying the touch control is provided. The system includes a receiving module 740 for receiving a plurality of touch operation commands generated by performing multiple touch operations on the touch control, and for determining a plurality of touch operation positions on the user interface corresponding to each of the plurality of touch operation commands, The display module 720 further adjusts the display position from the first position to the second position of the user interface based on the plurality of touch operation positions, and displays the touch control at the second position.

[0180] In a possible embodiment, the second position is determined based on a first click hot zone, the first click hot zone being an area where the click rate reaches a first threshold, and the click rate of the first click hot zone is determined based on the number of touch operation positions among the plurality of touch operation positions that fall within the first click hot zone.

[0181] In a possible embodiment, the display module 720 further determines the click rate of each candidate sub-region within the prediction region based on the touch operation position among the plurality of touch operation positions that falls within the prediction region, and determines the candidate sub-regions that include the touch control and are larger than the touch control, and whose click rate has reached the first threshold, as the first click hot zones.

[0182] In a possible embodiment, the apparatus further includes a transmitting module 760. The transmitting module 760 transmits an operation record to a server for indicating the plurality of touch operation locations, and the receiving module 740 receives a second location information transmitted from the server, the second location information for indicating the second location, the second location information is determined by the server based on the operation record, and the server determines the click rate of each candidate sub-region within the prediction region based on the touch operation locations among the plurality of touch operation locations that fall within the prediction region, and determines the candidate sub-regions whose click rate reaches the first threshold as the first click hot zone.

[0183] In a possible embodiment, the second position is determined based on a second click hot zone, the second click hot zone being an area where the number of clicks reaches a second threshold, and the number of clicks in the second click hot zone being the number of touch operation positions among the plurality of touch operation positions that belong to the second click hot zone.

[0184] In a possible embodiment, the display module 720 further determines the number of clicks for each candidate sub-region within the prediction region based on the touch operation position among the plurality of touch operation positions that falls within the prediction region, and determines the candidate sub-regions that include the touch control and are larger than the touch control, and whose number of clicks has reached the second threshold, as the second click hot zone.

[0185] In a possible embodiment, the transmitting module 760 transmits an operation record to a server for indicating the plurality of touch operation locations, the receiving module 740 receives second location information transmitted from the server, the second location information for indicating the second location, the second location information is determined by the server based on the operation record, the server determines the number of clicks for each candidate sub-region within the prediction region based on the touch operation locations among the plurality of touch operation locations that fall within the prediction region, and determines the candidate sub-regions whose number of clicks reaches the second threshold as the second click hot zone, the prediction region being an area in the user interface that includes the touch control and has an area larger than the touch control.

[0186] In a possible embodiment, the second position information is the coordinates of the second position, or offset data of the second position relative to the first position.

[0187] In possible embodiments, the method for setting the candidate sub-regions is one of the following: dividing the prediction region into a plurality of non-overlapping rectangular candidate sub-regions; dividing the prediction region into a plurality of non-overlapping fan-shaped candidate sub-regions; setting a plurality of circular candidate sub-regions having the same radius and partially overlapping in the prediction region, with the center of the prediction region as the reference position; setting a plurality of circular candidate sub-regions having the same radius and partially overlapping in the prediction region, with the center of the touch control as the reference position; setting a plurality of circular candidate sub-regions having the same radius in the prediction region, with each of the touch operation positions as the center.

[0188] In a possible embodiment, the display module 720 further adjusts the size of the touch controls based on the size and / or resolution of the user interface.

[0189] In a possible embodiment, the display module 720 further adjusts the size of the touch control based on the operation position of the multiple touch operations, or based on the touch operation position of an invalid operation among the multiple touch operation positions that falls outside the touch control but falls within the predicted area, the predicted area being an area in the user interface that includes the touch control and has an area larger than the touch control.

[0190] Figure 12 is a schematic diagram of the structure of a touch-control display device provided by one exemplary embodiment of this application. The device is implemented as all or part of a computer device by software, hardware, or a combination thereof, and the device is A receiving module 820 for receiving operation records for instructing multiple touch operation locations transmitted from a terminal, wherein each of the multiple touch operation locations corresponds to a plurality of touch operation commands, and the plurality of touch operation commands are generated by performing multiple touch operations on the touch control. A determination module 840 for determining a second position of the touch control in the user interface based on the plurality of touch operation positions, wherein the second position is obtained by adjusting the first position based on the plurality of touch operation positions, and the first position is the display position of the touch control in the user interface before the position adjustment. The system includes a transmitting module 860 that transmits second location information to the terminal to indicate the second location, thereby instructing the terminal to display the touch control at the second location.

[0191] In a possible embodiment, the second position is determined based on a first click hot zone, the first click hot zone being an area where the click rate reaches a first threshold, and the click rate of the first click hot zone is determined based on the number of touch operation positions among the plurality of touch operation positions that fall within the first click hot zone.

[0192] In a possible embodiment, the decision module 840 determines the click rate of each candidate sub-region within the prediction region based on the touch operation position among the plurality of touch operation positions that falls within the prediction region, and the prediction region is determined to be the first click hot zone if the candidate sub-region is an area in the user interface that includes the touch control and has a larger area than the touch control, and the click rate of the sub-region reaches the first threshold.

[0193] In a possible embodiment, the second position is determined based on a second click hot zone, the second click hot zone being an area where the number of clicks reaches a second threshold, and the number of clicks in the second click hot zone being the number of touch operation positions among the plurality of touch operation positions that belong to the second click hot zone.

[0194] In a possible embodiment, the decision module 840 determines the number of clicks for each candidate sub-region within the prediction region based on the touch operation position among the plurality of touch operation positions that falls within the prediction region, and the prediction region is determined to be the second click hot zone if the candidate sub-region is an area in the user interface that includes the touch control and has a larger area than the touch control, and the number of clicks reaches the second threshold.

[0195] Figure 13 is a structural block diagram of a computer device 1700 provided in one exemplary embodiment of the present application. The computer device 1700 may be a portable mobile terminal, such as a smartphone, tablet, MP3 player (Moving Picture Experts Group Audio Layer III), or MP4 player (Moving Picture Experts Group Audio Layer IV). The computer device 1700 may also be called by other names such as user device or mobile terminal.

[0196] Generally, computer equipment 1700 includes a processor 1701 and memory 1702.

[0197] The processor 1701 includes one or more processing cores, such as a 4-core processor or an 8-core processor. The processor 1701 may be implemented in at least one hardware form from among DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 1701 further includes a main processor, also called a CPU (Central Processing Unit), which processes data in the wake-up state, and a coprocessor, which is a low-power consumption processor that processes data in the standby state. In some embodiments, the processor 1701 integrates a GPU (Graphics Processing Unit), which renders and draws content to be displayed on the display. In some embodiments, the processor 1701 further includes an AI (Artificial Intelligence) processor, which processes computing operations related to machine learning.

[0198] The memory 1702 includes one or more computer-readable storage media, which may be tangible and non-temporary. The memory 1702 may further include high-speed random access memory and non-volatile memory, such as one or more magnetic disk storage devices and flash storage devices. In some embodiments, the non-temporary computer-readable storage media in the memory 1702 stores at least one command, which is executed by the processor 1701 to realize the touch control display method provided by the embodiments of this application.

[0199] In some embodiments, preferably, the computer device 1700 may further include a peripheral device interface 1703 and at least one peripheral device. Specifically, the peripheral device includes at least one of a radio frequency circuit 1704, a touch display 1705, a camera component 1706, an audio circuit 1707, and a power supply 1708.

[0200] The peripheral device interface 1703 connects at least one peripheral device related to I / O (Input / Output) to the processor 1701 and the memory 1702. In some embodiments, the processor 1701, memory 1702, and peripheral device interface 1703 are integrated on the same chip or circuit board, while in some other embodiments, one or two of the processor 1701, memory 1702, and peripheral device interface 1703 may be implemented on separate chips or circuit boards, and this embodiment is not limited thereto.

[0201] The radio frequency circuit 1704 receives and transmits RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 1704 communicates with communication networks and other communication devices using electromagnetic signals. The radio frequency circuit 1704 selects electrical signals to be transmitted as electromagnetic signals, or selects received electromagnetic signals to be transmitted as electrical signals. Optionally, the radio frequency circuit 1704 includes an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. The radio frequency circuit 1704 communicates with other terminals using at least one wireless communication protocol. Such wireless communication protocols include, but are not limited to, the World Wide Web, metropolitan area networks, intranets, various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local networks, and / or WiFi (Wireless Fidelity) networks. In some embodiments, the radio frequency circuit 1704 may further include a circuit relating to NFC (Near Field Communication), and this application is not limited thereto.

[0202] The touch display 1705 displays a UI (User Interface). The UI may include patterns, text, icons, videos, and combinations thereof. The touch display 1705 has the ability to collect touch signals on or above its surface. These touch signals are input to the processor 1701 as control signals and processed. The touch display 1705 provides virtual buttons and / or a virtual keyboard, also called soft buttons and / or a soft keyboard. In some embodiments, there may be one touch display 1705, provided on the front panel of the computer equipment 1700; in some other embodiments, there may be at least two touch displays 1705, each provided on a different surface of the computer equipment 1700, or designed to be foldable; and in some embodiments, the touch display 1705 may be a flexible display provided on a curved or foldable surface of the computer equipment 1700. Furthermore, the touch display 1705 may be configured with a non-rectangular, irregular pattern, i.e., a non-rectangular screen. The 1705 touch display is manufactured from materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).

[0203] The camera component 1706 collects images or videos. Optionally, the camera component 1706 includes a front camera and a rear camera. Generally, the front camera enables video calls or selfies, and the rear camera enables picture or video recording. In some embodiments, there are at least two rear cameras, each being one of a main camera, a depth-of-field camera, or a wide-angle camera. This allows the main camera and depth-of-field camera to be combined to achieve background blur, and the main camera and wide-angle camera to achieve panoramic and VR (Virtual Reality) shooting functions. In some embodiments, the camera component 1706 may further include a flash. The flash may be a monochromatic or dichromatic flash. A dichromatic flash is a combination of a warm-light flash and a cold-light flash and is used for light compensation at different color temperatures.

[0204] The audio circuit 1707 provides an audio interface between the user and the computer equipment 1700. The audio circuit 1707 includes a microphone and a speaker. The microphone collects sound waves from the user and the environment, selects the sound waves as electrical signals, and inputs them to the processor 1701 for processing, or to the radio frequency circuit 1704 to enable voice communication. To achieve the objective of stereoscopic sound collection or noise reduction, there may be multiple microphones, each provided in a different part of the computer equipment 1700. The microphones may further be array microphones or omnidirectional microphones. The speaker selects electrical signals from the processor 1701 or the radio frequency circuit 1704 as sound waves. The speaker may be a conventional thin-film speaker or a piezoelectric ceramic speaker. If the speaker is a piezoelectric ceramic speaker, it can select electrical signals as sound waves audible to humans, and also select electrical signals as sound waves inaudible to humans for use in distance measurement, etc. In some embodiments, the audio circuit 1707 may further include a headphone jack.

[0205] Power supply 1708 supplies power to each component of the computer equipment 1700. Power supply 1708 may be AC ​​power, DC power, a disposable battery, or a rechargeable battery. If power supply 1708 includes a rechargeable battery, the rechargeable battery may be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery that is charged by a wired circuit, and a wireless rechargeable battery is a battery that is charged by a wireless coil. The rechargeable battery may also support fast charging technology.

[0206] In some embodiments, the computer device 1700 may further include one or more sensors 1709. These one or more sensors 1709 include, but are not limited to, an accelerometer 1710, a gyroscope 1711, a pressure sensor 1712, a light sensor 1713, and a proximity sensor 1714.

[0207] The accelerometer 1710 can detect the magnitude of acceleration on three coordinate axes of a coordinate system established by the computer equipment 1700. For example, the accelerometer 1710 detects the components of gravitational acceleration on the three coordinate axes. Based on the gravitational acceleration signal collected by the accelerometer 1710, the processor 1701 controls the touch display 1705 to display the user interface in a horizontal or vertical view. The accelerometer 1710 may also collect game or user motion data.

[0208] The gyro sensor 1711 detects the orientation and rotation angle of the computer device 1700, and works in conjunction with the accelerometer 1710 to collect the user's 3D movements relative to the computer device 1700. Based on the data collected by the gyro sensor 1711, the processor 1701 implements functions such as motion detection (for example, changing the UI based on the user's tilt operation), image stability during capture, game control, and inertial navigation.

[0209] The pressure sensor 1712 is located on the side frame of the computer device 1700 and / or beneath the touch display 1705. When the pressure sensor 1712 is located on the side frame of the computer device 1700, it detects the user's gripping signal to the computer device 1700 and performs left / right hand recognition or quick operation based on the gripping signal. When the pressure sensor 1712 is located beneath the touch display 1705, it can control operable controls on the UI interface based on the user's pressure operation on the touch display 1705. The operable controls include at least one of button controls, scroll bar controls, icon controls, and menu controls.

[0210] The light sensor 1713 collects ambient light intensity. In one embodiment, the processor 1701 controls the display brightness of the touch display 1705 based on the ambient light intensity collected by the light sensor 1713. Specifically, when the ambient light intensity is high, the display brightness of the touch display 1705 is increased, and when the ambient light intensity is low, the display brightness of the touch display 1705 is decreased. In another embodiment, the processor 1701 may further dynamically adjust the shooting parameters of the camera component 1706 based on the ambient light intensity collected by the light sensor 1713.

[0211] The proximity sensor 1714, also called a distance sensor, is typically located on the front of the computer equipment 1700. The proximity sensor 1714 collects the distance between the user and the front of the computer equipment 1700. In one embodiment, if the proximity sensor 1714 detects that the distance between the user and the front of the computer equipment 1700 is gradually decreasing, the processor 1701 controls the touch display 1705 to switch from a screen-on state to a screen-off state. If the proximity sensor 1714 detects that the distance between the user and the front of the computer equipment 1700 is gradually increasing, the processor 1701 controls the touch display 1705 to switch from a screen-off state to a screen-on state.

[0212] As those skilled in the art will understand, the structure in Figure 13 is not limited to the computer equipment 1700 and may include more or fewer components than shown, or may combine several components, or may use a different component arrangement.

[0213] Figure 14 is a schematic diagram of the structure of a server according to an exemplary embodiment. The server 1300 includes a Central Processing Unit (CPU) 1301, a system memory 1304 comprising Random Access Memory (RAM) 1302 and Read-Only Memory (ROM) 1303, and a system bus 1305 connecting the system memory 1304 and the Central Processing Unit 1301. The computer equipment 1300 further includes a basic input / output (I / O) system 1306 for information transmission between devices within the computer equipment, and a mass storage device 1307 for storing an operating system 1313, application programs 1314, and other program modules 1315.

[0214] The basic input / output system 1306 includes a display 1308 for displaying information and an input device 1309 for the user to input information, such as a mouse or keyboard. Both the display 1308 and the input device 1309 are connected to the central processing unit 1301 via an input / output controller 1310 connected to a system bus 1305. The basic input / output system 1306 further includes an input / output controller 1310 for receiving and processing input from several other devices such as a keyboard, mouse, or electronic stylus. Similarly, the input / output controller 1310 further provides output to a display, printer, or other type of output device.

[0215] The mass storage device 1307 is connected to the central processing unit 1301 via a mass storage controller (not shown) connected to the system bus 1305. The mass storage device 1307 and its associated computer-readable media provide non-volatile storage to the computer equipment 1300. In other words, the mass storage device 1307 may include a computer-readable media (not shown), such as a hard disk or a compact disc read-only memory (CD-ROM) drive.

[0216] Without loss of generality, the computer equipment-readable medium includes computer equipment storage mediums and communication mediums. Computer equipment storage mediums include volatile and non-volatile, removable and non-removable mediums realized by any method or technique for storing information such as computer equipment-readable instructions, data structures, program modules, or other data. Computer equipment storage mediums include RAM, ROM, Erasable Programmable Read Only Memory (EPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), CD-ROM, Digital Video Disc (DVD), or other optical storage, tape cassettes, magnetic tapes, magnetic disk storage devices, or other magnetic storage devices. Of course, as will be apparent to those skilled in the art, the computer equipment storage medium is not limited to the above-mentioned types. The system memory 1304 and mass storage devices 1307 described above are collectively referred to as memory.

[0217] Based on some embodiments of this disclosure, the server 1300 may further be connected to and run on remote computer equipment on a network, such as the Internet. That is, the computer equipment 1300 may be connected to a network 1311 via a network interface unit 1312 connected to the system bus 1305, or in other words, it may be connected to other types of networks or remote computer equipment systems (not shown) using the network interface unit 1312.

[0218] The memory may further include one or more programs, and the one or more programs are stored in the memory, and the main processor 1301 executes the one or more programs to realize all or some of the steps of the touch control display method described above.

[0219] Embodiments of this application further provide a computer device comprising a processor and memory, wherein at least one computer program is stored in the memory, and at least one computer program is read and executed by the processor, thereby realizing the touch control display method provided in each of the above embodiment of the method.

[0220] Embodiments of this application further provide a computer storage medium in which at least one computer program is stored, and at least one computer program is read and executed by a processor, thereby realizing the touch control display method provided by each embodiment of the method described above.

[0221] Embodiments of this application further provide a computer program product which includes a computer program stored in a computer-readable storage medium, and the computer program is read from the computer-readable storage medium and executed by the processor of a computer device, thereby causing the computer device to execute the touch control display method provided in each of the above embodiment of the method.

[0222] Here, “plural” as used herein refers to two or more. “And / or” describes the relationship between related objects and indicates that there are three relationships; for example, A and / or B indicates three situations: A existing independently, A and B existing together, and B existing independently. The letter “ / ” generally indicates that the related objects before and after it are in an “or” relationship.

[0223] As those skilled in the art will understand, the implementation of all or some of the steps of the above embodiments may be completed by hardware, or by instructing the relevant hardware to complete them using a program, the program being stored in a computer-readable storage medium, the storage medium being read-only memory, a magnetic disk, or an optical disk, etc.

[0224] The foregoing is not an limitation of this application, but merely a preferred embodiment thereof. Any modifications, equivalent substitutions, improvements, etc., completed within the spirit and principles of this application should fall within the scope of protection of this application.

Claims

1. A method for displaying touch controls performed by a terminal, wherein the method is: The steps include setting the first position of the user interface as the display position of the touch control and displaying the touch control, The steps include receiving multiple touch operation commands generated by performing multiple touch operations on the aforementioned touch control, The steps include determining a plurality of touch operation positions on the user interface corresponding to each of the plurality of touch operation commands, A step of determining the distribution of operation frequency based on operation records, If the touch control is a touch control on a high-frequency operation area, the steps include adjusting the display position from the first position to the second position of the user interface based on the plurality of touch operation positions, and displaying the touch control at the second position. The steps include: adjusting other touch controls on a low-frequency operation area to other areas without touch controls, thereby releasing more space for the frequently operated touch controls; A method that includes this.

2. The second position is determined based on the first click hot zone, The first click hot zone is the region where the click-through rate reaches a first threshold. The method according to claim 1, wherein the click rate of the first click hot zone is determined based on the number of touch operation positions among the plurality of touch operation positions that fall within the first click hot zone.

3. The aforementioned method, A step of determining the click rate of each candidate sub-region within the prediction region based on the touch operation position that falls within the prediction region from among the plurality of touch operation positions, wherein the prediction region is a region in the user interface that includes the touch control and has an area larger than the touch control. The method according to claim 2, further comprising the step of determining a candidate sub-region in which the click rate has reached the first threshold as the first click hot zone.

4. The aforementioned method, The steps include sending an operation record to the server to instruct the plurality of touch operation locations, The method according to claim 2, further comprising the step of receiving a second location information transmitted from the server, wherein the second location information is for indicating the second location, the second location information is determined by the server based on the operation record, the server determines the click rate of each candidate sub-region within the prediction region based on the touch operation position among the plurality of touch operation positions that falls within the prediction region, and determines the candidate sub-region whose click rate reaches a first threshold as a first click hot zone, wherein the prediction region is a region in the user interface that includes the touch control and has an area larger than the touch control.

5. The method according to claim 1 or 2, wherein the second position is determined based on a second click hot zone, the second click hot zone is a region where the number of clicks reaches a second threshold, and the number of clicks in the second click hot zone is the number of touch operation positions among the plurality of touch operation positions that belong to the second click hot zone.

6. The aforementioned method, A step of determining the number of clicks for each candidate sub-region within the prediction region based on the touch operation position among the plurality of touch operation positions that falls within the prediction region, wherein the prediction region is a region in the user interface that includes the touch control and has an area larger than the touch control. The method according to claim 5, further comprising the step of determining a candidate sub-region in which the number of clicks has reached the second threshold as the second click hot zone.

7. The aforementioned method, The steps include sending an operation record to the server to instruct the plurality of touch operation locations, The method according to claim 5, further comprising the step of receiving second location information transmitted from the server, wherein the second location information is for indicating the second location, the second location information is determined by the server based on the operation record, the server determines the number of clicks for each candidate sub-region within the prediction region based on the touch operation position among the plurality of touch operation positions that enter the prediction region, and determines the candidate sub-region whose number of clicks reaches a second threshold as a second click hot zone, the prediction region being a region in the user interface that includes the touch control and has an area larger than the touch control.

8. The second location information is either the coordinates of the second location, or The method according to claim 7, wherein the second position information is offset data of the second position relative to the first position.

9. The method for defining the candidate sub-regions is one of the following: The prediction region is divided into multiple non-overlapping rectangular candidate subregions; The aforementioned prediction region is divided into multiple non-overlapping candidate sector-shaped subregions; Using the center of the prediction region as the reference position, a plurality of circular candidate sub-regions having the same radius and partially overlapping the prediction region are set; Using the center of the touch control as the reference position, multiple circular candidate sub-regions having the same radius and partially overlapping are set in the prediction region; The method according to claim 3, wherein a plurality of circular candidate sub-regions having the same radius are set in the prediction region, centered on each of the aforementioned touch operation positions.

10. The aforementioned method, The method according to claim 1 or 2, further comprising the step of adjusting the size of the touch control based on the size and / or resolution of the user interface.

11. The aforementioned method, A step of adjusting the size of the touch control based on the plurality of touch operation positions, Or, The method according to claim 1 or 2, further comprising the step of adjusting the size of the touch control based on the touch operation position of an invalid operation among the plurality of touch operation positions that falls outside the touch control but belongs within a prediction area, wherein the prediction area is an area in the user interface that includes the touch control and has a larger area than the touch control.

12. A method for displaying touch controls performed by a server, wherein the method is: A step of receiving an operation record transmitted from a terminal for indicating multiple touch operation locations, wherein each of the multiple touch operation locations corresponds to a plurality of touch operation commands, and the plurality of touch operation commands are generated by performing multiple touch operations on the touch control. A step of determining a second position of the touch control in the user interface based on the plurality of touch operation positions, wherein the second position is obtained by adjusting the first position based on the plurality of touch operation positions, and the first position is the display position of the touch control in the user interface before the position adjustment. A step of determining the distribution of operation frequency based on operation records, If the touch control is a touch control on a high-frequency operation area, the step of instructing the terminal to display the touch control at the second location by transmitting second location information to the terminal to indicate the second location, The steps include instructing the terminal to release more space for frequently operated touch controls by adjusting other touch controls on a low-frequency operation area to other areas without touch controls, A method that includes this.

13. The method according to claim 12, wherein the second position is determined based on a first click hot zone, the first click hot zone is an area where the click rate reaches a first threshold, and the click rate of the first click hot zone is determined based on the number of touch operation positions among the plurality of touch operation positions that fall within the first click hot zone.

14. The aforementioned method, A step of determining the click rate of each candidate sub-region within the prediction region based on the touch operation position among the plurality of touch operation positions that falls within the prediction region, wherein the prediction region is a region in the user interface that includes the touch control and has an area larger than the touch control. The method according to claim 13, further comprising the step of determining a candidate sub-region in which the click rate has reached the first threshold as the first click hot zone.

15. The method according to claim 12 or 13, wherein the second position is determined based on a second click hot zone, the second click hot zone is a region where the number of clicks reaches a second threshold, and the number of clicks in the second click hot zone is the number of touch operation positions among the plurality of touch operation positions that belong to the second click hot zone.

16. The aforementioned method, A step of determining the number of clicks for each candidate sub-region within the prediction region based on the touch operation position among the plurality of touch operation positions that falls within the prediction region, wherein the prediction region is a region in the user interface that includes the touch control and has an area larger than the touch control. The method according to claim 15, further comprising the step of determining a candidate sub-region in which the number of clicks reaches the second threshold as the second click hot zone.

17. A touch control display device, wherein the device is The first position of the user interface is set as the display position of the touch control, and a display module for displaying the touch control is provided. The system includes a receiving module for receiving a plurality of touch operation commands generated by performing multiple touch operations on the touch control, and for determining a plurality of touch operation positions on the user interface corresponding to each of the plurality of touch operation commands, The aforementioned display module further, Based on the operation records, the distribution of operation frequency is determined. If the touch control is a touch control on a high-frequency operation area, the display position is adjusted from the first position to the second position of the user interface based on the plurality of touch operation positions, and the touch control is displayed at the second position. A device that releases more space for frequently operated touch controls by adjusting other touch controls on a low-frequency operation area to other areas without touch controls.

18. A touch control display device, wherein the device is A receiving module for receiving operation records for instructing multiple touch operation locations transmitted from a terminal, wherein each of the multiple touch operation locations corresponds to a multiple touch operation command, and the multiple touch operation commands are generated by performing multiple touch operations on the touch control. A determination module for determining a second position of the touch control in a user interface based on the plurality of touch operation positions, wherein the second position is obtained by adjusting the first position based on the plurality of touch operation positions, the first position is the display position of the touch control in the user interface before the position adjustment, and the determination module determines the distribution of operation frequencies based on operation records. Apparatus comprising: a transmitting module for instructing the terminal to display the touch control at a second position by transmitting a second position information to the terminal for indicating the second position, if the touch control is a touch control on a high-frequency operating area; and a transmitting module for instructing the terminal to release more space for the frequently operated touch control by adjusting other touch controls on a low-frequency operating area to other areas where there are no touch controls.

19. A computer device comprising a processor and memory, wherein at least one computer program is stored in the memory, and at least one computer program is read and executed by the processor, thereby realizing the touch control display method described in claim 1 or 2, or the touch control display method described in claim 12 or 13.

20. A computer program, wherein the computer program product includes a computer program, the computer program is stored in a computer-readable storage medium, and the computer program is read from the computer-readable storage medium and executed by the processor of a computer device, thereby causing the computer device to execute the touch control display method described in claim 1 or 2, or the touch control display method described in claim 12 or 13.

Citation Information

Patent Citations

  • Control attribute adjusting method and device, processor and electronic device

    CN113262471A

  • Display control method and device of control and electronic equipment

    CN114995930A

  • Floating navigational controls in a tablet computer

    US20130265235A1

  • Floating touch control sensing method, floating touch control sensing system, and non-transitory computer readable storage medium

    US20190272078A1

  • Rule-based user interface layout rearrangement

    US20200272313A1