Component display method and device, storage medium and electronic device
By obtaining the attitude and touch data of the terminal device and dynamically adjusting the component position, the problem that components are difficult to reach in the graphical user interface is solved and the operation comfort is improved.
Patent Information
- Application Number
- CN202410942037.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-12
- Publication Date
- 2024-11-15
AI Technical Summary
In the graphical user interface, some components are difficult to reach due to location reasons, resulting in high difficulty in user operation and poor operation comfort. Especially in strong interactive application scenarios, the existing technology is difficult to effectively solve this problem.
By acquiring the attitude data and touch operation data of the terminal device, moving the target component from one area to another in response to specific conditions, so that the user can perform touch operations more easily, and using the attitude data to determine the tilt amplitude threshold and touch operation data to determine the touch operation data to determine the tilt amplitude threshold and the touch operation data to determine the Touch points change to realize dynamic position adjustment of components.
It reduces the difficulty of touch operation of components, improves user operation comfort, and solves the problem of difficult and poor operation comfort of some components in the graphical user interface.
Smart Images

Figure CN118963881A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of graphical user interface display technology, and in particular to a component display method, device, storage medium and electronic device. Background Art
[0002] When using a terminal device, users often encounter situations where some components are set in difficult-to-reach locations within the graphical user interface. For example, when the user holds the lower part of the terminal device, it is difficult to touch components set in the upper area of the graphical user interface of the terminal device. Based on this, it is difficult for the user to operate and control the terminal device, which is prone to misoperation and poor operating comfort.
[0003] The related art usually improves user operation comfort by setting components as much as possible within the user's finger operation comfort zone in the graphical user interface. However, in some highly interactive application scenarios (such as electronic game scenarios, social media chat scenarios, online shopping scenarios, online learning scenarios, etc.), there may be more components in the graphical user interface. In this case, the solutions provided in the above-mentioned related art will be difficult to solve the above-mentioned problems of high user operation difficulty and poor operation comfort.
[0004] To address the above-mentioned problems, no effective solution has been proposed yet.
[0005] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present application, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention
[0006] At least some embodiments of the present application provide a component display method, device, storage medium and electronic device to at least solve the technical problems in the related art of difficult control operations and poor operating comfort for some components in a graphical user interface.
[0007] According to one embodiment of the present application, a component display method is provided, which provides a graphical user interface through a terminal device, wherein the graphical user interface includes a touch area, and a target component is displayed in the touch area. The component display method includes: obtaining posture data and touch operation data of the terminal device, wherein the posture data is used to determine the tilt amplitude of the terminal device, and the touch operation data is used to determine the number of touches and touch positions of multiple touch points sensed by the terminal device; in response to the posture data satisfying a first preset condition and the touch operation data satisfying a second preset condition, controlling the target component to move from a first area within the touch area to a second area within the touch area, wherein the first preset condition is used to determine a tilt amplitude threshold corresponding to the posture data, and the second preset condition is used to determine that the touch positions of at least some of the multiple touch points change and / or the number of touches of the multiple touch points change; and performing a touch operation on the target component in the second area.
[0008] According to one embodiment of the present application, a component display device is also provided, which provides a graphical user interface through a terminal device, and the graphical user interface includes a touch area. A target component is displayed in the touch area. The component display device includes: an acquisition module, used to acquire posture data and touch operation data of the terminal device, wherein the posture data is used to determine the tilt amplitude of the terminal device, and the touch operation data is used to determine the number of touches and touch positions of multiple touch points sensed by the terminal device; a control module, used to control the target component to move from a first area within the touch area to a second area within the touch area in response to the posture data satisfying a first preset condition and the touch operation data satisfying a second preset condition, wherein the first preset condition is used to determine a tilt amplitude threshold corresponding to the posture data, and the second preset condition is used to determine that the touch positions of at least some of the multiple touch points change and / or the number of touches of the multiple touch points change; and perform a touch operation on the target component in the second area.
[0009] According to one embodiment of the present application, a computer-readable storage medium is further provided, in which a computer program is stored, wherein the computer program is configured to execute any of the above-mentioned component display methods when executed by a processor.
[0010] According to one embodiment of the present application, an electronic device is also provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor is configured to run the computer program to execute any of the component display methods described above.
[0011] According to one embodiment of the present application, a computer program product is also provided, including a computer program, and when the computer program is executed by a processor, the component display method in any of the above items is implemented.
[0012] In at least some embodiments of the present application, posture data and touch operation data of the terminal device are first obtained, wherein the posture data is used to determine the tilt amplitude of the terminal device, and the touch operation data is used to determine the touch quantity and touch position of multiple touch points sensed by the terminal device, and further in response to the posture data satisfying a first preset condition and the touch operation data satisfying a second preset condition, the target component is controlled to move from a first area within the touch area to a second area within the touch area, wherein the first preset condition is used to determine a tilt amplitude threshold corresponding to the posture data, and the second preset condition is used to determine that the touch position of at least some of the multiple touch points changes and / or the touch quantity of the multiple touch points changes, and then the touch operation is performed on the target component within the second area. Therefore, the present application controls the movement of the target component according to the posture data and touch operation data of the terminal device. When realizing the touch operation function of the target component, it is not limited to the fixed setting position of the component in the graphical user interface. It achieves the purpose of moving the target component to be operated, and then realizing the touch operation of the target component in the second area, thereby achieving the technical effect of reducing the difficulty of touch operation of the target component and improving the operation comfort, and then solving the technical problems of high control operation difficulty and poor operation comfort of some components in the graphical user interface in the related technology. BRIEF DESCRIPTION OF THE DRAWINGS
[0013] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:
[0014] Figure 1 It is a hardware structure block diagram of a mobile terminal according to a component display method in one embodiment of the present application;
[0015] Figure 2 is a flow chart of a component display method according to one embodiment of the present application;
[0016] Figure 3 is a schematic diagram of an optional single-handed operation of a terminal device according to one embodiment of the present application;
[0017] Figure 4 is a schematic diagram of an optional touch operation performed on a first area according to one embodiment of the present application;
[0018] Figure 5 is a schematic diagram of an optional third area according to one embodiment of the present application;
[0019] Figure 6 is a schematic diagram of an optional process of controlling the movement of a target component according to one embodiment of the present application;
[0020] Figure 7 is a schematic diagram of an optional process of adjusting the display position of a target component according to one embodiment of the present application;
[0021] Figure 8 is a schematic diagram of an optional process of adjusting the display style of a target component according to one embodiment of the present application;
[0022] Fig. 9 is a schematic diagram of an optional process of restoring display control of a target component according to one embodiment of the present application;
[0023] Fig.10 is a schematic diagram of an optional reminder process for a target component according to one embodiment of the present application;
[0024] Fig.11 is a schematic diagram of a movement control process corresponding to an optional “component movement” function according to one embodiment of the present application;
[0025] Fig.12 is a schematic diagram of a movement control process corresponding to an optional “whole screen movement” function according to one embodiment of the present application;
[0026] Fig.13 is a structural block diagram of a component display device according to one embodiment of the present application;
[0027] Fig.14 is a schematic diagram of an electronic device according to one embodiment of the present application. DETAILED DESCRIPTION
[0028] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present application.
[0029] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0030] It should be noted that, in the specification of the present application, the word "for example" is used to mean "used as an example, illustration or description". Any embodiment described as "for example" in the present application is not necessarily interpreted as being more preferred or more advantageous than other embodiments. In order to enable any technician in the field to implement and use the present application, the following description is given. In the following description, details are listed for the purpose of explanation. It should be understood that a person of ordinary skill in the art can recognize that the present application can be implemented without using these specific details. In other examples, well-known structures and processes will not be elaborated in detail to avoid unnecessary details that make the description of the present application obscure. Therefore, the present application is not intended to be limited to the embodiments shown, but is consistent with the widest range of principles and features disclosed in the present application.
[0031] In a possible implementation manner of the present application, with respect to the relevant technical solutions commonly used in scenarios involving component touch operations in the field of graphical user interface display technology, the inventor has found, after practice and careful research, that there are still technical problems with components. Based on this, an embodiment of the present application proposes a component display method, which adopts a technical concept of controlling the target component to move from the first area within the touch area to the second area within the touch area in response to posture data satisfying a first preset condition and touch operation data satisfying a second preset condition, and then performing a touch operation on the target component within the second area. This achieves the technical effect of reducing the difficulty of touch operation of the target component and improving the operating comfort, thereby solving the technical problems of high difficulty and poor operating comfort in controlling some components in the graphical user interface in the related technology.
[0032] The above method embodiments involved in this application can be executed in a terminal device (for example, a mobile terminal, a computer terminal or a similar computing device). Taking running on a mobile terminal as an example, the mobile terminal can be a smart phone, a tablet computer, a PDA, a mobile Internet device, a game console and other terminal devices.
[0033] Figure 1 1 is a hardware structure block diagram of a mobile terminal according to a component display method in one embodiment of the present application. Figure 1 As shown, the mobile terminal may include one or more ( Figure 1 (only one is shown in the figure) processor 102, memory 104, transmission device 106, input / output device 108 and display device 110. Taking the component display method applied to an electronic game scene through the mobile terminal as an example, the processor 102 calls and runs the computer program stored in the memory 104 to execute the component display method, and the generated graphical user interface corresponding to the target component is transmitted to the input / output device 108 and / or the display device 110 through the transmission device 106, and then the graphical user interface is provided to the player.
[0034] Still like Figure 1 As shown, the processor 102 may include but is not limited to: a central processing unit (CPU), a graphics processing unit (GPU), a digital signal processing (DSP) chip, a microcontroller unit (MCU), a programmable logic device (Field Programmable Gate Array, FPGA), a neural network processor (Neural-Network Processing Unit, NPU), a tensor processor (Tensor Processing Unit, TPU), an artificial intelligence (Artificial Intelligence, AI) type processor and other processing devices.
[0035] Those skilled in the art will understand that Figure 1 The structure shown is only for illustration and does not limit the structure of the mobile terminal. Figure 1 More or fewer components as shown, or with Figure 1 Different configurations are shown.
[0036] In some optional embodiments mainly based on game scenarios, the above-mentioned terminal device can also provide a human-computer interaction interface with a touch-sensitive surface, which can sense finger contact and / or gestures to perform human-computer interaction with a graphical user interface (Graphical User Interface, GUI). The human-computer interaction function may include the following interactions: creating web pages, drawing, word processing, making electronic documents, games, video conferencing, instant messaging, sending and receiving emails, call interface, playing digital videos, playing digital music and / or web browsing, etc. The executable instructions for executing the above-mentioned human-computer interaction functions are configured / stored in a computer program product or readable storage medium executable by one or more processors.
[0037] The above method embodiments involved in this application can also be executed in a server. Among them, the server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (Content Delivery Network, CDN), and basic cloud computing services such as big data and artificial intelligence platforms. Taking the application of the component display method to an electronic game scene through an electronic game server as an example, the electronic game server can generate a graphical user interface corresponding to the target component based on the component display method, and provide the graphical user interface to the player (for example, it can be rendered and displayed on the display screen of the player's terminal, or provided to the player through holographic projection, etc.).
[0038] According to one embodiment of the present application, an embodiment of a component display method is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.
[0039] In this embodiment, a component display method running on the above mobile terminal is provided. Figure 2 is a flow chart of a component display method according to one embodiment of the present application, wherein a graphical user interface is provided by a terminal device, the graphical user interface includes a touch area, and a target component is displayed in the touch area, such as Figure 2 As shown, the method includes the following steps S21 to S23.
[0040] Step S21, acquiring posture data and touch operation data of the terminal device, wherein the posture data is used to determine the tilt amplitude of the terminal device, and the touch operation data is used to determine the touch quantity and touch position of multiple touch points sensed by the terminal device.
[0041] The terminal device may be a computer terminal device, a mobile terminal device, etc. The terminal device is equipped with a display device, which can display a graphical user interface. Part or all of the graphical user interface area can be set as a touch area, and the user performs a touch operation on the component displayed in the touch area to trigger the component function corresponding to the component.
[0042] The above-mentioned graphical user interface may be an operating system interface, a game software interface, an office software interface, a web browser interface, an image processing software interface, etc. In particular, the game types corresponding to the above-mentioned game software interface may be: action games (for example: first-person or third-person shooting games, two-dimensional or three-dimensional fighting games, war action games and sports action games, etc.), adventure games (for example: exploration games, collection games, puzzle games, etc.), simulation games (for example: simulation sandbox games, simulation development games, strategy simulation games, city building simulation games, business simulation games, etc.), role-playing games and leisure games (for example: chess and card table games, casual competitive games, music rhythm games, dress-up development games, etc.), etc.
[0043] The above-mentioned target component can be a unit component such as a button component, an image component, an input box component, a slider component, a menu component, a label component, etc., or it can be a composite component containing at least one of the above-mentioned unit components (for example, a map component, an interactive message component, an equipment bar component, etc.).
[0044] The posture data of the above-mentioned terminal device may include the device tilt information collected in real time by the posture sensor (for example, gyroscope, accelerometer, magnetometer, etc.) equipped with the terminal device. The device tilt data may include: tilt angle, tilt speed, tilt direction, tilt amplitude and tilt duration, etc.
[0045] The above-mentioned touch operation data may include touch point information collected in real time by a touch sensor installed in the terminal device, and the touch point information may include the number of touches and touch positions of multiple touch points sensed by the terminal device, and the touch positions may be represented by screen coordinates in a graphical user interface. For example, in an electronic game application scenario, the multiple touch points corresponding to the game graphical user interface may be touch points corresponding to touch operations (such as single-finger touch operations, multi-finger touch operations, etc.) performed by a player on the touch screen of the terminal device.
[0046] When the terminal device is running, posture data and touch operation data are acquired in real time. The real-time tilt amplitude of the terminal device is considered through the posture data. The touch operation data is used to consider the touch operations performed by the user of the terminal device on the terminal device in real time, and the user's touch operation intentions are inferred, thereby making control decisions on the target components.
[0047] Step S22, in response to the posture data satisfying the first preset condition and the touch operation data satisfying the second preset condition, controlling the target component to move from the first area within the touch area to the second area within the touch area, wherein the first preset condition is used to determine the tilt amplitude threshold corresponding to the posture data, and the second preset condition is used to determine that the touch positions of at least some of the multiple touch points change and / or the touch numbers of the multiple touch points change.
[0048] The posture data satisfying the first preset condition can indicate that the tilt amplitude of the terminal device reaches the corresponding tilt amplitude threshold. At this time, it can be considered that the terminal device has tilted and flipped to a large extent, and it can be inferred that the user's holding posture of the terminal device (such as a smart phone) has changed.
[0049] The touch operation data satisfying the second preset condition can represent the occurrence of at least one of the following events: the touch positions of some of the multiple touch points change; the number of touches of the multiple touch points changes; when the touch position of at least one touch point changes, the number of touch points sensed by the terminal device also changes.
[0050] In the application scenario, when it is detected that the posture data satisfies the first preset condition and the touch operation data satisfies the second preset condition, it can be inferred that the user has the intention to touch the target component at this time, that is, while the user's holding posture of the terminal device changes, the touch operation of the terminal device also changes the touch position and / or the touch electricity quantity. Based on this, the target component originally located in the first area can be controlled to move from the first area to the second area.
[0051] Step S23: performing a touch operation on the target component in the second area.
[0052] In the application scenario, the difficulty of the user performing touch operations on the components in the first area is higher than the difficulty of performing touch operations on the components in the second area. After the control target component is moved to the second area for display, the user can perform touch operations on the target component displayed in the second area. Therefore, the above method steps provided in the embodiment of the present application can detect the data of the terminal device in real time, and move the target component from the first area to the second area when specific conditions are met, so as to facilitate the user to perform touch operations on the target component, reduce the difficulty of the user's touch operation, and improve the user's operating comfort.
[0053] Specifically, part or all of the above steps S21 to S23 may also include other method steps, which can be referred to the further introduction of the embodiments of the present application below and will not be repeated here.
[0054] In an embodiment of the present application, posture data and touch operation data of the terminal device are first obtained, wherein the posture data is used to determine the tilt amplitude of the terminal device, and the touch operation data is used to determine the touch quantity and touch position of multiple touch points sensed by the terminal device, and further in response to the posture data satisfying a first preset condition and the touch operation data satisfying a second preset condition, the target component is controlled to move from a first area within the touch area to a second area within the touch area, wherein the first preset condition is used to determine a tilt amplitude threshold corresponding to the posture data, and the second preset condition is used to determine that the touch position of at least some of the multiple touch points changes and / or the touch quantity of the multiple touch points changes, and then the touch operation is performed on the target component within the second area. Therefore, the present application controls the movement of the target component according to the posture data and touch operation data of the terminal device. When realizing the touch operation function of the target component, it is not limited to the fixed setting position of the component in the graphical user interface. It achieves the purpose of moving the target component to be operated, and then realizing the touch operation of the target component in the second area, thereby achieving the technical effect of reducing the difficulty of touch operation of the target component and improving the operation comfort, and then solving the technical problems of high control operation difficulty and poor operation comfort of some components in the graphical user interface in the related technology.
[0055] The following uses an electronic game application scenario as an example to further illustrate other optional method steps included in the above-mentioned component display method of the embodiment of the present application.
[0056] Optionally, in step S22, the posture data satisfies the first preset condition, which may include the following execution steps:
[0057] Step S221: determining, based on the posture data, that the real-time tilt angle of the terminal device is greater than a tilt amplitude threshold, wherein the tilt amplitude threshold is determined by the setting operation data in the operation setting event.
[0058] Through the posture data collected in real time, the real-time tilt angle of the terminal device can be determined, and whether the real-time tilt angle is greater than the tilt amplitude threshold can be determined whether the posture data meets the first preset condition. For example, the real-time tilt angle includes the deflection angle relative to the X-axis, Y-axis and Z-axis in the three-dimensional space coordinate system. Correspondingly, the tilt amplitude threshold can also include the angle component threshold relative to the X-axis, Y-axis and Z-axis. Based on this, the condition that the real-time tilt angle is greater than the tilt amplitude threshold can be set to one of the following: among the three angle components corresponding to the X-axis, Y-axis and Z-axis, at least one component is greater than the corresponding component threshold, then it is determined that the real-time tilt angle is greater than the tilt amplitude threshold; among the three angle components corresponding to the X-axis, Y-axis and Z-axis, at least two components are greater than the corresponding component threshold, then it is determined that the real-time tilt angle is greater than the tilt amplitude threshold; the three angle components corresponding to the X-axis, Y-axis and Z-axis are all greater than the corresponding component threshold, then it is determined that the real-time tilt angle is greater than the tilt amplitude threshold.
[0059] In an application scenario, the tilt amplitude threshold may be determined by the user through preference settings, or may be determined by the user's setting operation data in an operation setting event.
[0060] Through the above-mentioned step S221, the embodiment of the present application determines the first preset condition through the tilt amplitude threshold. When the terminal device is running, it detects in real time whether the posture data meets the first preset condition. When the real-time tilt angle of the terminal device is greater than the tilt amplitude threshold, it is determined that the posture data meets the first preset condition. At this time, it can be inferred that the user's holding posture of the terminal device has changed.
[0061] Optionally, the above component display method may further include the following execution steps:
[0062] Step S241, in response to an operation setting event, obtaining a first tilt angle of the terminal device when performing a first setting operation and a second tilt angle of the terminal device when performing a second setting operation, wherein the first setting operation is a touch operation performed by the terminal device on a first area in a one-handed operation mode, and the second setting operation is a touch operation performed on a second area in the one-handed operation mode, the first area is used to determine a touch restricted range before the posture data changes, and the second area is used to determine a current touchable range before the posture data changes;
[0063] Step S242: determining a tilt amplitude threshold based on the first tilt angle and the second tilt angle.
[0064] According to the above optional implementation, in an application scenario, when an operation setting event is triggered, the user specifies a touch operation on the terminal device in a one-handed operation mode, obtains operation data corresponding to the touch operation, and determines a tilt amplitude threshold based on the operation data.
[0065] Specifically, in the one-handed operation mode, before the user's holding posture of the terminal device changes (that is, the above-mentioned posture data changes), it is difficult for the user to perform touch operations on a part of the area in the graphical user interface. For example, it is difficult for the user to touch this part of the area when operating with one hand. The range corresponding to this part of the area in the graphical user interface is determined as the touch-restricted range, and this part of the area is called the first area. Correspondingly, before the holding posture changes, it is less difficult for the user to perform touch operations on another part of the graphical user interface. For example, the user can easily or comfortably touch this other part of the area when operating with one hand. The range corresponding to this other part of the area in the graphical user interface is determined as the current touchable range, and this other part of the area is called the second area.
[0066] For example, in one application scenario, the terminal device is a smart phone, and the user uses the right hand to perform a vertical screen touch operation on the smart phone, as shown in the operation diagram. Figure 3 As shown, when a user usually holds the mobile phone in one hand, he or she performs touch operations on the screen with the thumb, and the area that the thumb can touch conveniently and comfortably is determined as the second area, and the other touch areas in the graphical user interface except the second area are determined as the first area.
[0067] In the operation setting event, the user will perform a series of preset touch operations, which at least include a first setting operation performed on the first area and a second setting operation performed on the second area. The first tilt angle of the terminal device when the user performs the first setting operation and the second tilt angle of the terminal device when the user performs the second setting operation are obtained, and the tilt amplitude threshold is further determined according to the first tilt angle and the second tilt angle.
[0068] Specifically, for example, a user performs multiple first setting operations for multiple preset positions in a first area, and records the first angle range of the first tilt angle corresponding to the multiple first setting operations. The user performs multiple second setting operations for multiple preset positions in a second area, and records the second angle range of the second tilt angle corresponding to the multiple second setting operations. According to the first angle range and the second angle range, an angle demarcation value is determined as the tilt angle threshold. For example, in the direction relative to the Y axis, the first angle range is 30° to 45°, and the second angle range is 0° to 10°. According to the application scenario requirements, the middle value 20° between 30° and 10° can be determined as the angle component threshold in the direction relative to the Y axis. According to the application scenario requirements, 30° can also be determined as the angle component threshold in the direction relative to the Y axis. The embodiment of the present application does not limit the specific determination strategy of the tilt amplitude threshold.
[0069] Through the above steps S241 to S242, the embodiment of the present application determines the tilt amplitude threshold by operating the setting event, can personalize the first preset condition according to the user's operating habits, and more accurately judge whether the posture data meets the first preset condition, so that the component display method is more in line with the user's usage habits.
[0070] Optionally, in step S22, the touch operation data satisfies the second preset condition, which includes at least one of the following:
[0071] Condition C1: the touch positions of at least some of the touch points change to within the third area, wherein the third area is the false touch occurrence area corresponding to the target component;
[0072] Condition C2: the number of touches of the plurality of touch points increases, and the touch positions of the newly added touch points are within the third area.
[0073] The above touch operation data includes the touch positions and touch quantities of the multiple touch points. According to the changes in the touch positions and touch quantities, it is possible to determine whether the touch operation data meets the second preset condition.
[0074] In the application scenario, the terminal device is a smart phone, and the user uses his right hand to perform a vertical screen touch operation on the smart phone. Figure 4 is a schematic diagram of a user performing a touch operation on a first area. When the user wants to perform a touch operation on a component in the first area, the user may change the holding posture of the smartphone, that is, from Figure 3 The holding posture shown changes to Figure 4 In the holding posture shown, when the user performs a touch operation on the components in the first area, the palm of the user's right hand may also accidentally touch the lower right touch area in the graphical user interface. Based on this, the lower right area in the graphical user interface can be determined as the area where the accidental touch occurs, that is, the third area. In the right-handed single-handed vertical screen operation mode, when the target component is set in the upper left area of the graphical user interface, the determined third area can be as follows Figure 5 shown.
[0075] When the multiple touch points sensed by the terminal device include touch points in the third area, it can be determined that the above condition C1 is satisfied. It can also be understood that when the touch positions of at least some of the multiple touch points change to the third area, it is determined that the above condition C1 is satisfied.
[0076] In addition, when a user wants to perform a touch operation on a component in the first area and causes an accidental touch in the third area, the number of touch points may also increase. Therefore, when the number of touches sensed by the terminal device at multiple touch points increases and the increased touch points are located in the third area, it can be determined that the above condition C2 is met.
[0077] In an application scenario, when it is detected that at least one of the above conditions C1 and C2 is met, it can be determined that the touch operation data meets the second preset condition, and further it can be inferred that the current user has a touch intention on the target component.
[0078] Through the conditions C1 and C2 set in the above step S22, the embodiment of the present application can determine whether an accidental touch event of the touch area currently occurs according to the touch operation data and the accidental touch occurrence area. If an accidental touch occurs on the accidental touch occurrence area corresponding to the target component, it can be inferred that the current user has a touch intention on the target component. Further, in combination with whether the aforementioned posture data satisfies the first preset condition and whether the touch operation data satisfies the second preset condition, it can be determined whether the target component needs to be moved and controlled at present.
[0079] Optionally, in step S22, controlling the target component to move from the first area within the touch area to the second area within the touch area may include the following execution steps:
[0080] Step S222: Control the target component to move from the initial display position in the first area to the target display position in the second area.
[0081] According to the above optional execution steps, when it is determined that the posture data satisfies the first preset condition and the touch operation data satisfies the second preset condition, it is determined that the user currently has a touch intention on the target component. Since the first area is a touch restricted area, it is difficult for the user to touch the target component displayed at the initial display position in the first area. At this time, the target component is controlled to move from the initial display position in the first area to the target display position in the second area. The second area is the current touchable area, and the target display position can be a to-be-displayed position pre-specified for the target component in the second area.
[0082] In an exemplary application scenario, the process of controlling the movement of the target component is as follows: Figure 6 When it is detected that the posture data of the smartphone meets the first preset condition and the touch operation data meets the second preset condition, the target component initially displayed in the first area is controlled to move to the target display position in the second area. Visually, the target component "slides down" from the initial display position to the target display position in the graphical user interface, achieving the effect of the target component "actively approaching" the user's finger when the user wants to touch the target component.
[0083] Therefore, the embodiments of the present application are not limited to a fixed component layout on a graphical user interface, but when it is inferred that the user currently has a touch intention on a target component in the touch restricted area, the target component is moved from the touch restricted area to the current touchable area to facilitate the user to complete the touch operation.
[0084] Through the above step S222, the embodiment of the present application moves the target component from the touch restricted area to the current touchable area, which facilitates the user to implement the touch function of the target component in the current touchable area, reduces the difficulty of touch operation on the target component, and improves the comfort of touch operation.
[0085] Optionally, the above component display method may further include the following execution steps:
[0086] Step S25 , in response to the first touch operation performed on the target component, adjusting the target display position to the operation end position of the first touch operation.
[0087] According to the above optional execution steps, after the target component is moved to the target display position in the second area, the user can also specify a first touch operation on the target component to adjust the display position of the target component.
[0088] In an exemplary application scenario, the process of adjusting the display position of the target component is as follows: Figure 7 The user can perform a drag touch operation on the target component displayed at the target display position in the second area ( Figure 7 In the example of horizontal dragging to the right), in response to the drag touch operation, the target component can be controlled to move within the graphical user interface following the touch point of the drag touch operation until the first touch operation ends, and the target component is displayed at the operation end position of the first touch operation.
[0089] Through the above-mentioned step S25, the embodiment of the present application determines the operation end position of the first touch operation as the target display position of the target component in the second area. Based on this, the user can adjust the target display position of the target component by performing the first touch operation (such as dragging the touch operation) on the target component. For example, adjust it to the habitual operation position or a position that will not cause occlusion to other scene elements in the virtual scene screen, thereby improving the user's operating flexibility. The above-mentioned method steps can be flexibly applied to more and more complex component display scenarios.
[0090] Optionally, the target component includes a plurality of components to be moved; in step S22, controlling the target component to move from a first area within the touch area to a second area within the touch area may include the following execution steps:
[0091] Step S223 , controlling the multiple components to be moved to move from the first area to the second area according to the operation priorities corresponding to the multiple components to be moved.
[0092] According to the above-mentioned optional execution steps, the embodiment of the present application also takes into account the situation where there are multiple target components to be touched in the first area. These multiple target components to be touched may be components that are functionally related. When the posture data of the terminal device satisfies the first preset condition and the touch operation data satisfies the second preset condition, the above-mentioned multiple target components to be touched are determined as multiple components to be moved.
[0093] In the application scenario, the graphical user interface may also include a component combination, which includes multiple components. The user can implement the function corresponding to the component combination by performing a set of touch operations on the component combination in sequence. For example, the component combination (i.e., the target component) may be a virtual equipment bar, which may include an equipment bar button and multiple equipment components in an equipment bar window that pops up after the motor equipment bar button. If the equipment bar buttons are distributed in the first area, it is difficult for the user to perform touch operations on the equipment bar buttons in the one-handed operation mode. At this time, according to the above-mentioned execution steps provided in the embodiment of the present application, the multiple components included in the virtual equipment bar can be determined as multiple components to be moved, and the multiple components to be moved can be moved. For example, the equipment bar button is first controlled to move from the first area to the second area, and after the user clicks the equipment bar button, the pop-up equipment bar window is moved from the first area to the second area.
[0094] It should be noted that the operation priority of the above-mentioned multiple components to be moved can be determined according to the touch operation order determined by the component function corresponding to the target component. For example, in the virtual equipment bar, the operation priority of the equipment bar button is higher than the operation priority of the equipment bar window.
[0095] Through the above-mentioned step S223, the embodiment of the present application can also realize the function of moving multiple components to be moved. According to the operation priority, the multiple components to be moved are moved to the current touchable area, which can support the user to conveniently and comfortably perform touch operations on the moved target components to realize the corresponding touch functions.
[0096] Optionally, the above component display method may further include the following execution steps:
[0097] Step S26, adjusting the display style of the target component in the second area according to the target display rule, wherein the target display rule is used to determine the parameters to be adjusted corresponding to the display style, and the parameters to be adjusted include at least one of the following: display size, display color, display brightness, display transparency, and dynamic effect parameters.
[0098] The above target display rules may be display rules corresponding to the target components preset according to the application scenario requirements. For example, when the target component is a virtual thumbnail map component, the display rules corresponding to the target component may include: "Zoom in after moving", 1.5 (indicating that the display size is enlarged by 1.5 times). For example, when the target component is a virtual equipment bar component, the display rules corresponding to the target component may include: "Highlight after moving", 200% (indicating that the display brightness is adjusted to 200% of the basic brightness value).
[0099] In the application scenario, when it is detected that the posture data meets the first preset condition and the touch operation data meets the second preset condition, the target display rule corresponding to the target component is obtained, and after the target component is controlled to move to the second area, the display style of the target component is adjusted according to the target display rule.
[0100] In an exemplary application scenario, the process of adjusting the display style of the target component is as follows: Figure 8 After the target component is moved to the second area, the parameters to be adjusted of the target component are determined according to the target display rule, including the display size and the display color, and the scaling factor corresponding to the display size and the target color corresponding to the display color are further determined ( Figure 8 The adjusted target color is indicated by diagonal hatching in the figure), the display size of the target component displayed in the second area is scaled according to the scaling factor, and the display color of the target component displayed in the second area is adjusted to the target color.
[0101] Through the above-mentioned step S26, the embodiment of the present application can also adapt to various display requirements for target components in application scenarios. While reducing the difficulty of users' observation and touch operation of target components and improving the convenience of users' operation of target components, it also enhances the flexibility of component layout in the graphical user interface and improves the richness of the picture.
[0102] Optionally, the above component display method may further include the following execution steps:
[0103] Step S27 , in response to a second touch operation performed on the target component displayed in the second area, controlling the target component to be restored to an initial display position in the first area for display.
[0104] According to the above-mentioned designated steps, when it is detected that the user performs a second touch operation on the target component displayed in the second area, the target component can be controlled to move to restore the initial display position in the first area for display.
[0105] In an exemplary application scenario, the process of restoring display control of the target component is as follows: Fig. 9As shown, the user can perform a control operation of swiping upward on the target component displayed in the second area, and at this time, the control target component is restored to be displayed at the original display position in the first area.
[0106] In addition, in the application scenario, the target component's recovery display trigger condition can also be set to the completion of the user's touch operation on the target component displayed in the second area. That is, in response to the completion of the fourth touch operation on the target component displayed in the second area, the target component is controlled to be restored to the initial display position in the first area for display.
[0107] Through the above-mentioned step S27, the embodiment of the present application can control the target component to be restored to the initial display position of the first area for display. That is to say, when the embodiment of the present application detects the user's touch intention on the target component, it temporarily controls the target component to move to the current touchable area within the touch area. While facilitating user operation, it will not cause display obstruction of the display screen or other components in the second area.
[0108] Optionally, the above component display method may further include the following execution steps:
[0109] Step S281, in response to a second touch operation performed within a target time period after the target component is moved to the second area, displaying a reminder component in the graphical user interface;
[0110] Step S282, in response to the third touch operation performed on the reminder component, stop controlling the target component to move from the first area to the second area.
[0111] According to the above optional execution steps, after the control target component is moved to the second area, the user performs a second touch operation (for controlling the target component to be restored to display in the first area) within the target duration, and it is determined that the user does not currently have a touch demand for the target component. At this time, while the control target component is restored to the initial display position in the first area for display, a reminder component is popped up in the graphical user interface, and the reminder component is used to determine whether the user needs to turn off the automatic movement function of the target component. If it is detected that the user performs a third touch operation on the reminder component, the control target component is stopped from moving from the first area to the second area.
[0112] In an exemplary application scenario, the reminder process for the target component is as follows: Fig.10As shown. When it is detected that the target component moves to the second area within the target time (for example, it can be set to 1 second), the user performs a touch operation of swiping upward on the target component to control the target component to restore the display in the first area, and then a reminder component pops up in the graphical user interface, and the reminder component displays a reminder message "Do you want to turn off the automatic sliding function?" If it is detected that the user performs a third touch operation on the reminder component (such as clicking, swiping left, etc.), the control of the target component from the first area to the second area is stopped. For example, the control of the target component to move to the second area according to the posture data and touch operation data can be stopped in the current game, or the function of controlling the target component to move to the second area according to the posture data and touch operation data in all game games can be turned off (until the user turns on this function through the preference setting).
[0113] In addition, when the fifth touch operation performed by the user on the reminder component (for example, swiping right, etc.) is detected or the user is not detected performing a touch operation on the reminder component within the preset time period, the function of continuing to obtain posture data and touch operation data in real time and continuing to control the target component to move to the second area according to the posture data and touch operation data is turned on.
[0114] Through the above-mentioned steps S281 to S282, the embodiment of the present application also takes into account the real-time changes in the user's demand for the automatic movement function of the target component during the operation of the terminal device, and provides a solution for turning off or temporarily turning off the function, thereby avoiding the user's need to avoid triggering the target component to move to the second area when the function is not needed or the need to frequently restore the target component to move to the first area for display through a second touch operation, thereby improving the user's operating fluency and operating experience, and enhancing the applicability of the component display method in the embodiment of the present application to various application scenarios.
[0115] Through the aforementioned optional execution steps of the embodiment of the present application, the "component movement" function can be realized. A movement control process corresponding to the "component movement" function in an application scenario is as follows: Fig.11 As shown, when it is detected that the posture data satisfies the first preset condition and the touch operation data satisfies the second preset condition, the target component is controlled to automatically move downward within the touch area of the terminal device. The implementation effect of the above-mentioned "component movement" function can be that while the target component moves, other display contents within the touch area of the terminal device do not move. In this way, the user can perform a touch operation on the target component temporarily moved to the second area for display while observing other information displayed in the graphical user interface.
[0116] Optionally, the above component display method may further include the following execution steps:
[0117] Step S29, in response to the posture data satisfying the first preset condition and the touch operation data satisfying the second preset condition, controlling the scene screen displayed in the graphical user interface to move toward the target direction, wherein the scene screen is at least a partial display screen of the virtual scene corresponding to the target component, and the target direction is determined by the moving direction of the target component during the process of moving from the first area to the second area.
[0118] In the application scenario, the target component may also have some connection with the scene screen displayed in the graphical user interface. When it is detected that the gesture data meets the first preset condition and the touch operation data meets the second preset condition, the scene screen can be controlled to move simultaneously while the target component is controlled to move from the first area to the second area, that is, "full screen movement" is achieved. The moving direction of the above scene screen can be consistent with the moving direction of the target component in the graphical user interface.
[0119] In an exemplary application scenario, the aforementioned optional execution steps of the embodiment of the present application can also realize the "full screen movement" function. The movement control process corresponding to the "full screen movement" function in the application scenario is as follows: Fig.11 As shown, when it is detected that the posture data meets the first preset condition and the touch operation data meets the second preset condition, the target component is controlled to automatically move downward within the touch area of the terminal device, and the corresponding scene screen is also controlled to move downward.
[0120] Optionally, in step S29, controlling the scene image displayed in the graphical user interface to move toward the target direction may include the following execution steps:
[0121] Step S291, controlling the scene image to move a target distance in a target direction, wherein the target distance is determined by a moving distance of the target component in a process of moving from a first area to a second area.
[0122] Still like Fig.12 As shown, when controlling the scene screen to move in the target direction, the target distance of the scene screen movement can be equal to the moving distance of the target component, that is, the target component moves synchronously with the scene screen, and the mapping position relationship between the target component and the scene screen is fixed during the movement, thereby realizing the "whole screen movement" function.
[0123] Through the above-mentioned method steps provided in the embodiment of the present application, by considering the posture data and touch operation data of the terminal device, the operation intention of the terminal device corresponding to the user is inferred, and when the specified conditions are met, the target component is controlled to move from the touch restricted area to the current touchable area. This can help users to more easily perform touch operations on components set on the edge of the graphical user interface, reduce the difficulty of touch operations, and improve the user operation experience.
[0124] In addition, the embodiment of the present application can not only determine the display position of the target component according to the user's historical touch operation, but also support the user to adjust the display position of the target component, so that the touch operation performed by the user on the graphical user interface is not limited to a fixed component layout, but realizes personalized customization of the interface while realizing general operation functions. The specific movement mode, display rules, etc. of the above-mentioned target component in the embodiment of the present application can be flexibly set according to the application scenario.
[0125] Through the description of the above implementation methods, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as a disk, an optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.
[0126] In this embodiment, a component display device is also provided, which is used to implement the above-mentioned embodiments and preferred implementation modes, and the descriptions that have been made will not be repeated. As used below, the term "module" can implement a combination of software and / or hardware of a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceivable.
[0127] Fig.13 is a structural block diagram of a component display device according to one embodiment of the present application, wherein a graphical user interface is provided through a terminal device, and the graphical user interface includes a touch area, and a target component is displayed in the touch area, such as Fig.13 As shown, the device comprises:
[0128] An acquisition module 1301 is used to acquire posture data and touch operation data of a terminal device, wherein the posture data is used to determine the tilt amplitude of the terminal device, and the touch operation data is used to determine the touch quantity and touch position of multiple touch points sensed by the terminal device;
[0129] A control module 1302, configured to control the target component to move from a first area within the touch area to a second area within the touch area in response to the gesture data satisfying a first preset condition and the touch operation data satisfying a second preset condition, wherein the first preset condition is used to determine a tilt amplitude threshold corresponding to the gesture data, and the second preset condition is used to determine that the touch positions of at least some of the touch points among the multiple touch points change and / or the touch quantities of the multiple touch points change;
[0130] The execution module 1303 is used to perform a touch operation on the target component in the second area.
[0131] Optionally, in the above control module 1302, the posture data satisfies the first preset condition including: determining, based on the posture data, that the real-time tilt angle of the terminal device is greater than a tilt amplitude threshold, wherein the tilt amplitude threshold is determined by the setting operation data in the operation setting event.
[0132] Optionally, in addition to all the above-mentioned modules, the above-mentioned component display device also includes a setting module 1304 (not shown in the figure), which is used to: respond to an operation setting event, obtain a first tilt angle of the terminal device when performing a first setting operation and a second tilt angle of the terminal device when performing a second setting operation, wherein the first setting operation is a touch operation performed by the terminal device on a first area in a one-handed operation mode, and the second setting operation is a touch operation performed on a second area in a one-handed operation mode, the first area is used to determine a touch restricted range before the posture data changes, and the second area is used to determine a current touchable range before the posture data changes; based on the first tilt angle and the second tilt angle, determine the tilt amplitude threshold.
[0133] Optionally, in the above-mentioned control module 1302, the touch operation data satisfies the second preset condition including at least one of the following: the touch position of at least part of the touch points changes to a third area, wherein the third area is the false touch occurrence area corresponding to the target component; the number of touches of multiple touch points increases, and the touch positions of the newly added touch points are within the third area.
[0134] Optionally, the control module 1302 is further configured to: control the target component to move from an initial display position in the first area to a target display position in the second area.
[0135] Optionally, the control module 1302 is further configured to: in response to a first touch operation performed on a target component, adjust the target display position to an operation end position of the first touch operation.
[0136] Optionally, the target component includes a plurality of components to be moved; the control module 1302 is further used to: control the plurality of components to be moved to move from the first area to the second area according to the operation priorities corresponding to the plurality of components to be moved.
[0137] Optionally, in addition to all the above-mentioned modules, the above-mentioned component display device also includes an adjustment module 1305 (not shown in the figure), which is used to: adjust the display style of the target component in the second area according to the target display rules, wherein the target display rules are used to determine the parameters to be adjusted corresponding to the display style, and the parameters to be adjusted include at least one of the following: display size, display color, display brightness, display transparency, and dynamic effect parameters.
[0138] Optionally, in addition to all the above modules, the component display device also includes a recovery module 1306 (not shown in the figure), which is used to: respond to the second touch operation performed on the target component displayed in the second area, and control the target component to restore to the initial display position in the first area for display.
[0139] Optionally, in addition to all the above-mentioned modules, the above-mentioned component display device also includes a reminder module 1307 (not shown in the figure), which is used to: display a reminder component in the graphical user interface in response to a second touch operation performed within a target time length after the control target component moves to the second area; and stop controlling the target component from moving from the first area to the second area in response to a third touch operation performed on the reminder component.
[0140] Optionally, in addition to all the above-mentioned modules, the above-mentioned component display device also includes a screen movement module 1308 (not shown in the figure), which is used to: in response to the posture data satisfying the first preset condition and the touch operation data satisfying the second preset condition, control the scene screen displayed in the graphical user interface to move toward the target direction, wherein the scene screen is at least a partial display screen of the virtual scene corresponding to the target component, and the target direction is determined by the moving direction of the target component in the process of moving from the first area to the second area.
[0141] Optionally, the above-mentioned picture movement module 1308 is also used to: control the scene picture to move a target distance in a target direction, wherein the target distance is determined by the moving distance of the target component in the process of moving from the first area to the second area.
[0142] It should be noted that the above modules can be implemented by software or hardware. For the latter, it can be implemented in the following ways, but not limited to: the above modules are all located in the same processor; or the above modules are located in different processors in any combination.
[0143] An embodiment of the present application further provides a computer-readable storage medium, in which a computer program is stored, wherein the computer program is configured to execute the steps of any of the above method embodiments when running.
[0144] Optionally, in this embodiment, the above-mentioned computer-readable storage medium may include but is not limited to: a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk, and other media that can store computer programs.
[0145] Optionally, in this embodiment, the computer-readable storage medium may be located in any one of the computer terminals in a computer terminal group in a computer network, or in any one of the mobile terminals in a mobile terminal group.
[0146] Optionally, in this embodiment, the computer-readable storage medium may be configured to store a computer program for performing the following steps:
[0147] S1, acquiring posture data and touch operation data of the terminal device, wherein the posture data is used to determine the tilt amplitude of the terminal device, and the touch operation data is used to determine the touch quantity and touch position of multiple touch points sensed by the terminal device;
[0148] S2, in response to the gesture data satisfying a first preset condition and the touch operation data satisfying a second preset condition, controlling the target component to move from a first area within the touch area to a second area within the touch area, wherein the first preset condition is used to determine a tilt amplitude threshold corresponding to the gesture data, and the second preset condition is used to determine that the touch positions of at least some of the multiple touch points change and / or the touch quantities of the multiple touch points change;
[0149] S3, performing a touch operation on the target component in the second area.
[0150] Optionally, the computer-readable storage medium is further configured to store program code for executing the following steps: determining, based on the posture data, that the real-time tilt angle of the terminal device is greater than a tilt amplitude threshold, wherein the tilt amplitude threshold is determined by setting operation data in an operation setting event.
[0151] Optionally, the above-mentioned computer-readable storage medium is also configured to store program codes for performing the following steps: responding to an operation setting event, obtaining a first tilt angle of the terminal device when performing a first setting operation and a second tilt angle of the terminal device when performing a second setting operation, wherein the first setting operation is a touch operation performed by the terminal device on a first area in a one-handed operation mode, and the second setting operation is a touch operation performed on a second area in a one-handed operation mode, the first area is used to determine a touch restricted range before the posture data changes, and the second area is used to determine a current touchable range before the posture data changes; based on the first tilt angle and the second tilt angle, determine a tilt amplitude threshold.
[0152] Optionally, the computer-readable storage medium is also configured to store program codes for executing the following steps: the touch positions of at least some of the touch points change to within a third area, wherein the third area is a false touch occurrence area corresponding to the target component; the number of touches of multiple touch points increases, and the touch positions of the newly added touch points are within the third area.
[0153] Optionally, the computer-readable storage medium is further configured to store a program code for executing the following steps: controlling the target component to move from an initial display position in the first area to a target display position in the second area.
[0154] Optionally, the computer-readable storage medium is further configured to store a program code for executing the following steps: in response to a first touch operation performed on a target component, adjusting a target display position to an operation end position of the first touch operation.
[0155] Optionally, the computer-readable storage medium is further configured to store program codes for executing the following steps: the target component includes multiple components to be moved; and the multiple components to be moved are controlled to move from the first area to the second area according to the operation priorities corresponding to the multiple components to be moved.
[0156] Optionally, the above-mentioned computer-readable storage medium is also configured to store program code for executing the following steps: adjusting the display style of the target component in the second area according to the target display rule, wherein the target display rule is used to determine the parameters to be adjusted corresponding to the display style, and the parameters to be adjusted include at least one of the following: display size, display color, display brightness, display transparency, and dynamic effect parameters.
[0157] Optionally, the computer-readable storage medium is further configured to store program codes for executing the following steps: in response to a second touch operation performed on a target component displayed in the second area, controlling the target component to be restored to an initial display position in the first area for display.
[0158] Optionally, the computer-readable storage medium is also configured to store program codes for executing the following steps: in response to a second touch operation performed within a target time period after the control target component moves to the second area, displaying a reminder component in a graphical user interface; in response to a third touch operation performed on the reminder component, stopping controlling the target component from moving from the first area to the second area.
[0159] Optionally, the computer-readable storage medium is also configured to store program codes for executing the following steps: in response to the posture data satisfying a first preset condition and the touch operation data satisfying a second preset condition, controlling the scene screen displayed in the graphical user interface to move toward a target direction, wherein the scene screen is at least a partial display screen of the virtual scene corresponding to the target component, and the target direction is determined by the moving direction of the target component during the process of moving from the first area to the second area.
[0160] Optionally, the computer-readable storage medium is further configured to store program codes for executing the following steps: controlling the scene screen to move a target distance in a target direction, wherein the target distance is determined by a moving distance of the target component during the process of moving from the first area to the second area.
[0161] In the computer-readable storage medium of the above embodiment, a technical solution for implementing a component display method is provided. First, the posture data and touch operation data of the terminal device are obtained, wherein the posture data is used to determine the tilt amplitude of the terminal device, and the touch operation data is used to determine the touch quantity and touch position of multiple touch points sensed by the terminal device, and further in response to the posture data satisfying the first preset condition and the touch operation data satisfying the second preset condition, the target component is controlled to move from the first area within the touch area to the second area within the touch area, wherein the first preset condition is used to determine the tilt amplitude threshold corresponding to the posture data, and the second preset condition is used to determine that the touch position of at least some of the multiple touch points changes and / or the touch quantity of the multiple touch points changes, and then the touch operation is performed on the target component in the second area. Therefore, the present application controls the movement of the target component according to the posture data and touch operation data of the terminal device. When realizing the touch operation function of the target component, it is not limited to the fixed setting position of the component in the graphical user interface. It achieves the purpose of moving the target component to be operated, and then realizing the touch operation of the target component in the second area, thereby achieving the technical effect of reducing the difficulty of touch operation of the target component and improving the operation comfort, and then solving the technical problems of high control operation difficulty and poor operation comfort of some components in the graphical user interface in the related technology.
[0162] Through the description of the above implementation methods, it is easy for those skilled in the art to understand that the example implementation methods described here can be implemented by software or by combining software with necessary hardware. Therefore, the technical solution according to the implementation methods of the present application can be embodied in the form of a software product, which can be stored in a computer-readable storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the implementation methods of the present application.
[0163] In an exemplary embodiment of the present application, a program product capable of implementing the above method of the present embodiment is stored on a computer-readable storage medium. In some possible implementations, various aspects of the embodiments of the present application can also be implemented in the form of a program product, which includes a program code. When the program product is run on a terminal device, the program code is used to enable the terminal device to execute the steps according to various exemplary implementations of the present application described in the above "Exemplary Method" section of the present embodiment.
[0164] According to the program product for implementing the above method in the embodiment of the present application, it can adopt a portable compact disk read-only memory (CD-ROM) and include program code, and can be run on a terminal device, such as a personal computer. However, the program product of the embodiment of the present application is not limited thereto. In the embodiment of the present application, the computer-readable storage medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, an apparatus or a device.
[0165] The program product may be in any combination of one or more computer-readable media. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination thereof. More specific examples (non-exhaustive) of computer-readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.
[0166] It should be noted that the program code contained in the computer-readable storage medium can be transmitted using any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the above.
[0167] An embodiment of the present application further provides an electronic device, including a memory and a processor, wherein a computer program is stored in the memory, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.
[0168] Optionally, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor, and the input / output device is connected to the processor.
[0169] Optionally, in this embodiment, the processor may be configured to perform the following steps through a computer program:
[0170] S1, acquiring posture data and touch operation data of the terminal device, wherein the posture data is used to determine the tilt amplitude of the terminal device, and the touch operation data is used to determine the touch quantity and touch position of multiple touch points sensed by the terminal device;
[0171] S2, in response to the gesture data satisfying a first preset condition and the touch operation data satisfying a second preset condition, controlling the target component to move from a first area within the touch area to a second area within the touch area, wherein the first preset condition is used to determine a tilt amplitude threshold corresponding to the gesture data, and the second preset condition is used to determine that the touch positions of at least some of the multiple touch points change and / or the touch quantities of the multiple touch points change;
[0172] S3, performing a touch operation on the target component in the second area.
[0173] Optionally, the processor may also be configured to perform the following steps through a computer program: determining, based on the posture data, that the real-time tilt angle of the terminal device is greater than a tilt amplitude threshold, wherein the tilt amplitude threshold is determined by setting operation data in an operation setting event.
[0174] Optionally, the processor can also be configured to perform the following steps through a computer program: respond to an operation setting event, obtain a first tilt angle of the terminal device when performing a first setting operation and a second tilt angle of the terminal device when performing a second setting operation, wherein the first setting operation is a touch operation performed by the terminal device on a first area in a one-handed operation mode, and the second setting operation is a touch operation performed on a second area in a one-handed operation mode, the first area is used to determine a touch restricted range before the posture data changes, and the second area is used to determine a current touchable range before the posture data changes; based on the first tilt angle and the second tilt angle, determine a tilt amplitude threshold.
[0175] Optionally, the processor can also be configured to perform the following steps through a computer program: the touch positions of at least some of the touch points change to a third area, wherein the third area is the false touch occurrence area corresponding to the target component; the number of touches of multiple touch points increases, and the touch positions of the newly added touch points are within the third area.
[0176] Optionally, the processor may also be configured to execute the following steps through a computer program: controlling the target component to move from an initial display position in the first area to a target display position in the second area.
[0177] Optionally, the processor may also be configured to perform the following steps through a computer program: in response to a first touch operation performed on a target component, adjusting a target display position to an operation end position of the first touch operation.
[0178] Optionally, the processor may also be configured to execute the following steps through a computer program: the target component includes a plurality of components to be moved; and the plurality of components to be moved are controlled to move from the first area to the second area according to the operation priorities corresponding to the plurality of components to be moved.
[0179] Optionally, the above-mentioned processor can also be configured to perform the following steps through a computer program: adjust the display style of the target component in the second area according to the target display rule, wherein the target display rule is used to determine the parameters to be adjusted corresponding to the display style, and the parameters to be adjusted include at least one of the following: display size, display color, display brightness, display transparency, and dynamic effect parameters.
[0180] Optionally, the processor may also be configured to execute the following steps through a computer program: in response to a second touch operation performed on a target component displayed in the second area, controlling the target component to be restored to an initial display position in the first area for display.
[0181] Optionally, the processor can also be configured to perform the following steps through a computer program: in response to a second touch operation performed within a target time period after the control target component moves to the second area, display a reminder component in a graphical user interface; in response to a third touch operation performed on the reminder component, stop controlling the target component from moving from the first area to the second area.
[0182] Optionally, the above-mentioned processor can also be configured to perform the following steps through a computer program: in response to the posture data satisfying a first preset condition and the touch operation data satisfying a second preset condition, controlling the scene screen displayed in the graphical user interface to move toward a target direction, wherein the scene screen is at least a partial display screen of the virtual scene corresponding to the target component, and the target direction is determined by the moving direction of the target component during the process of moving from the first area to the second area.
[0183] Optionally, the processor may also be configured to execute the following steps through a computer program: controlling the scene screen to move a target distance toward a target direction, wherein the target distance is determined by a moving distance of the target component during the process of moving from the first area to the second area.
[0184] In the electronic device of the above embodiment, a technical solution for implementing a component display method is provided. First, the posture data and touch operation data of the terminal device are obtained, wherein the posture data is used to determine the tilt amplitude of the terminal device, and the touch operation data is used to determine the touch quantity and touch position of multiple touch points sensed by the terminal device, and further in response to the posture data satisfying the first preset condition and the touch operation data satisfying the second preset condition, the target component is controlled to move from the first area within the touch area to the second area within the touch area, wherein the first preset condition is used to determine the tilt amplitude threshold corresponding to the posture data, and the second preset condition is used to determine that the touch position of at least some of the multiple touch points changes and / or the touch quantity of the multiple touch points changes, and then the touch operation is performed on the target component in the second area. Therefore, the present application controls the movement of the target component according to the posture data and touch operation data of the terminal device. When realizing the touch operation function of the target component, it is not limited to the fixed setting position of the component in the graphical user interface. It achieves the purpose of moving the target component to be operated, and then realizing the touch operation of the target component in the second area, thereby achieving the technical effect of reducing the difficulty of touch operation of the target component and improving the operation comfort, and then solving the technical problems of high control operation difficulty and poor operation comfort of some components in the graphical user interface in the related technology.
[0185] Fig.14 is a schematic diagram of an electronic device according to one embodiment of the present application. Fig.14 As shown, the electronic device 1400 is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.
[0186] like Fig.14 As shown, the electronic device 1400 is in the form of a general computing device. The components of the electronic device 1400 may include but are not limited to: the at least one processor 1410, the at least one memory 1420, a bus 1430 connecting different system components (including the memory 1420 and the processor 1410), and a display 1440.
[0187] The memory 1420 stores program codes, which can be executed by the processor 1410, so that the processor 1410 executes the steps described in the method part of the embodiment of the present application according to various exemplary embodiments of the present application.
[0188] The memory 1420 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 14201 and / or a cache memory unit 14202, and may further include a read-only memory unit (ROM) 14203, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory.
[0189] In some examples, the memory 1420 may also include a program / utility 14204 having a set (at least one) of program modules 14205, such program modules 14205 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination thereof may include the implementation of a network environment. The memory 1420 may further include a memory remotely disposed relative to the processor 1410, and these remote memories may be connected to the electronic device 1400 via a network. Examples of the above-mentioned network include but are not limited to the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
[0190] The bus 1430 may represent one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a local bus of the processor 1410, or a bus using any of a variety of bus architectures.
[0191] The display 1440 may be, for example, a touch screen liquid crystal display (LCD), which may enable a user to interact with a user interface of the electronic device 1400 .
[0192] Optionally, the electronic device 1400 may also communicate with one or more external devices 1500 (e.g., keyboards, pointing devices, Bluetooth devices, etc.), one or more devices that enable a user to interact with the electronic device 1400, and / or any device that enables the electronic device 1400 to communicate with one or more other computing devices (e.g., routers, modems, etc.). Such communication may be performed through an input / output (I / O) interface 1450. Furthermore, the electronic device 1400 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) through a network adapter 1460. Fig.14 As shown, the network adapter 1460 communicates with other modules of the electronic device 1400 via the bus 1430. It should be understood that although Fig.14Not shown, other hardware and / or software modules may be used in conjunction with the electronic device 1400, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, disk arrays (Redundant Arrays of Independent Disks, RAID) systems, tape drives, and data backup storage systems.
[0193] The electronic device 1400 may further include: a keyboard, a cursor control device (such as a mouse), an input / output interface (I / O interface), a network interface, a power supply and / or a camera.
[0194] It can be understood by those skilled in the art that Fig.14 The structure shown is only for illustration and does not limit the structure of the above electronic device. Fig.14 More or fewer components as shown, or with Fig.14 The memory 1420 may be used to store computer programs and corresponding data, such as the computer programs and corresponding data corresponding to the component display method in the embodiment of the present application. The processor 1410 executes various functional applications and data processing by running the computer programs stored in the memory 1420, that is, implementing the above-mentioned component display method.
[0195] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.
[0196] In the above embodiments of the present application, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, please refer to the relevant description of other embodiments.
[0197] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of the units can be a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.
[0198] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.
[0199] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0200] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly or all or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, server or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk.
[0201] The above is only a preferred implementation of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.
Claims
1. A component display method, characterized in that: A graphical user interface is provided through a terminal device, the graphical user interface includes a touch area, a target component is displayed in the touch area, and the component display method includes: Acquire posture data and touch operation data of the terminal device, wherein the posture data is used to determine the tilt amplitude of the terminal device, and the touch operation data is used to determine the touch quantity and touch position of multiple touch points sensed by the terminal device; In response to the gesture data satisfying a first preset condition and the touch operation data satisfying a second preset condition, controlling the target component to move from a first area within the touch area to a second area within the touch area, wherein the first preset condition is used to determine a tilt amplitude threshold corresponding to the gesture data, and the second preset condition is used to determine that the touch positions of at least some of the multiple touch points change and / or the touch quantities of the multiple touch points change; A touch operation is performed on the target component in the second area.
2. The component display method according to claim 1, characterized in that: The posture data meeting the first preset condition includes: It is determined according to the posture data that the real-time tilt angle of the terminal device is greater than the tilt amplitude threshold, wherein the tilt amplitude threshold is determined by the setting operation data in the operation setting event.
3. The component display method according to claim 2, characterized in that: The component display method further includes: In response to the operation setting event, obtaining a first tilt angle of the terminal device when performing a first setting operation and a second tilt angle of the terminal device when performing a second setting operation, wherein the first setting operation is a touch operation performed by the terminal device on the first area in a one-handed operation mode, and the second setting operation is a touch operation performed on the second area in the one-handed operation mode, the first area is used to determine a touch restricted range before the posture data changes, and the second area is used to determine a current touchable range before the posture data changes; The tilt amplitude threshold is determined based on the first tilt angle and the second tilt angle.
4. The component display method according to claim 1, characterized in that: The touch operation data satisfies the second preset condition, which includes at least one of the following: The touch positions of at least part of the touch points change to within a third area, wherein the third area is an area where a false touch occurs corresponding to the target component; The number of touches of the plurality of touch points increases, and the touch positions of the newly added touch points are within the third area.
5. The component display method according to claim 1, characterized in that: Controlling the target component to move from the first area within the touch area to the second area within the touch area includes: The target component is controlled to move from an initial display position in the first area to a target display position in the second area.
6. The component display method according to claim 5, characterized in that: The component display method further includes: In response to a first touch operation performed on the target component, the target display position is adjusted to an operation end position of the first touch operation.
7. The component display method according to claim 1, characterized in that: The target component includes a plurality of components to be moved; and controlling the target component to move from the first area within the touch area to the second area within the touch area further includes: According to the operation priorities corresponding to the multiple components to be moved, the multiple components to be moved are controlled to move from the first area to the second area.
8. The component display method according to any one of claims 1 to 7, characterized in that: The component display method further includes: According to the target display rules, the display style of the target component in the second area is adjusted, wherein the target display rules are used to determine the parameters to be adjusted corresponding to the display style, and the parameters to be adjusted include at least one of the following: display size, display color, display brightness, display transparency, and dynamic effect parameters.
9. The component display method according to claim 1, characterized in that: The component display method further includes: In response to a second touch operation performed on the target component displayed in the second area, the target component is controlled to be restored to an initial display position in the first area for display.
10. The component display method according to claim 9, characterized in that: The component display method further includes: In response to the second touch operation being performed within a target time period after controlling the target component to move to the second area, displaying a reminder component in the graphical user interface; In response to a third touch operation performed on the reminder component, stopping controlling the target component to move from the first area to the second area.
11. The component display method according to any one of claims 1 to 7, characterized in that: The component display method further includes: In response to the posture data satisfying the first preset condition and the touch operation data satisfying the second preset condition, the scene screen displayed in the graphical user interface is controlled to move toward a target direction, wherein the scene screen is at least a partial display screen of the virtual scene corresponding to the target component, and the target direction is determined by the moving direction of the target component in the process of moving from the first area to the second area.
12. The component display method according to claim 11, characterized in that: Controlling the scene picture displayed in the graphical user interface to move toward the target direction includes: The scene image is controlled to move a target distance toward the target direction, wherein the target distance is determined by a moving distance of the target component during the process of moving from the first area to the second area.
13. A component display device, characterized in that: A graphical user interface is provided through a terminal device, wherein the graphical user interface includes a touch area, a target component is displayed in the touch area, and the component display device includes: An acquisition module, used to acquire posture data and touch operation data of the terminal device, wherein the posture data is used to determine the tilt amplitude of the terminal device, and the touch operation data is used to determine the touch quantity and touch position of multiple touch points sensed by the terminal device; a control module, configured to control the target component to move from a first area within the touch area to a second area within the touch area in response to the gesture data satisfying a first preset condition and the touch operation data satisfying a second preset condition, wherein the first preset condition is used to determine a tilt amplitude threshold corresponding to the gesture data, and the second preset condition is used to determine that the touch positions of at least some of the multiple touch points change and / or the touch quantities of the multiple touch points change; An execution module is used to perform a touch operation on the target component in the second area.
14. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, wherein the computer program is configured to execute the component display method according to any one of claims 1 to 12 when executed by a processor.
15. An electronic device comprising a memory and a processor, characterized in that: A computer program is stored in the memory, and the processor is configured to run the computer program to execute the component display method according to any one of claims 1 to 12.
16. A computer program product, characterized in that The invention comprises a computer program, which implements the component display method described in any one of claims 1 to 12 when being executed by a processor.
