Interaction control method and device and electronic equipment
By determining the touch position and generating virtual contacts in the graphical user interface, the problem of difficult multi-touch operation in a single-handed grip device is solved, and the user's operation flexibility and experience is improved.
Patent Information
- Application Number
- CN202410814722.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-06-21
- Publication Date
- 2024-11-08
AI Technical Summary
Multi-touch operation is difficult to complete when holding the device with one hand, limiting the user's target touch operation flexibility and user experience.
By determining the first touch position of the contact addition operation in the graphical user interface and establishing a binding relationship with the target touch operation, the first and second touches are generated in response to the target touch operation of the second touch position. Events, use virtual contacts to achieve multi-contact control.
It improves the flexibility and operation experience of user target touch operation, allows complex multi-touch operations when holding the device with one hand, expanding the applicable scenarios of interaction.
Smart Images

Figure CN118915950A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of interface interaction technology, and in particular to an interactive control method, device and electronic device. Background Art
[0002] With the widespread popularity of multi-touch screens, more and more functions are beginning to use multi-touch to expand the user's input methods to provide a faster and simpler input method. However, multi-touch requires users to use multiple fingers at the same time to interact. Users can usually only use one or both hands to perform multi-touch when holding the device with both hands or placing the device on a stable surface. When the user holds the device with one hand, multi-touch is a difficult operation to complete. In the above method, the flexibility and diversity of the user's target touch operation are limited, resulting in a poor user experience. Summary of the invention
[0003] In view of this, an object of the present disclosure is to provide an interactive control method, device and electronic device to improve the flexibility of user target touch operation and enhance the user's operating experience.
[0004] In a first aspect, an embodiment of the present disclosure provides an interactive control method, which provides a graphical user interface through a terminal device; the method includes: in response to a touch adding operation, determining a first touch position corresponding to the touch adding operation in the graphical user interface, and establishing a binding relationship between the first touch position and the target touch operation; in response to a target touch operation acting on a second touch position of the graphical user interface, determining a first touch event according to the target touch operation and the second touch position, and processing the first touch event through a first processing logic corresponding to the first touch event; and determining a second touch event according to the target touch operation and the first touch position, and processing the second touch event through a second processing logic corresponding to the second touch event.
[0005] In a second aspect, an embodiment of the present disclosure provides an interactive control device that provides a graphical user interface through a terminal device; the device includes: a first touch position determination module, which is used to determine, in response to a touch adding operation, a first touch position corresponding to the touch adding operation in the graphical user interface, and establish a binding relationship between the first touch position and the target touch operation; a first touch event determination module, which is used to respond to a target touch operation acting on a second touch position of the graphical user interface, determine a first touch event according to the target touch operation and the second touch position, and process the first touch event through a first processing logic corresponding to the first touch event; a second touch event determination module, which is used to determine a second touch event according to the target touch operation and the first touch position, and process the second touch event through a second processing logic corresponding to the second touch event.
[0006] In a third aspect, an embodiment of the present invention provides an electronic device, including a processor and a memory, wherein the memory stores machine executable instructions that can be executed by the processor, and the processor executes the machine executable instructions to implement the above-mentioned interactive control method.
[0007] In a fourth aspect, an embodiment of the present invention provides a machine-readable storage medium, which stores machine-executable instructions. When the machine-executable instructions are called and executed by a processor, the machine-executable instructions prompt the processor to implement the above-mentioned interactive control method.
[0008] The embodiments of the present invention bring the following beneficial effects:
[0009] The above-mentioned interactive control method, device and electronic device, in response to a touch point adding operation, determine the first touch position corresponding to the touch point adding operation in the graphical user interface, and establish a binding relationship between the first touch position and the target touch operation; in response to a target touch operation acting on the second touch position of the graphical user interface, determine a first touch event according to the target touch operation and the second touch position, and process the first touch event through a first processing logic corresponding to the first touch event; and determine a second touch event according to the target touch operation and the first touch position, and process the second touch event through a second processing logic corresponding to the second touch event. In this manner, a virtual touch point can be generated at a predetermined interface position through a target touch operation, and the virtual touch point and the touch point generated by the touch operation can realize multi-touch control, thereby improving the flexibility of the user's target touch operation and the user's operating experience.
[0010] Other features and advantages of the present disclosure will be described in the following description, and partly become apparent from the description, or understood by practicing the present disclosure. The purpose and other advantages of the present disclosure are realized and obtained by the structures particularly pointed out in the description, claims and drawings.
[0011] In order to make the above-mentioned objectives, features and advantages of the present disclosure more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0012] In order to more clearly illustrate the specific embodiments of the present disclosure or the technical solutions in the prior art, the drawings required for use in the specific embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present disclosure. For those skilled in the art, other drawings can be obtained based on these drawings without paying any creative work.
[0013] Figure 1 A schematic diagram of a game editing scene provided by an embodiment of the present disclosure;
[0014] Figure 2 A schematic diagram of a graphical user interface provided in an embodiment of the present disclosure;
[0015] Figure 3 Another graphical user interface schematic diagram provided for an embodiment of the present disclosure;
[0016] Figure 4 Another graphical user interface schematic diagram provided for an embodiment of the present disclosure;
[0017] Figure 5 Another graphical user interface schematic diagram provided for an embodiment of the present disclosure;
[0018] Figure 6 A schematic diagram of the structure of an interactive control device provided by an embodiment of the present disclosure;
[0019] Figure 7 A schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION
[0020] In order to make the purpose, technical solution and advantages of the embodiments of the present disclosure clearer, the technical solution of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present disclosure, rather than all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present disclosure.
[0021] With the widespread popularity of multi-touch screens, more and more functions are beginning to use multi-touch to expand the user's input methods and provide faster and simpler input methods. However, multi-touch requires users to use multiple fingers at the same time to interact, which limits the user's usage scenarios. For example, users can only use one or both hands to perform multi-touch when holding the device with both hands or placing the device on a stable surface. When the user holds the device with one hand, multi-touch is a difficult operation to complete. For example, in games displayed in portrait mode, most users use one-handed holding, which makes it difficult to perform multi-touch.
[0022] Based on this, an interactive control method, device and electronic device provided by the embodiments of the present disclosure can be applied to scenarios where multiple touch points are required to generate touch events.
[0023] The interactive control method in one embodiment of the present invention can be run on a local terminal device or a server. When the interactive control method is run on a server, the method can be implemented and executed based on a cloud interactive system, wherein the cloud interactive system includes a server and a client device.
[0024] In an optional implementation, various cloud applications, such as cloud games, can be run under the cloud interaction system. Taking cloud games as an example, cloud games refer to a game mode based on cloud computing. In the operation mode of cloud games, the operating body of the game program and the main body of the game screen presentation are separated, the storage and operation of the interactive control method are completed on the cloud game server, and the role of the client device is used for receiving and sending data and presenting the game screen. For example, the client device can be a display device with data transmission function close to the user side, such as a mobile terminal, a TV, a computer, a handheld computer, etc.; but the cloud game server in the cloud is used for information processing. When playing the game, the user operates the client device to send an operation instruction to the cloud game server. The cloud game server runs the game according to the operation instruction, encodes and compresses the game screen and other data, and returns it to the client device through the network. Finally, the client device decodes and outputs the game screen.
[0025] In an optional embodiment, taking a game as an example, a local terminal device stores a game program and is used to present a game screen. The local terminal device is used to interact with the user through a graphical user interface, that is, the game program is downloaded and installed by an electronic device and run conventionally. The local terminal device may provide the graphical user interface to the user in a variety of ways, for example, it may be rendered and displayed on a display screen of the terminal, or provided to the user through a holographic projection. For example, the local terminal device may include a display screen and a processor, the display screen is used to present a graphical user interface, the graphical user interface includes a game screen, and the processor is used to run the game, generate a graphical user interface, and control the display of the graphical user interface on the display screen.
[0026] See also Figure 1 First, an interactive control method provided by an embodiment of the present invention is introduced, and a graphical user interface is provided by a terminal device. The method comprises the following steps:
[0027] Step S102, in response to the touch point adding operation, determining a first touch position corresponding to the touch point adding operation in the graphical user interface, and establishing a binding relationship between the first touch position and the target touch operation.
[0028] A graphical user interface usually has interface interaction elements such as controls and triggerable markers, and a user's target touch operation on the graphical user interface is usually recognized as a control operation on the above-mentioned interactive elements. A sliding operation on the graphical user interface can also usually drag the view in the graphical user interface. Therefore, it is difficult to determine the first touch position used to generate the first touch position by directly acting on the target touch operation on the graphical user interface.
[0029] Usually, a control for adding touch points can be displayed in advance in the graphical user interface. When the user clicks the control, it can be considered that the user has performed a touch point adding operation. That is, a specified position of the graphical user interface, such as the center position, can be determined as the first touch position. The user can also use the control as a starting point to perform a sliding operation, and the position of the touch point where the sliding operation is released is determined as the first touch position. After triggering the control, the user can also perform a specified touch operation such as clicking or long pressing at a certain position in the graphical user interface, thereby determining the position as the first touch position.
[0030] The above-mentioned target touch operation can usually be a click operation, a long press operation, a movement in a sliding operation, or multiple operations, which can be set based on needs. The target touch operation bound to the first touch position can be predetermined, or can be pre-set by the user through a setting interface, or the user interface can select the target touch operation bound to the first touch position through a selection operation after determining the first touch position, which is not limited here.
[0031] Step S104, responding to a target touch operation on a second touch position of the graphical user interface, determining a first touch event according to the target touch operation and the second touch position, and processing the first touch event by a first processing logic corresponding to the first touch event.
[0032] The second touch position is usually different from the first touch position. When the target touch operation is generated at the second touch position, it can be considered that a touch point is generated at the second touch position. The first touch event is not related to the first touch position. Even if the first touch position is not determined, the first touch event is generated by the target touch operation.
[0033] The touch events corresponding to the touch points usually include press events, release events, sliding events, etc. The above-mentioned first touch event is specifically related to the type of the target touch operation. For example, when the target touch operation is a click or long press operation, the first touch event generated usually includes a press event and a release event; when the target touch operation is a sliding operation, the first touch event generated includes a press event, a sliding event, and a release event.
[0034] Different processing logics for touch events are usually set at different positions of the graphical user interface. For example, when a control is displayed at the second touch position, a press event and a release event are generated at the second touch position, and the processing logic may be to trigger the function of the control; when the second touch position is in a view, a slide event is generated at the second touch position, and the processing logic may be to slide the view.
[0035] Step S106 , determining a second touch event according to the target touch operation and the first touch position, and processing the second touch event by a second processing logic corresponding to the second touch event.
[0036] When a target touch operation is generated at the second touch position, it can be considered that a virtual touch point is generated at the first touch position at the same time. For the first touch event at the second touch position, a second touch event is generated at the virtual touch point at the same time. The second touch event can be communicated with the first touch event first, or it can be different. For example, when a touch point is generated at the second touch position through a target touch operation, and the touch point is continuously in a pressed state, a press event is generated, and a press event can be continuously generated at the first touch position. When a release event is generated through a target touch operation, a release event is also generated at the first touch position. It is also possible to set a press event and a release event to be generated alternately at the first touch position at a set frequency when a press event is generated at the second touch position through a target touch operation. If a release event is generated through a target touch operation, a release event is generated at the first touch position, and no press event is generated.
[0037] The above-mentioned first touch event and second touch event can be regarded as occurring at the same time, and can be used as sub-events of a complex touch event. When the user controls the touch point at the second touch position to slide through the target touch operation and generates a sliding event, the second touch event determined based on the target touch operation and the first touch position can be set according to demand. For example, when the touch event required by the user needs to be composed of a sliding sub-event corresponding to a touch point that occurs simultaneously, and a sub-event in which another touch point is in a long press state, it can be set that when the user controls the movement of the touch point through the target touch operation and generates a sliding sub-event, the control continues to generate a press event at the first touch position to achieve the required touch event.
[0038] In the game, the user needs to slide two touch points in opposite directions at the same time to magnify the magnification of the game scene in the game interface. When the game interface is displayed in portrait mode, the user may tend to use one-handed operation, and usually can only generate one touch point through the target touch operation. The virtual touch point generated at the first touch position through the target touch operation can assist the touch point of the target touch operation to generate a multi-touch event.
[0039] It can be set that when the first touch event generated by the user at the second touch position through the target touch operation is a sliding event, the sliding event starting from the first touch position is controlled to be generated as the second touch event. In order to generate the required touch event, the user can determine multiple first touch positions through the above touch point adding operation to realize the sub-event of sliding with three or more touch points.
[0040] The above-mentioned interactive control method, in response to a touch point adding operation, determines a first touch position corresponding to the touch point adding operation in a graphical user interface, and establishes a binding relationship between the first touch position and the target touch operation; in response to a target touch operation acting on a second touch position of the graphical user interface, determines a first touch event according to the target touch operation and the second touch position, and processes the first touch event through a first processing logic corresponding to the first touch event; and determines a second touch event according to the target touch operation and the first touch position, and processes the second touch event through a second processing logic corresponding to the second touch event. In this method, a virtual touch point can be generated at a predetermined interface position through a target touch operation, and the virtual touch point and the touch point generated by the touch operation can realize multi-touch control, thereby improving the flexibility of the user's target touch operation and the user's operating experience.
[0041] The following embodiments provide a specific method of generating a first touch position at a first touch position in response to a target touch operation on a graphical user interface, and controlling a touch state of the first touch position based on the target touch operation.
[0042] A first touch position control area can be pre-set in the graphical user interface. The area can be set at a position in the graphical user interface that does not block the displayed content and does not have an interactive interface element. The specific setting can be based on the needs and is not limited here. The user can perform a sliding operation starting from the position in the area, and the sliding operation is called the first sliding operation. In response to the first sliding operation starting from the first touch position control area, the contact of the first sliding operation is monitored; in response to the contact of the first sliding operation being released at a certain position in the graphical user interface, the position is determined as the first touch position. The position can be in the display area of the interactive interface element, such as the contact on a triggerable mark in the game interface, or it can be not in the above display area, and is not limited here. When the first touch position is in the display area of the interactive interface element, if a virtual touch is generated at the first touch position through the target touch operation, the virtual touch can be regarded as a touch acting on the interactive interface element.
[0043] After determining the first touch position, the player may need to change the determined first touch position. In response to the contact adding operation, a contact identifier can be generated in the graphical user interface, and the first touch position is determined based on the contact identifier, and the location of the contact identifier is usually determined as the first touch position. The player can use the contact identifier as a starting point to perform a sliding operation, and the sliding operation is called a second sliding operation. In response to the second sliding operation acting on the contact identifier, the contact identifier can be controlled to follow the movement of the contact of the second sliding operation. In response to the contact of the second sliding operation being released at a certain position in the graphical user interface, the first touch position is updated to that position.
[0044] In some cases, the user may not need to generate a second touch event based on the target touch operation and the first touch position, and this state is called an untriggerable state. For example, multiple first touch positions are determined in the graphical user interface. When the player performs a target touch operation in the graphical user interface, it is necessary to determine which first touch position or positions determine the second touch event together with the target touch operation, and the first touch position that will not be used can be set to an untriggerable state. The player can perform a trigger operation on the contact control area, and in response to the first trigger operation acting on the first touch position control area, the first touch position is set to an untriggerable state; in the untriggerable state, the first touch position cannot be generated at the first touch position. The player triggers the area again, and in response to the second trigger operation acting on the first touch position control area, the first touch position is set to a triggerable state. That is, the player can switch whether the first touch position can be generated at the first touch position by triggering the contact control area.
[0045] The user can also cancel the first touch position by double-clicking the first touch position, or click a preset touch point deletion control area to cancel all first touch positions on the graphical user interface. The specific settings can be made according to the needs, and are not set here.
[0046] The following embodiment provides a specific method in which the target touch operation includes a pressing operation and the second touch event is determined according to the target touch operation and the first touch position.
[0047] The target touch operation may include a press operation, and according to the press operation, a touch event may be determined to be generated at the first touch position, that is, a virtual touch point is generated at the first touch position. The target touch operation may also include a touch release operation, and in response to the touch release operation at the second touch position, a touch release event may be determined to be generated at the first touch position.
[0048] When the target touch operation is a sliding operation, the movement of the contact point generated at the second touch position can be controlled by the sliding operation. Compared with the touch generation event and the release event, the sliding event of the contact point involves the sliding direction, sliding distance, etc., which is more complicated. Therefore, it is usually necessary to set a first sliding event generated based on the target touch operation to determine the parameters of the generated second sliding event. The touch response mode can be set for the first touch position in advance. The touch response mode is used to indicate the target touch operation bound to the first touch position. When the target touch operation bound to the first touch position includes a sliding operation, the operating parameters of the sliding operation affect the sliding event generated by the sliding operation and the first touch position differently in different touch response modes. In response to the sliding operation, the event parameters of the sliding event can be determined based on the touch response mode corresponding to the first touch position and the operating parameters of the sliding operation.
[0049] The operation parameters of the sliding operation include the sliding direction; the event parameters of the sliding event are called the target sliding direction and the target sliding distance. Generally speaking, when the virtual touch point generated at the first touch position can move along with the movement of the touch point generated at the second touch position by the target touch operation, the target sliding distance of the first touch position and the sliding distance of the touch point are the same. Therefore, the above event parameters mainly consider the target sliding direction.
[0050] Assume that the touch response mode includes a first mode and a second mode. When the touch response mode of the first touch position is the first mode, the sliding direction of the sliding operation is determined as the target sliding direction. Figure 2 As shown, Figure 2 The black dot next to the middle finger indicates the touch point generated by the sliding operation, and the black dot in the center of the touch mark indicates the virtual touch point generated at the first touch position. The moving directions of both touch points are upward. The touch response mode in response to the first touch position is the second mode, and the opposite direction of the sliding direction of the sliding operation is determined as the target sliding direction. Figure 3 As shown, the two contacts move in opposite directions.
[0051] In some cases, when the first touch event generated by the user through the target touch operation is a sliding event, a press event is continuously generated at the first touch position, or a release event is directly generated. Correspondingly, the third mode can be set as the touch response mode. When the touch response mode of the first touch position is the third mode, and the first touch event is a sliding event, a press event is continuously generated at the first touch position, or a release event is directly generated. The specific processing can be performed according to the set processing method, which is not limited here.
[0052] In order to switch between the above-mentioned touch response modes, a mode switching control may be displayed in a graphical user interface. An arrangement order may be pre-set for a plurality of preset touch response modes, for example, the arrangement order is the first mode, the second mode, and the third mode. After determining the first touch position, it is usually necessary to initialize the touch response mode at the first touch position to a specified mode in the touch response mode, and the specified mode may be any of the three modes. The user may trigger the mode switching control through touch operations such as clicking and long pressing, and in response to the triggering operation on the mode switching control, the touch response mode of the first touch position is switched to a touch response mode located after the specified mode in the arrangement order.
[0053] When the second touch events are all sliding events, the current touch position corresponding to the sliding event can be determined based on the sliding operation and the first touch position, and a touch mark is displayed at the current touch position to prompt the user the current position of the virtual touch point generated at the first touch position. Figure 4As shown, the left dotted line represents the sliding track corresponding to the first touch event generated by the target touch operation, the right dotted line represents the moving track of the virtual touch point, and the touch point mark moves with the virtual touch point.
[0054] When there are multiple first touch positions in the graphical user interface, it is necessary to determine at which first touch position the user wants to generate the first touch position. For example, when the player performs a target touch operation, in response to the target touch operation acting on the graphical user interface, it is necessary to determine the target touch position from multiple first touch positions; wherein the determination time of the target touch position is earlier than the generation time of other first touch positions in the multiple first touch positions, that is, the first touch position is generated at the earliest determined first touch position, and the contact point can also be generated at the latest determined first touch position. The player can also select the first touch position where the first touch position needs to be generated by specifying touch operations such as clicking and long pressing. In response to a specified touch operation acting on a certain position in the multiple first touch positions, the position is determined as the target touch position, wherein the above-mentioned determined target touch position can be one or more, which is not limited here. In response to the target touch operation acting on the graphical user interface, it is necessary to determine the second touch event according to the target touch operation and the target touch position.
[0055] The present disclosure also provides another interactive control method. Figure 1 The core logic of the method is as follows: the user is allowed to set a first touch position for generating a touch signal in a graphical user interface, and a touch point identifier (which may be called a "pin") is displayed at the first touch position; the pin can be moved to any position in the interface. When the user clicks, slides, and performs other operations in the interface, the pin executes corresponding logic according to different modes to realize a multi-touch mode of using multiple fingers to operate on the touch screen at the same time.
[0056] The following modes can be preset for pushpins:
[0057] (1) Basic mode: The thumbtack remains in the current position. When the user presses the screen, the thumbtack performs the press and hold operation. When the user releases his finger, the thumbtack is released simultaneously. This can be used to complete multi-finger simultaneous click and long press operations.
[0058] (2) Forward operation: Expanding on the basic mode, when the user performs directional operations such as sliding or dragging, the thumbtack performs the same directional operation. It can be used to complete multi-finger sliding and dragging operations in the same direction at the same time.
[0059] (3) Reverse operation: Expanding on the basic mode, when the user performs directional operations such as sliding or dragging, the thumbtack performs the operation in the opposite direction. It can be used to complete multi-finger sliding or dragging operations in the opposite direction at the same time.
[0060] like Figure 5 As shown, three areas A, B, and C are set in the graphical user interface. The user can create a pin by touching area A. For example, the user can press and hold area A and drag it to the screen to create a pin at the release point. The user can move the pin position by long pressing the created pin, specifically, long pressing and dragging it to the specified position. The pin activation / deactivation function can be set for area A: the user clicks area A to switch the pin switch. In the activated state, the pin recognizes the user operation and performs the operation. In the closed state, the pin is hidden and no operation is performed. Area B can be set to switch modes. The user clicks area B to switch the pin mode in sequence, and the default is the basic mode. When the user needs to clear a specified pin, he can double-click the pin to delete it. When all pins need to be cleared, the player can long press area C to clear all pins in the interface.
[0061] When there are multiple pins in the interface, it is difficult for the system to determine which pin(s) the user intends to interact with when the user performs an operation. For example, the user wants to zoom in and out with two fingers, and slides his fingers in the interface, but the system cannot determine the zoom center point. In this case, it is necessary to set the multi-pin recognition logic, which can be: according to the order in which the pins are created, the first pin created is interacted with by default; if the user wants to interact with other pins, he needs to click the pin and set it as the interaction target, and then he can continue the operation.
[0062] This method helps users complete complex multi-touch operations with one finger, expands the applicable scenarios of complex interactions, and helps users perform more complex operations in scenarios where they hold the device in one hand. This interaction method refers to mimicking user operations through interface controls to complete various multi-touch operations. It can also be expanded to multiple demand scenarios such as two-finger, three-finger, forward, and reverse.
[0063] For the above method embodiments, see Figure 6 An interactive control device is shown, which provides a graphical user interface through a terminal device; the device includes:
[0064] A first touch position determining module 602, configured to determine, in response to a touch point adding operation, a first touch position corresponding to the touch point adding operation in a graphical user interface, and establish a binding relationship between the first touch position and a target touch operation;
[0065] A first touch event determination module 604 is configured to respond to a target touch operation on a second touch position of the graphical user interface, determine a first touch event according to the target touch operation and the second touch position, and process the first touch event through a first processing logic corresponding to the first touch event;
[0066] The second touch event determining module 606 is configured to determine a second touch event according to the target touch operation and the first touch position, and process the second touch event through a second processing logic corresponding to the second touch event.
[0067] The above-mentioned interactive control device, in response to a touch point adding operation, determines a first touch position corresponding to the touch point adding operation in a graphical user interface, and establishes a binding relationship between the first touch position and the target touch operation; in response to a target touch operation acting on a second touch position of the graphical user interface, determines a first touch event according to the target touch operation and the second touch position, and processes the first touch event through a first processing logic corresponding to the first touch event; and determines a second touch event according to the target touch operation and the first touch position, and processes the second touch event through a second processing logic corresponding to the second touch event. In this manner, a virtual touch point can be generated at a predetermined interface position through a target touch operation, and the virtual touch point and the touch point generated by the touch operation can realize multi-touch control, thereby improving the flexibility of the user's target touch operation and the user's operating experience.
[0068] The first touch position determination module is further configured to: generate a touch mark in the graphical user interface in response to a touch adding operation, and determine the first touch position based on the touch mark.
[0069] The target touch operation includes a pressing operation; the second touch event determination module is further used to: determine, according to the pressing operation, that a touch point generation event is generated at the first touch position.
[0070] The target touch operation also includes a touch release operation; the device also includes: a release event generating module, which is used to determine to generate a touch release event at the first touch position in response to the touch release operation for the second touch position.
[0071] The target touch operation also includes a sliding operation. According to the pressing operation, the device further includes: a sliding event generating module, which is used to determine and generate a sliding event starting from the first touch position in response to the sliding operation.
[0072] The above-mentioned first touch position has a corresponding touch response mode; the touch response mode is used to indicate a target touch operation bound to the first touch position; when the target touch operation bound to the first touch position includes a sliding operation, in different touch response modes, the operating parameters of the sliding operation have different effects on the sliding event generated by the sliding operation and the first touch position; the sliding event generating module is also used to: in response to the sliding operation, determine the event parameters of the sliding event based on the touch response mode corresponding to the first touch position and the operating parameters of the sliding operation.
[0073] The above-mentioned operation parameters include the sliding direction of the sliding operation; the event parameters include the target sliding direction; the touch response mode includes a first mode and a second mode; the sliding event generating module is also used for: in response to the touch response mode of the first touch position being the first mode, determining the sliding direction of the sliding operation as the target sliding direction; in response to the touch response mode of the first touch position being the second mode, determining the opposite direction of the sliding direction of the sliding operation as the target sliding direction.
[0074] The above-mentioned graphical user interface displays a mode switching control; multiple preset touch response modes have a preset arrangement order; the above-mentioned device also includes: a mode initialization module, used to initialize the touch response mode of the first touch position to a specified mode in the touch response mode; a mode switching module, used to respond to a trigger operation on the mode switching control, and switch the touch response mode of the first touch position to a touch response mode located after the specified mode in the arrangement order.
[0075] The above-mentioned target touch operation includes a sliding operation; the second touch event includes a sliding event; the above-mentioned device also includes: a contact identification generating module, which is used to respond to the sliding operation, determine the current touch position corresponding to the sliding event based on the sliding operation and the first touch position, and display the contact identification at the current touch position.
[0076] The above-mentioned second touch event determination module is also used for: when the first touch positions in the graphical user interface include multiple first touch positions, in response to the target touch operation, determining the target touch position from the multiple first touch positions; wherein the determination time of the target touch position is earlier than the generation time of other first touch positions in the multiple first touch positions; or, in response to a specified touch operation acting on a first position among the multiple first touch positions, determining the first position as the target touch position of the contact point; and determining the second touch event according to the target touch operation and the target touch position.
[0077] The above-mentioned graphical user interface displays a touch position control area; the first touch position determination module is also used to: respond to a first sliding operation starting from the touch position control area, monitor the contact point of the first sliding operation; in response to the contact point of the first sliding operation being released at a second position of the graphical user interface, determine the second position as the first touch position.
[0078] The above-mentioned device also includes: a contact identifier movement module, which is used to respond to the second sliding operation acting on the contact identifier and control the contact identifier to follow the movement of the contact point of the second sliding operation; a touch position update performance module, which is used to respond to the contact point of the second sliding operation being released at the fourth position of the graphical user interface and update the first touch position to the fourth position.
[0079] The above-mentioned graphical user interface displays a touch position control area; the above-mentioned method also includes: a first state setting module, used to respond to a first trigger operation acting on the touch position control area, and set the first touch position to an untriggerable state; in the untriggerable state, the second trigger event cannot be determined based on the target touch operation and the first touch position; a second state setting module, used to respond to a second trigger operation acting on the first touch position control area, and set the first touch position to a triggerable state.
[0080] This embodiment further provides an electronic device, including a processor and a memory, wherein the memory stores machine executable instructions that can be executed by the processor, and the processor executes the machine executable instructions to implement the above interactive control method, for example:
[0081] In response to a touch adding operation, a first touch position corresponding to the touch adding operation is determined in the graphical user interface, and a binding relationship between the first touch position and the target touch operation is established; in response to a target touch operation acting on a second touch position of the graphical user interface, a first touch event is determined according to the target touch operation and the second touch position, and the first touch event is processed by a first processing logic corresponding to the first touch event; and a second touch event is determined according to the target touch operation and the first touch position, and the second touch event is processed by a second processing logic corresponding to the second touch event.
[0082] In the above method, a virtual touch point can be generated at a predetermined interface position through a target touch operation. The virtual touch point and the touch point generated by the touch operation can realize multi-touch point control, thereby improving the flexibility of the user's target touch operation and improving the user's operating experience.
[0083] Optionally, the above step of determining the first touch position corresponding to the contact adding operation in the graphical user interface in response to the contact adding operation includes: generating a contact identifier in the graphical user interface in response to the contact adding operation, and determining the first touch position based on the contact identifier.
[0084] Optionally, the target touch operation includes a pressing operation; and the step of determining the second touch event according to the target touch operation and the first touch position includes: determining, according to the pressing operation, that a touch point generation event is generated at the first touch position.
[0085] Optionally, the above-mentioned target touch operation also includes a contact release operation; after determining that a contact generation event is generated at the first touch position based on the pressing operation, the above-mentioned method also includes: responding to the contact release operation for the second touch position, determining that a contact release event is generated at the first touch position.
[0086] Optionally, the target touch operation further includes a sliding operation; after determining that a touch point event is generated at the first touch position according to the pressing operation, the method further includes: in response to the sliding operation, determining that a sliding event is generated starting from the first touch position.
[0087] Optionally, the above-mentioned first touch position has a corresponding touch response mode; the touch response mode is used to indicate a target touch operation bound to the first touch position; when the target touch operation bound to the first touch position includes a sliding operation, in different touch response modes, the operating parameters of the sliding operation affect the sliding event generated by the sliding operation and the first touch position differently; in response to the sliding operation, determining the step of generating a sliding event with the first touch position as the starting point includes: in response to the sliding operation, determining the event parameters of the sliding event based on the touch response mode corresponding to the first touch position and the operating parameters of the sliding operation.
[0088] Optionally, the above-mentioned operation parameters include a sliding direction of the sliding operation; the event parameters include a target sliding direction; the touch response mode includes a first mode and a second mode; based on the touch response method corresponding to the first touch position and the operation parameters of the sliding operation, the step of determining the event parameters of the sliding event includes: in response to the touch response mode of the first touch position being the first mode, determining the sliding direction of the sliding operation as the target sliding direction; in response to the touch response mode of the first touch position being the second mode, determining the opposite direction of the sliding direction of the sliding operation as the target sliding direction.
[0089] Optionally, the above-mentioned graphical user interface displays a mode switching control; multiple preset touch response modes have a preset arrangement order; the above-mentioned method also includes: initializing the touch response mode of the first touch position to a specified mode in the touch response mode; in response to a trigger operation on the mode switching control, switching the touch response mode of the first touch position to a touch response mode located after the specified mode in the arrangement order.
[0090] Optionally, the target touch operation includes a sliding operation; the second touch event includes a sliding event; the method further includes: in response to the sliding operation, determining a current touch position corresponding to the sliding event based on the sliding operation and the first touch position, and displaying a contact mark at the current touch position.
[0091] Optionally, the above-mentioned step of determining the second touch event based on the target touch operation and the first touch position includes: when there are multiple first touch positions in the graphical user interface, in response to the target touch operation, determining the target touch position from the multiple first touch positions; wherein the determination time of the target touch position is earlier than the generation time of other first touch positions in the multiple first touch positions; or, in response to a specified touch operation acting on a first position among the multiple first touch positions, determining the first position as the target touch position of the contact point; and determining the second touch event based on the target touch operation and the target touch position.
[0092] Optionally, the above-mentioned graphical user interface displays a touch position control area; in response to a contact adding operation, a step of determining a first touch position corresponding to the contact adding operation in the graphical user interface includes: responding to a first sliding operation starting from the touch position control area, monitoring the touch point of the first sliding operation; in response to the touch point of the first sliding operation being released at a second position of the graphical user interface, determining the second position as the first touch position.
[0093] Optionally, the above method also includes: in response to a second sliding operation acting on the contact identifier, controlling the contact identifier to follow the movement of the contact of the second sliding operation; in response to the contact of the second sliding operation being released at a fourth position of the graphical user interface, updating the first touch position to the fourth position.
[0094] Optionally, the above-mentioned graphical user interface displays a touch position control area; the above-mentioned method also includes: in response to a first trigger operation acting on the touch position control area, setting the first touch position to an untriggerable state; in the untriggerable state, a second trigger event cannot be determined based on the target touch operation and the first touch position; in response to a second trigger operation acting on the first touch position control area, setting the first touch position to a triggerable state.
[0095] See also Figure 7 As shown, the electronic device includes a processor 100 and a memory 101. The memory 101 stores machine executable instructions that can be executed by the processor 100. The processor 100 executes the machine executable instructions to implement the above-mentioned interactive control method.
[0096] Further, Figure 7 The electronic device shown further includes a bus 102 and a communication interface 103 , and the processor 100 , the communication interface 103 and the memory 101 are connected via the bus 102 .
[0097] The memory 101 may include a high-speed random access memory (RAM), and may also include a non-volatile memory, such as at least one disk storage. The communication connection between the system network element and at least one other network element is realized through at least one communication interface 103 (which may be wired or wireless), and the Internet, wide area network, local area network, metropolitan area network, etc. may be used. The bus 102 may be an ISA bus, a PCI bus, or an EISA bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 7 Only one bidirectional arrow is used in the diagram, but this does not mean that there is only one bus or only one type of bus.
[0098] The processor 100 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit or software instructions in the processor 100. The above processor 100 can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present disclosure can be implemented or executed. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in conjunction with the embodiments of the present disclosure can be directly embodied as a hardware decoding processor for execution, or a combination of hardware and software modules in the decoding processor for execution. The software module may be located in a storage medium mature in the art, such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 101, and the processor 100 reads the information in the memory 101 and completes the steps of the method of the above embodiment in combination with its hardware.
[0099] This embodiment also provides a machine-readable storage medium, which stores machine-executable instructions. When the machine-executable instructions are called and executed by a processor, the machine-executable instructions prompt the processor to implement the above-mentioned interactive control method.
[0100] An interactive control method, device and electronic device provided in the embodiments of the present disclosure include a computer-readable storage medium storing program code, and the program code includes instructions that can be used to execute the methods described in the above method embodiments, for example:
[0101] In response to a touch adding operation, a first touch position corresponding to the touch adding operation is determined in the graphical user interface, and a binding relationship between the first touch position and the target touch operation is established; in response to a target touch operation acting on a second touch position of the graphical user interface, a first touch event is determined according to the target touch operation and the second touch position, and the first touch event is processed by a first processing logic corresponding to the first touch event; and a second touch event is determined according to the target touch operation and the first touch position, and the second touch event is processed by a second processing logic corresponding to the second touch event.
[0102] In the above method, a virtual touch point can be generated at a predetermined interface position through a target touch operation. The virtual touch point and the touch point generated by the touch operation can realize multi-touch point control, thereby improving the flexibility of the user's target touch operation and improving the user's operating experience.
[0103] Optionally, the above step of determining the first touch position corresponding to the contact adding operation in the graphical user interface in response to the contact adding operation includes: generating a contact identifier in the graphical user interface in response to the contact adding operation, and determining the first touch position based on the contact identifier.
[0104] Optionally, the target touch operation includes a pressing operation; and the step of determining the second touch event according to the target touch operation and the first touch position includes: determining, according to the pressing operation, that a touch point generation event is generated at the first touch position.
[0105] Optionally, the above-mentioned target touch operation also includes a contact release operation; after determining that a contact generation event is generated at the first touch position based on the pressing operation, the above-mentioned method also includes: responding to the contact release operation for the second touch position, determining that a contact release event is generated at the first touch position.
[0106] Optionally, the target touch operation further includes a sliding operation; after determining that a touch point event is generated at the first touch position according to the pressing operation, the method further includes: in response to the sliding operation, determining that a sliding event is generated starting from the first touch position.
[0107] Optionally, the above-mentioned first touch position has a corresponding touch response mode; the touch response mode is used to indicate a target touch operation bound to the first touch position; when the target touch operation bound to the first touch position includes a sliding operation, in different touch response modes, the operating parameters of the sliding operation affect the sliding event generated by the sliding operation and the first touch position differently; in response to the sliding operation, determining the step of generating a sliding event with the first touch position as the starting point includes: in response to the sliding operation, determining the event parameters of the sliding event based on the touch response mode corresponding to the first touch position and the operating parameters of the sliding operation.
[0108] Optionally, the above-mentioned operation parameters include a sliding direction of the sliding operation; the event parameters include a target sliding direction; the touch response mode includes a first mode and a second mode; based on the touch response method corresponding to the first touch position and the operation parameters of the sliding operation, the step of determining the event parameters of the sliding event includes: in response to the touch response mode of the first touch position being the first mode, determining the sliding direction of the sliding operation as the target sliding direction; in response to the touch response mode of the first touch position being the second mode, determining the opposite direction of the sliding direction of the sliding operation as the target sliding direction.
[0109] Optionally, the above-mentioned graphical user interface displays a mode switching control; multiple preset touch response modes have a preset arrangement order; the above-mentioned method also includes: initializing the touch response mode of the first touch position to a specified mode in the touch response mode; in response to a trigger operation on the mode switching control, switching the touch response mode of the first touch position to a touch response mode located after the specified mode in the arrangement order.
[0110] Optionally, the target touch operation includes a sliding operation; the second touch event includes a sliding event; the method further includes: in response to the sliding operation, determining a current touch position corresponding to the sliding event based on the sliding operation and the first touch position, and displaying a contact mark at the current touch position.
[0111] Optionally, the above-mentioned step of determining the second touch event based on the target touch operation and the first touch position includes: when there are multiple first touch positions in the graphical user interface, in response to the target touch operation, determining the target touch position from the multiple first touch positions; wherein the determination time of the target touch position is earlier than the generation time of other first touch positions in the multiple first touch positions; or, in response to a specified touch operation acting on a first position among the multiple first touch positions, determining the first position as the target touch position of the contact point; and determining the second touch event based on the target touch operation and the target touch position.
[0112] Optionally, the above-mentioned graphical user interface displays a touch position control area; in response to a contact adding operation, a step of determining a first touch position corresponding to the contact adding operation in the graphical user interface includes: responding to a first sliding operation starting from the touch position control area, monitoring the touch point of the first sliding operation; in response to the touch point of the first sliding operation being released at a second position of the graphical user interface, determining the second position as the first touch position.
[0113] Optionally, the above method also includes: in response to a second sliding operation acting on the contact identifier, controlling the contact identifier to follow the movement of the contact of the second sliding operation; in response to the contact of the second sliding operation being released at a fourth position of the graphical user interface, updating the first touch position to the fourth position.
[0114] Optionally, the above-mentioned graphical user interface displays a touch position control area; the above-mentioned method also includes: in response to a first trigger operation acting on the touch position control area, setting the first touch position to an untriggerable state; in the untriggerable state, a second trigger event cannot be determined based on the target touch operation and the first touch position; in response to a second trigger operation acting on the first touch position control area, setting the first touch position to a triggerable state.
[0115] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the system and device described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.
[0116] In addition, in the description of the embodiments of the present disclosure, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For those skilled in the art, the specific meanings of the above terms in the present disclosure can be understood according to specific circumstances.
[0117] If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present disclosure, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present disclosure. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program code.
[0118] In the description of the present disclosure, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc., indicating the orientation or positional relationship, are based on the orientation or positional relationship shown in the drawings, and are only for the convenience of describing the present disclosure and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation of the present disclosure. In addition, the terms "first", "second", and "third" are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance.
[0119] Finally, it should be noted that the above embodiments are only specific implementation methods of the present disclosure, which are used to illustrate the technical solutions of the present disclosure, rather than to limit them. The protection scope of the present disclosure is not limited thereto. Although the present disclosure is described in detail with reference to the above embodiments, those skilled in the art should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above embodiments within the technical scope disclosed in the present disclosure, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present disclosure, and should be included in the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be based on the protection scope of the claims.
Claims
1. An interactive control method, characterized in that: Providing a graphical user interface through a terminal device; the method comprises: In response to a touch point adding operation, determining a first touch position corresponding to the touch point adding operation in the graphical user interface, and establishing a binding relationship between the first touch position and a target touch operation; In response to the target touch operation acting on a second touch position of the graphical user interface, determining a first touch event according to the target touch operation and the second touch position, and processing the first touch event by a first processing logic corresponding to the first touch event; and A second touch event is determined according to the target touch operation and the first touch position, and the second touch event is processed by a second processing logic corresponding to the second touch event.
2. The method according to claim 1, characterized in that In response to a touch point adding operation, the step of determining, in the graphical user interface, a first touch position corresponding to the touch point adding operation comprises: In response to a touch point adding operation, a touch point identifier is generated in the graphical user interface, and the first touch position is determined based on the touch point identifier.
3. The method according to claim 1, characterized in that The target touch operation includes a pressing operation; The step of determining a second touch event according to the target touch operation and the first touch position includes: According to the pressing operation, it is determined that a touch point generation event is generated at the first touch position.
4. The method according to claim 3, characterized in that The target touch operation also includes a contact release operation; After determining, according to the pressing operation, that a touch point generation event is generated at the first touch control position, the method further includes: In response to a touch release operation on the second touch position, it is determined that a touch release event is generated at the first touch position.
5. The method according to claim 3, characterized in that: The target touch operation also includes a sliding operation; After determining, according to the pressing operation, that a touch point generation event is generated at the first touch position, the method further includes: In response to the sliding operation, a sliding event starting from the first touch position is determined to be generated.
6. The method according to claim 5, characterized in that The first touch position has a corresponding touch response mode; the touch response mode is used to indicate a target touch operation bound to the first touch position; when the target touch operation bound to the first touch position includes a sliding operation, under different touch response modes, the operating parameters of the sliding operation have different effects on the sliding event generated by the sliding operation and the first touch position; In response to the sliding operation, the step of determining to generate a sliding event starting from the first touch position includes: In response to the sliding operation, event parameters of the sliding event are determined based on the touch response mode corresponding to the first touch position and the operation parameters of the sliding operation.
7. The method according to claim 6, characterized in that The operation parameter includes the sliding direction of the sliding operation; the event parameter includes the target sliding direction; the touch response mode includes a first mode and a second mode; The step of determining the event parameters of the sliding event based on the touch response mode corresponding to the first touch position and the operation parameters of the sliding operation includes: In response to the touch response mode of the first touch position being the first mode, determining a sliding direction of the sliding operation as a target sliding direction; In response to the touch response mode of the first touch position being the second mode, a direction opposite to a sliding direction of the sliding operation is determined as a target sliding direction.
8. The method according to claim 6, characterized in that The graphical user interface displays a mode switching control; a plurality of preset touch response modes have a preset arrangement order; The method further comprises: Initializing the touch response mode of the first touch position to a specified mode in the touch response modes; In response to a trigger operation on the mode switching control, the touch response mode of the first touch position is switched to a touch response mode located after the designated mode in the arrangement sequence.
9. The method according to claim 2, characterized in that: The target touch operation includes a sliding operation; the second touch event includes a sliding event; The method further comprises: In response to the sliding operation, a current touch position corresponding to the sliding event is determined based on the sliding operation and the first touch position, and the touch point identifier is displayed at the current touch position.
10. The method according to claim 1, characterized in that The step of determining a second touch event according to the target touch operation and the first touch position includes: When there are multiple first touch positions in the graphical user interface, in response to the target touch operation, a target touch position is determined from the multiple first touch positions; wherein the determination time of the target touch position is earlier than the generation time of other first touch positions in the multiple first touch positions; Alternatively, in response to a designated touch operation applied to a first position among the plurality of first touch positions, the first position is determined as a touch point target touch position; A second touch event is determined according to the target touch operation and the target touch position.
11. The method according to claim 1, characterized in that: The graphical user interface displays a touch position control area; In response to a touch point adding operation, the step of determining, in the graphical user interface, a first touch position corresponding to the touch point adding operation comprises: In response to a first sliding operation starting from the touch position control area, monitoring a touch point of the first sliding operation; In response to the contact point of the first sliding operation being released at a second position of the graphical user interface, the second position is determined as a first touch position.
12. The method according to claim 2, characterized in that: The method further comprises: In response to a second sliding operation on the contact mark, controlling the contact mark to follow the contact movement of the second sliding operation; In response to the contact point of the second sliding operation being released at a fourth position of the graphical user interface, the first touch position is updated to the fourth position.
13. The method according to claim 1, characterized in that The graphical user interface displays a touch position control area; The method further comprises: In response to a first trigger operation acting on the touch position control area, the first touch position is set to a non-triggerable state; in the non-triggerable state, a second trigger event cannot be determined according to the target touch operation and the first touch position; In response to a second trigger operation acting on the first touch position control area, the first touch position is set to a triggerable state.
14. An interactive control device, characterized in that: Providing a graphical user interface through a terminal device; the device comprises: A first touch position determination module, configured to determine, in response to a touch point adding operation, a first touch position corresponding to the touch point adding operation in the graphical user interface, and establish a binding relationship between the first touch position and a target touch operation; a first touch event determination module, configured to respond to the target touch operation acting on a second touch position of the graphical user interface, determine a first touch event according to the target touch operation and the second touch position, and process the first touch event through a first processing logic corresponding to the first touch event; The second touch event determination module is used to determine a target touch event based on the touch state of the first touch position and the target touch operation, and process the target touch event through a processing logic corresponding to the target touch event.
15. An electronic device, characterized in that: It comprises a processor and a memory, wherein the memory stores machine executable instructions that can be executed by the processor, and the processor executes the machine executable instructions to implement the interactive control method according to any one of claims 1 to 13.
16. A machine-readable storage medium, characterized in that: The machine-readable storage medium stores machine-executable instructions, and when the machine-executable instructions are called and executed by a processor, the machine-executable instructions prompt the processor to implement the interactive control method according to any one of claims 1 to 13.
