Split screen display gesture operation method and device for touch screen device, computer device and storage medium

Abstract

The application provides a touch screen device split screen display gesture operation method and device, computer device and storage medium, comprising: when a touch control device enters a split screen operation activation state, the touch control device receives a first gesture operation; the first gesture operation is identified, the gesture operation type corresponding to the first gesture operation is determined, a split screen control instruction for the touch control device is generated; according to the split screen control instruction for the touch control device, the interface layout of the touch control device is modified. When the split screen control instruction for the touch control device is generated, the initial application interface layout in which the touch control device is located before the first gesture operation is accepted is determined; the initial application interface in the initial application interface layout in which the initial point of the first gesture operation is located is determined; according to the gesture operation type corresponding to the first gesture operation, the final application interface layout corresponding to the first gesture operation is determined.

Description

Technical Field

[0001] This application relates to the field of computer technology, and more specifically, to a method, apparatus, computer device, and storage medium for split-screen display of gesture operation on a touch screen device. Background Technology

[0002] On touch-screen devices (such as mobile phones, tablets, computers, and all-in-one touchscreen devices), especially in scenarios requiring simultaneous handling of multiple tasks or applications (such as office work, study, and entertainment), there is a demand for split-screen display of digital content (such as books, images, text, audio, and video). Split-screen display of digital content can improve work efficiency, allowing users to handle multiple tasks simultaneously and reducing the time spent switching applications; it can enhance multitasking capabilities, allowing users to view and operate multiple applications at the same time, improving the flexibility and convenience of multitasking; and it can enrich the user experience, providing users with a more intuitive and richer visual experience, making the user experience more pleasant and comfortable when using the device. Summary of the Invention

[0003] This application provides a gesture operation method, device, computer equipment, and storage medium that can realize split-screen display of touch devices.

[0004] The technical solution of this application is implemented as follows: This application provides a gesture operation method, the method including: Step S10: When the touch device enters the split-screen operation activation state, the touch device receives the first gesture operation; Step S20: Recognize the first gesture operation, determine the gesture operation type corresponding to the first gesture operation, and generate a split-screen control command for the touch device; Step S30: Modify the interface layout of the touch device according to the split-screen control command for the touch device.

[0005] In the above scheme, in step S10, the touch device is a gesture operation device that includes a gesture operation receiving unit; the split-screen operation activation state is a system state in which gesture operation is effective. When the touch device does not enter the split-screen operation activation state, any gesture operation applied to the touch device will not have an effect on the touch device.

[0006] Those skilled in the art will understand that the term "touch device" is used in this application to refer to a gesture operation device that includes a receiving unit for gesture operation, wherein "touch" means that it can be controlled by gesture operation, that is, it can receive gesture operation; and "device" means device.

[0007] Those skilled in the art will understand that the term "display interface" is used in this application to refer to the receiving unit for gesture operations, since in some embodiments of this application, the unit of the touch device used to display digital content can also be used to receive gesture operations. In implementation, if the unit for displaying digital content and the unit for receiving gesture operations are separate, a correspondence should be established between the spatial range of the unit for displaying digital content and the spatial range of the unit for receiving gesture operations.

[0008] In the above scheme, in step S10, the gesture operation types corresponding to the first gesture operation include: three-finger left swipe, three-finger right swipe, three-finger down swipe, and three-finger up swipe. The three-finger left swipe, the three-finger right swipe, the three-finger down swipe, and the three-finger up swipe represent operations performed within the full-screen area of ​​the touch device.

[0009] The three-finger left swipe refers to pressing three fingers on the display interface of the touch device and moving them to the left; the three-finger right swipe refers to pressing three fingers on the display interface of the touch device and moving them to the right; the three-finger down swipe refers to pressing three fingers on the display interface of the touch device and moving them downwards; and the three-finger up swipe refers to pressing three fingers on the display interface of the touch device and moving them upwards.

[0010] When the three fingers press on the display interface of the touch device, three initial points corresponding to the three fingers can be detected on the display interface; when the three fingers stop pressing on the display interface, three ending points corresponding to the three fingers can be detected on the display interface. The leftward movement, the rightward movement, the downward movement, and the upward movement are determined by the positional relationship between the ending points and the initial points.

[0011] In some embodiments of this application, when the average x-coordinate of the termination point is to the left (or right) of the average x-coordinate of the starting point, and the difference between the average x-coordinates is more than five times the difference between the average y-coordinates, the gesture operation is considered to correspond to moving to the left (or right); when the average y-coordinate of the termination point is above (or below) the average y-coordinate of the starting point, and the difference between the average y-coordinates is more than five times the difference between the average x-coordinates, the gesture operation is considered to correspond to moving upwards (or downwards). In implementation, the judgment rule can be modified to determine the direction of movement of the gesture operation.

[0012] In the above scheme, in step S20, determining the gesture operation type corresponding to the first gesture operation means determining whether the first gesture operation corresponds to a three-finger left swipe, a three-finger right swipe, a three-finger down swipe, a three-finger up swipe, or an invalid gesture.

[0013] In some embodiments of this application, an invalid gesture refers to three or fewer fingers pressing on the display interface of the touch device, or three fingers pressing on the display interface of the touch device, but the relative positional relationship between the initial point and the ending point does not satisfy any of the judgment rules. In implementation, the judgment rules can be modified to determine the gesture operation type corresponding to the first gesture operation.

[0014] In the above scheme, step S20, generating the split-screen control command for the touch device, includes: Step S21: Determine the initial application interface layout of the touch device before accepting the first gesture operation; Step S22: Determine the initial application interface in the initial application interface layout where the initial point of the first gesture operation is located; Step S23: Determine the final application interface layout corresponding to the first gesture operation based on the gesture operation type corresponding to the first gesture operation.

[0015] This application provides a gesture operation device, including: a receiving unit, a determining unit, and a controlling unit, wherein... The receiving unit is used to receive a first gesture operation when the touch device enters the split-screen operation activation state; The determining unit identifies the first gesture operation, determines the gesture operation type corresponding to the first gesture operation, and generates a split-screen control command for the touch device. The control unit modifies the interface layout of the touch device according to the split-screen control command for the touch device.

[0016] This application provides a gesture operation device, characterized in that it includes: a processor and a memory, the memory storing machine-readable instructions executable by the processor, the processor executing the machine-readable instructions stored in the memory, and when the machine-readable instructions are executed by the processor, the processor executes the gesture operation method.

[0017] This application provides a computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program, and when the computer program is run by a computer device, the computer device executes the gesture operation method.

[0018] This application provides a gesture operation method, apparatus, device, and computer-readable storage medium. The method includes: when a touch device enters a split-screen operation activation state, the touch device receives a first gesture operation; the first gesture operation is identified to determine the gesture operation type corresponding to the first gesture operation, and a split-screen control instruction is generated for the touch device; the interface layout of the touch device is modified according to the split-screen control instruction for the touch device. In this solution, gesture operation allows multiple application interfaces to be displayed on the screen, enabling users to handle multiple tasks simultaneously, reducing the time spent switching applications, providing users with a more intuitive and richer visual experience, and making user experience more pleasant and comfortable when using the device. Attached Figure Description

[0019] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments will be briefly described below. These drawings are incorporated in and constitute a part of this specification. They illustrate embodiments conforming to this application and, together with the specification, serve to explain the technical solutions of this application. It should be understood that the following drawings only show some embodiments of this application and should not be considered as limiting the scope. For those skilled in the art, other related drawings can be obtained from these drawings without creative effort.

[0020] The accompanying drawings of this application are described below: Figure 1 The flowchart of the gesture operation method provided in some embodiments of this application is shown. Figure 1 ; Figure 2 The flowchart of the gesture operation method provided in some embodiments of this application is shown. Figure 2 ; Figure 3 The following are schematic diagrams of the split-screen structure provided in some embodiments of this application; Figure 4 This application illustrates gesture operations provided in some embodiments. Figure 1 ; Figure 5 This application illustrates gesture operations provided in some embodiments. Figure 2 ; Figure 6 This application illustrates gesture operations provided in some embodiments. Figure 3 ; Figure 7 This application illustrates gesture operations provided in some embodiments. Figure 4 ; Figure 8 This application illustrates gesture operations provided in some embodiments. Figure 5 ; Figure 9 This application illustrates gesture operations provided in some embodiments. Figure 7 ; Figure 10 The present application provides schematic diagrams of the apparatus structure according to some embodiments. Figure 11 The diagram shows a schematic representation of the device structure provided in some embodiments of this application. Detailed Implementation

[0021] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of the embodiments. The components of the embodiments of this application described and shown herein can generally be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of this application is not intended to limit the scope of the claimed application, but merely represents selected embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without inventive effort are within the scope of protection of this application.

[0022] When using touch devices, users often request split-screen display of digital content on the touch device's screen. This application proposes a gesture operation method that allows users to create multiple interfaces on the display screen using simple gestures, thereby reducing the time spent switching applications and providing users with a more intuitive and richer visual experience.

[0023] like Figure 1 As shown, the split-screen layout structure on touch devices includes, but is not limited to: M1: Single-screen structure, the display interface contains 1 interface; the interfaces are numbered 1234 from left to right and top to bottom; M2: Dual-screen - top-bottom structure, the display interface contains 2 interfaces, arranged in a top-bottom structure; the interfaces are numbered 12 and 34 from left to right and from top to bottom; M3: Dual-screen - left-right structure, the display interface contains 2 interfaces in a left-right structure; the interfaces are numbered 13 and 24 from left to right and from top to bottom; M4: Three-screen - left-top-bottom-right full-width structure. The display interface contains 3 screens, with the left side having a top-bottom structure and the right side having a full-width structure; the screens are numbered 1, 24, and 3 from left to right and from top to bottom. M5: Three-screen - top, left, right, and bottom full-width structure. The display interface contains 3 screens, with the top screen having a left-right structure and the bottom screen having a full-width structure; the screens are numbered 1, 2, 3, and 4 from left to right and from top to bottom. M6: Three-screen - left full-width and right top-bottom structure. The display interface contains 3 screens, with the right side in a top-bottom structure and the left side in a full-width structure; the screens are numbered 13, 2, and 4 from left to right and from top to bottom; M7: Three-screen - top full-width and bottom left-right structure. The display interface contains 3 screens, with the bottom screen in a left-right structure and the top screen in a full-width structure; the screens are numbered 12, 3, and 4 from left to right and from top to bottom. M8: Four-screen structure, the display interface contains 4 interfaces; the interfaces are numbered 1, 2, 3, and 4 from left to right and from top to bottom.

[0024] This application provides a gesture operation method. Figure 2 This application provides an optional flowchart illustrating a gesture operation method. Figure 1 , will combine Figure 2 The steps shown are explained.

[0025] The following describes S10: When the touch device enters the split-screen operation activation state, the touch device receives a first gesture operation.

[0026] In some embodiments of this application, the touch device includes devices such as mobile phones, tablets, computers, and touch all-in-one machines.

[0027] In some embodiments of this application, the split-screen operation is activated by default, and the user can directly perform gesture operations or manually exit the split-screen operation activation state.

[0028] In some embodiments of this application, the split-screen operation activation state is not entered by default. Users can manually enter the split-screen operation activation state on the touch device to perform gesture operations.

[0029] The following describes S20: Recognizing the first gesture operation, determining the gesture operation type corresponding to the first gesture operation, and generating a split-screen control command for the touch device.

[0030] In some embodiments of this application, the gesture operation type corresponding to the first gesture operation includes three-finger left swipe, three-finger right swipe, three-finger down swipe, and three-finger up swipe.

[0031] like Figure 3 As shown, in S20, generating the split-screen control command for the touch device includes: S21: Determine the initial application interface layout of the touch device before accepting the first gesture operation; S22: Determine the initial application interface in the initial application interface layout where the initial point of the first gesture operation is located; S23: Determine the final application interface layout corresponding to the first gesture operation based on the gesture operation type corresponding to the first gesture operation.

[0032] In some embodiments of this application, such as Figure 4 As shown, the split-screen control instructions can be summarized in the following table. Each column of the table represents: S20 determines the gesture operation type corresponding to the first gesture operation; S21 determines the initial application interface layout of the touch device before accepting the first gesture operation; S22 determines the initial application interface in the initial application interface layout where the initial point of the first gesture operation is located; S23 determines the final application interface layout corresponding to the first gesture operation; and S20 generates the split-screen control instructions for the touch device.

[0033] The first line indicates that under the interface structure M1 (single-screen structure), the three initial points of the three-finger swipe are all located on the interface numbered 1234; when the three fingers swipe up, the interface structure M2 (dual-screen-top-bottom structure) is formed; the original interface 1234 moves to interface 12 and opens the newly created interface 34.

[0034] In some embodiments of this application, such as Figure 5 As shown, the split-screen control instructions can be summarized in the following table. The format of the table and the content structure of each column are the same as those in the table above, and will not be described again below.

[0035] In some embodiments of this application, such as Figure 6 As shown, the split-screen control instructions can be summarized in the following table.

[0036] In some embodiments of this application, such as Figure 7 As shown, the split-screen control instructions can be summarized in the following table.

[0037] The first line indicates that under the interface structure M8 (four-screen structure), the three initial points of the three-finger swipe are all located on the interface number 3; when the three fingers swipe up, the interface structure M6 (three-screen - left full-width right top-bottom structure) is formed; the original interface 3 moves to interface 13 and closes the original interface 1.

[0038] In some embodiments of this application, such as Figure 8 As shown, the split-screen control instructions can be summarized in the following table.

[0039] In some embodiments of this application, such as Figure 9 As shown, the split-screen control instructions can be summarized in the following table.

[0040] Those skilled in the art will understand that, in the above-described method of the specific implementation, the order in which each step is written does not imply a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of each step should be determined by its function and possible internal logic.

[0041] Those skilled in the art will understand that, since the embodiments of this application can realize gesture operations of adding from one interface to four interfaces and deleting from four interfaces to one interface, the layout structure in the embodiments of this application can be applied to structures not limited to those formed by up to four interfaces.

[0042] like Figure 10 The diagram shown is a schematic of a gesture operation device provided in an embodiment of this application. The device includes: a receiving unit U10, a determining unit U20, and a controlling unit U30, wherein... The receiving unit U10 is used to receive a first gesture operation when the touch device enters the split-screen operation activation state; The determining unit U20 identifies the first gesture operation received by the receiving unit U10, determines the gesture operation type corresponding to the first gesture operation, and generates a split-screen control command for the touch device. The control unit U30 modifies the interface layout of the touch device according to the split-screen control command for the touch device.

[0043] The determining unit U20 generates a split-screen control command for the touch device by sequentially executing: determining the initial application interface layout of the touch device before accepting the first gesture operation; determining the initial application interface in the initial application interface layout where the initial point of the first gesture operation is located; and determining the final application interface layout corresponding to the first gesture operation based on the gesture operation type corresponding to the first gesture operation.

[0044] This application also provides a computer device, such as... Figure 11 The diagram shown is a schematic representation of a computer device structure provided in an embodiment of this application, including a processor D10 and a memory D20. The memory D20 stores machine-readable instructions executable by the processor D10. The processor D10 executes the machine-readable instructions stored in the memory D20. When the machine-readable instructions are executed by the processor D10, the processor D10 performs the following steps: When the touch device enters the split-screen operation activation state, the touch device receives a first gesture operation; the first gesture operation is identified, the gesture operation type corresponding to the first gesture operation is determined, and a split-screen control instruction for the touch device is generated; the interface layout of the touch device is modified according to the split-screen control instruction for the touch device.

[0045] The specific execution process of the above instructions can be referred to the steps of the gesture operation method described in the embodiments of this application, and will not be repeated here.

[0046] This application also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, performs the steps of the gesture operation method described in the above method embodiments. The storage medium can be a volatile or non-volatile computer-readable storage medium.

[0047] This application also provides a computer program product that carries program code. The instructions included in the program code can be used to execute the steps of the gesture operation method described in the above method embodiments. For details, please refer to the above method embodiments, which will not be repeated here.

[0048] The aforementioned computer program product can be implemented through hardware, software, or a combination thereof. In one optional embodiment, the computer program product is specifically embodied in a computer storage medium; in another optional embodiment, the computer program product is specifically embodied in a software product, such as a software development kit (SDK), etc.

[0049] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems and devices described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here. In the several embodiments provided in this application, it should be understood that the disclosed systems, devices, and methods can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of units is only a logical functional division; in actual implementation, there may be other division methods. Furthermore, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Another point is that the displayed or discussed mutual coupling or direct coupling or communication connection may be through some communication interfaces; the indirect coupling or communication connection of devices or units may be electrical, mechanical, or other forms.

[0050] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0051] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0052] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a processor-executable, non-volatile, computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0053] Finally, it should be noted that the above-described embodiments are merely specific implementations of this application, used to illustrate the technical solutions of this application, and not to limit them. The protection scope of this application is not limited thereto. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that any person skilled in the art can still modify or easily conceive of changes to the technical solutions described in the foregoing embodiments, or make equivalent substitutions for some of the technical features, within the technical scope disclosed in this application. Such modifications, changes, or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be covered within the protection scope of this application. Therefore, the protection scope of this application should be determined by the protection scope of the claims.

Claims

1. A gesture operation method for implementing split-screen display, characterized in that, Includes the following steps: Step S10: When the touch device enters the split-screen operation activation state, the touch device receives the first gesture operation; Step S20: Recognize the first gesture operation, determine the gesture operation type corresponding to the first gesture operation, and generate a split-screen control command for the touch device; Step S30: Modify the interface layout of the touch device according to the split-screen control command for the touch device.

2. The method according to claim 1, characterized in that, The gesture operation types corresponding to the first gesture operation include: three-finger left swipe, three-finger right swipe, three-finger down swipe, and three-finger up swipe; the three-finger left swipe, the three-finger right swipe, the three-finger down swipe, and the three-finger up swipe represent operations performed within the full-screen range of the touch device.

3. The method according to claim 1, characterized in that, The generation of split-screen control commands for the touch device includes: Step S21: Determine the initial application interface layout of the touch device before accepting the first gesture operation; Step S22: Determine the initial application interface in the initial application interface layout where the initial point of the first gesture operation is located; Step S23: Determine the final application interface layout corresponding to the first gesture operation based on the gesture operation type corresponding to the first gesture operation.

4. A gesture control device, characterized in that, include: The unit comprises a receiving unit, a determining unit, and a control unit, wherein... The receiving unit is used to receive a first gesture operation when the touch device enters the split-screen operation activation state; The determining unit identifies the first gesture operation, determines the gesture operation type corresponding to the first gesture operation, and generates a split-screen control command for the touch device. The control unit modifies the interface layout of the touch device according to the split-screen control command for the touch device.

5. A gesture control device, characterized in that, include: A processor and a memory, the memory storing machine-readable instructions executable by the processor, the processor executing the machine-readable instructions stored in the memory, wherein when the machine-readable instructions are executed by the processor, the processor performs the gesture operation method as described in any one of claims 1 to 3.

6. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, which, when executed by a computer device, performs the gesture operation method as described in any one of claims 1 to 3.

Images