A split-screen display method, display terminal and storage medium based on gesture recognition

Abstract

The present invention discloses a split-screen display method based on gesture recognition, a display terminal and a storage medium, comprising: obtaining a first gesture instruction, determining a first target operation instruction corresponding to the first gesture instruction according to the first gesture instruction; determining a number of applications to be displayed and a split-screen template corresponding to the applications to be displayed according to the first target operation instruction; and performing split-screen display of the applications to be displayed according to the split-screen template. The present invention determines a first target operation instruction according to the first gesture instruction, determines a number of applications to be displayed and a split-screen template according to the first target operation instruction, and a user can set a gesture instruction corresponding to the operation instruction according to his own habits, thereby providing the user with a more personalized and customized split-screen function.

Description

Technical Field

[0001] The present invention relates to the field of display technology, and in particular to a split-screen display method based on gesture recognition, a display terminal and a storage medium. Background Art

[0002] At present, as the number of applications increases, users have an increasingly urgent need to use multiple applications on the same screen at the same time. However, the split-screen display mode of existing display terminals is very fixed, and different operating systems have different ways of starting the split-screen function, which cannot meet the split-screen startup and interaction habits of different users.

[0003] Therefore, the existing technology still needs to be improved and developed. Summary of the invention

[0004] The technical problem to be solved by the present invention is that, in view of the above-mentioned defects of the prior art, a split-screen display method, a display terminal and a storage medium based on gesture recognition are provided, aiming to solve the problem that the existing split-screen display method is fixed, different operating systems start the split-screen function in different ways, and cannot meet the split-screen startup and interaction habits of different users.

[0005] The technical solution adopted by the present invention to solve the problem is as follows:

[0006] In a first aspect, an embodiment of the present invention provides a split-screen display method based on gesture recognition, wherein the method is applied to a display terminal, and the method includes:

[0007] Acquire a first gesture instruction, and determine a first target operation instruction corresponding to the first gesture instruction according to the first gesture instruction;

[0008] Determining, according to the first target operation instruction, a number of applications to be displayed and split-screen templates corresponding to the number of applications to be displayed;

[0009] The plurality of applications to be displayed are displayed in split screen according to the split screen template.

[0010] In the split-screen display method based on gesture recognition, the step of determining, according to the first gesture instruction, a first target operation instruction corresponding to the first gesture instruction comprises:

[0011] Obtaining the correspondence between the preset gesture instructions and the operation instructions;

[0012] A first target operation instruction corresponding to the first gesture instruction is determined according to the first gesture instruction and the correspondence between the gesture instruction and the operation instruction.

[0013] In the split-screen display method based on gesture recognition, the method for setting the correspondence between the gesture instructions and the operation instructions includes:

[0014] Obtaining a gesture setting operation instruction, and entering a gesture recognition setting interface according to the gesture setting operation instruction; wherein the gesture recognition setting interface includes a single gesture mode and a multi-gesture mode;

[0015] In the gesture recognition setting interface, gesture instructions corresponding to operation instructions are collected through a camera to set the corresponding relationship between the gesture instructions and the operation instructions.

[0016] In the split-screen display method based on gesture recognition, the first target operation instruction is a single-gesture application opening instruction, a split-screen editing instruction, or a multi-gesture application opening instruction.

[0017] In the split-screen display method based on gesture recognition, the step of determining the plurality of applications to be displayed and the split-screen templates corresponding to the plurality of applications to be displayed according to the first target operation instruction comprises:

[0018] When the first target operation instruction is a multi-gesture application opening instruction, several applications corresponding to the first target operation instruction and the split-screen templates corresponding to the several applications are obtained, and the several applications corresponding to the first target operation instruction and the split-screen templates corresponding to the several applications are determined as the several applications to be displayed and the split-screen templates corresponding to the several applications to be displayed.

[0019] In the split-screen display method based on gesture recognition, the step of determining the plurality of applications to be displayed and the split-screen templates corresponding to the plurality of applications to be displayed according to the first target operation instruction further includes:

[0020] When the first target operation instruction is a split-screen editing instruction, monitoring whether the user issues a second gesture instruction, and when the user is not detected to issue the second gesture instruction within a preset time, obtaining attribute parameters of the currently displayed application; wherein the second gesture instruction is a single-gesture open application instruction or a multi-gesture open application instruction;

[0021] According to the attribute parameters, several applications that match the currently displayed application and the split-screen templates corresponding to the applications are determined, and the several applications that match the currently displayed application and the split-screen templates corresponding to the applications are determined as the several applications to be displayed and the split-screen templates corresponding to the applications to be displayed.

[0022] The split-screen display method based on gesture recognition, wherein the method further comprises:

[0023] Acquire a third gesture instruction, and determine, according to the third gesture instruction, a second target operation instruction corresponding to the third gesture instruction; wherein the second target operation instruction is a single-gesture application opening instruction, a split-screen operation instruction, or a multi-gesture application opening instruction;

[0024] According to the second target operation instruction, the split-screen status of the plurality of applications to be displayed is adjusted.

[0025] The split-screen display method based on gesture recognition, wherein the split-screen operation instructions include pulling up the split-screen menu instruction, collecting the split-screen combination instruction, switching the split-screen template instruction, editing the combined application instruction and exiting the split-screen instruction.

[0026] In a second aspect, an embodiment of the present invention further provides a split-screen display device based on gesture recognition, wherein the device includes:

[0027] An instruction acquisition module, used to acquire a first gesture instruction, and determine a first target operation instruction corresponding to the first gesture instruction according to the first gesture instruction;

[0028] an application determination module, configured to determine a number of applications to be displayed and split-screen templates corresponding to the number of applications to be displayed according to the first target operation instruction;

[0029] The split-screen display module is used to display the plurality of applications to be displayed in split-screen according to the split-screen template.

[0030] In a third aspect, an embodiment of the present invention provides a display terminal comprising a memory and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by one or more processors, wherein the one or more programs include steps for executing a split-screen display method based on gesture recognition as described in any one of the above.

[0031] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium. When the instructions in the storage medium are executed by a processor of an electronic device, the electronic device can perform the steps of the split-screen display method based on gesture recognition as described in any one of the above.

[0032] Beneficial effects of the present invention: The embodiment of the present invention first obtains a first gesture instruction, determines a first target operation instruction corresponding to the first gesture instruction according to the first gesture instruction, then determines a number of applications to be displayed and a split-screen template corresponding to the number of applications to be displayed according to the first target operation instruction, and finally, displays the number of applications to be displayed in split-screen according to the split-screen template. Therefore, the first target operation instruction is determined according to the first gesture instruction, and the number of applications to be displayed and the split-screen template are determined according to the first target operation instruction. Users can set gesture instructions corresponding to operation instructions according to their own habits, thereby bringing users a more personalized and customized split-screen function. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0034] Figure 1 is a flow chart of a split-screen display method based on gesture recognition provided by an embodiment of the present invention;

[0035] Figure 2 is an interactive schematic diagram when the gesture recognition setting interface is in a single gesture mode in the split-screen display method based on gesture recognition provided by an embodiment of the present invention;

[0036] Figure 3 is an interactive schematic diagram when the gesture recognition setting interface is in a multi-gesture mode in the split-screen display method based on gesture recognition provided by an embodiment of the present invention;

[0037] Figure 4 is a schematic diagram of a split-screen interaction process when the first target operation instruction is a split-screen editing instruction in the split-screen display method based on gesture recognition provided by an embodiment of the present invention;

[0038] Figure 5 is a principle block diagram of a screen splitting device based on gesture recognition provided by an embodiment of the present invention;

[0039] Figure 6 It is a block diagram of the internal structure principle of the display terminal provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0040] In order to make the purpose, technical solution and advantages of the present invention clearer and more specific, the present invention is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0041] It should be noted that if the embodiments of the present invention involve directional indications (such as up, down, left, right, front, back, etc.), the directional indications are only used to explain the relative position relationship, movement status, etc. between the components under a certain specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indication will also change accordingly.

[0042] The current touch and gesture recognition-supporting display terminals have very fixed ways of interacting with split screens, such as fixed gestures or fixed event split screen operations, and different operating systems have different ways of starting the split screen function, which cannot meet the split screen startup habits of different users, and the learning cost of existing split screen displays is relatively high.

[0043] In order to solve the problems of the prior art, this embodiment provides a split-screen display method based on gesture recognition, through which the gesture instructions corresponding to the operation instructions can be customized according to the user's habits, providing the user with a more personalized and customized split-screen function, and making full use of the gesture recognition function of the display terminal camera, reducing the learning cost and improving the efficiency of split-screen display. In specific implementation, first obtain the first gesture instruction, and determine the first target operation instruction corresponding to the first gesture instruction according to the first gesture instruction, then determine the several applications to be displayed and the split-screen template corresponding to the several applications to be displayed according to the first target operation instruction, and finally, split the several applications to be displayed according to the split-screen template. Therefore, the first target operation instruction is determined according to the first gesture instruction, and the several applications to be displayed and the split-screen template are determined according to the first target operation instruction. The user can set the gesture instruction corresponding to the operation instruction according to his own habits, bringing the user a more personalized and customized split-screen function.

[0044] For example, when it is necessary to display "Today's Headlines" and "Mango TV" in split screen on the display terminal, the user sends a first gesture instruction (gun gesture and index finger gesture) to the camera of the display terminal. After the display terminal obtains the first gesture instruction, it determines the first target operation instruction (open Today's Headlines + open Mango TV) corresponding to the first gesture instruction (gun gesture and index finger gesture) according to the first gesture instruction. Then, the display terminal determines the several applications to be displayed (Today's Headlines and Mango TV) and the split screen templates corresponding to the several applications to be displayed according to the first target operation instruction (open Today's Headlines + open Mango TV). Finally, the display terminal displays the several applications to be displayed (Today's Headlines and Mango TV) in split screen according to the split screen template. Since the first target operation instruction is determined according to the first gesture instruction in this embodiment, and the several applications to be displayed and the split screen template are determined according to the first target operation instruction, the user can set the gesture instruction corresponding to the operation instruction according to his own habits, bringing a more personalized and customized split screen function to the user.

[0045] Exemplary Methods

[0046] This embodiment provides a split-screen display method based on gesture recognition, which can be applied to a display terminal. Figure 1 As shown in , the method includes:

[0047] Step S100: Acquire a first gesture instruction, and determine a first target operation instruction corresponding to the first gesture instruction according to the first gesture instruction.

[0048] Specifically, the first gesture instruction is a gesture instruction issued by a user watching the display terminal to the display terminal, such as sliding down with three fingers or drawing an 8 with one finger, and the first target operation instruction is an operation instruction corresponding to the first gesture instruction, which can be a single-gesture application opening instruction, a split-screen editing instruction, or a multi-gesture application opening instruction, such as opening Toutiao, activating split-screen, opening Toutiao and opening Mango TV, etc. The display terminal in this embodiment monitors in real time whether the user issues the first gesture instruction. When it is detected that the user issues the first gesture instruction, the first gesture instruction is acquired through a camera and recognized, and the first target operation instruction corresponding to the first gesture instruction is determined according to the first gesture instruction, so that in the subsequent steps, the plurality of applications to be displayed and the split-screen templates corresponding to the plurality of applications to be displayed are determined according to the first target operation instruction.

[0049] In a specific implementation, the step of determining the first target operation instruction corresponding to the first gesture instruction according to the first gesture instruction in step S100 includes:

[0050] S100, obtaining a correspondence between a preset gesture instruction and an operation instruction;

[0051] S200: Determine a first target operation instruction corresponding to the first gesture instruction according to the first gesture instruction and the correspondence between the gesture instruction and the operation instruction.

[0052] Specifically, the correspondence between the gesture instructions and the operation instructions is pre-defined by the user according to his own habits. After the display terminal is turned on, the user can customize the correspondence between the gesture instructions and the operation instructions according to his own split-screen startup and interaction habits. For example, drawing an 8 with one finger corresponds to pulling up the split-screen editing instruction, drawing a circle with one finger corresponds to exiting the split-screen instruction, and sliding down with three fingers corresponds to activating the split-screen instruction. The gesture instructions customized by the user can be single gesture instructions or multiple gesture instructions. The single gesture instruction refers to the number of gesture instructions currently captured by the camera of the display terminal being one, and the multiple gesture instructions refers to the number of gesture instructions currently captured by the camera of the display terminal being more than one.

[0053] After the user customizes the correspondence between gesture instructions and operation instructions according to his / her split-screen startup and interaction habits, when split-screen display is needed, the user issues a first gesture instruction to the display terminal. After the display terminal detects that the user issues the first gesture instruction, it collects the user's first gesture instruction through the camera, and determines the first target operation instruction according to the correspondence between the first gesture instruction and the gesture instruction and operation instruction customized by the user, so as to determine the several applications to be displayed and the split-screen templates corresponding to the several applications to be displayed in the subsequent steps. For example, it is pre-defined that drawing an 8 with a single finger corresponds to pulling up the split-screen editing function, drawing a circle with a single finger corresponds to exiting the split-screen, and sliding down with three fingers corresponds to activating the split-screen. When the first gesture instruction obtained is a three-finger swipe down, the first target operation instruction is to activate the split-screen. Among them, the first target operation instruction is a single-gesture application opening instruction, a split-screen editing instruction, or a multi-gesture application opening instruction, such as opening Toutiao, opening Mango TV, activating the split-screen, etc. The split-screen display method of this embodiment can customize the correspondence between gesture instructions and operation instructions according to the user's habits, provide the user with a more personalized and customized split-screen function, and make full use of the gesture recognition function of the display terminal camera, thereby reducing the learning cost and improving the efficiency of split-screen display.

[0054] In a specific implementation, the method for setting the correspondence between the gesture instruction and the operation instruction in step S110 includes:

[0055] Step S001, obtaining a gesture setting operation instruction, and entering a gesture recognition setting interface according to the gesture setting operation instruction; wherein the gesture recognition setting interface includes a single gesture mode and a multi-gesture mode;

[0056] Step S002: In the gesture recognition setting interface, the gesture instructions corresponding to the operation instructions are collected through a camera to set the corresponding relationship between the gesture instructions and the operation instructions.

[0057] When the user needs to customize the correspondence between gesture instructions and operation instructions, a gesture setting operation instruction is sent to the display terminal. The gesture setting operation instruction can be a gesture instruction, a touch instruction or a key instruction. After the display terminal obtains the gesture setting operation instruction sent by the user, it enters the gesture recognition setting interface according to the gesture setting operation instruction. In the gesture recognition setting interface, the user can customize the correspondence between gesture instructions and operation instructions by clicking "Add Gesture" and drawing a customized gesture instruction facing the camera of the display terminal. For example, the user can customize the correspondence between drawing an 8 with one finger and the instruction to pull up the split-screen editing function by clicking "Add Gesture" and drawing an 8 with one finger facing the camera of the display terminal. The user can customize the correspondence between thumbs up and opening Tencent Video by clicking "Add Gesture" and giving a thumbs up to the camera of the display terminal.

[0058] In a specific implementation, the gesture recognition setting interface can switch between two usage modes, namely, single gesture mode and multi-gesture mode. In the single gesture mode, the user can group a series of commonly used gestures. When a user uses a gesture to pull up a split screen, the display terminal will no longer feedback the non-grouped split screen gestures. For example, Figure 2 As shown in the figure, when a user uses a gesture to pull up the split screen, the display terminal only recognizes the split screen gesture of group 1, and does not recognize the gesture of non-group 1. In multi-gesture mode, the user can set multiple gesture commands to correspond to multiple operation commands at the same time. When one or more users send a multi-gesture command to the display terminal, the display terminal camera recognizes the command and directly regards it as a split screen command. For example, Figure 3 As shown, in the multi-gesture mode, user 1 sends gesture 1 and gesture 2 to the display terminal, and user 2 sends gesture 3 and gesture 4 to the display terminal at the same time. The display terminal recognizes gesture 1, gesture 2, gesture 3 and gesture 4 as opening application 1, opening application 2, opening application 3 and opening application 4, respectively, thereby realizing the split-screen display of application 1, application 2, application 3 and application 4. The display terminal can also record the user's frequently used gestures and automatically group the user's frequently used gestures to reduce the user's setting steps.

[0059] Step S200: Determine, according to the first target operation instruction, a number of applications to be displayed and split-screen templates corresponding to the number of applications to be displayed.

[0060] Specifically, after obtaining the first target operation instruction, the several applications to be displayed can be determined according to the first target operation instruction, and then the split-screen templates corresponding to the several applications to be displayed can be determined according to the several applications to be displayed and the pre-set correspondence between the applications and the split-screen templates. For example, if the first target operation instruction is to open Toutiao and Mango TV, then according to the first target operation instruction, it can be determined that the several applications to be displayed are Toutiao and Mango TV, and then the split-screen templates corresponding to Toutiao and Mango TV can be determined according to the pre-set correspondence between the applications and the split-screen templates.

[0061] In a specific implementation, the step of determining the plurality of applications to be displayed and the split-screen templates corresponding to the plurality of applications to be displayed according to the first target operation instruction in step S200 includes:

[0062] Step S210: When the first target operation instruction is a multi-gesture application opening instruction, obtain several applications corresponding to the first target operation instruction and split-screen templates corresponding to the several applications, and determine the several applications corresponding to the first target operation instruction and the split-screen templates corresponding to the several applications as the several applications to be displayed and the split-screen templates corresponding to the several applications to be displayed.

[0063] Specifically, when the first target operation instruction is a multi-gesture application opening instruction, the several applications corresponding to the first target operation instruction and the split-screen display templates corresponding to the several applications can be determined according to the first target operation instruction, and the several applications corresponding to the first target operation instruction and the split-screen templates corresponding to the several applications are determined as the several applications to be displayed and the split-screen templates corresponding to the several applications to be displayed. For example, if the first target operation instruction is a thumbs up (open Tencent Video) + OK gesture (open Douyin), it can be determined that the several applications corresponding to the first target operation instruction are Tencent Video and Douyin, and the split-screen templates matching Tencent Video and Douyin are obtained according to the pre-set correspondence between the application and the split-screen template, and Tencent Video and Douyin are determined as the several applications to be displayed, and the split-screen templates matching Tencent Video and Douyin are determined as the split-screen templates corresponding to the several applications to be displayed.

[0064] In a specific embodiment, when the first target operation instruction is a single gesture instruction to open an application, the application corresponding to the first target operation instruction is obtained, the application corresponding to the first target operation instruction and the currently displayed application are determined as several applications to be displayed, the split-screen template matching the application corresponding to the first target operation instruction and the currently displayed application is determined as the split-screen template corresponding to the several applications to be displayed, and a prompt is given as to whether to display the application in a spliced ​​screen. If the user selects yes, the several applications to be displayed are displayed in a split-screen according to the split-screen template. If the user selects no, the application corresponding to the first target operation instruction is displayed in full screen. For example, the first target operation instruction is a thumbs up (open Tencent Video), and the currently displayed application is Douyin, so the several applications corresponding to the first target operation instruction can be determined as Tencent Video, Tencent Video and Douyin are determined as several applications to be displayed, the split-screen template matching Tencent Video and Douyin is determined as the split-screen template corresponding to the several applications to be displayed, and a prompt is given as to whether to display the application in a spliced ​​screen. If the user selects yes, Tencent Video and Douyin are displayed in a split-screen according to the split-screen template. If the user selects no, Tencent Video is displayed in full screen.

[0065] In a specific implementation, the step of determining the plurality of applications to be displayed and the split-screen templates corresponding to the plurality of applications to be displayed according to the first target operation instruction in step S200 further includes:

[0066] Step M121: when the first target operation instruction is a split-screen editing instruction, monitoring whether the user issues a second gesture instruction, and when the user is not monitored to issue the second gesture instruction within a preset time, obtaining attribute parameters of the currently displayed application; wherein the second gesture instruction is a single-gesture open application instruction or a multi-gesture open application instruction;

[0067] Step M122: determine, based on the attribute parameters, several applications that match the currently displayed application and the split-screen templates corresponding to the applications, and determine the several applications that match the currently displayed application and the split-screen templates corresponding to the applications as the several applications to be displayed and the split-screen templates corresponding to the applications to be displayed.

[0068] When the first target operation instruction is a split-screen editing instruction, the display terminal further monitors whether the user issues a second gesture instruction, wherein the second gesture instruction is a single-gesture application opening instruction or a multi-gesture application opening instruction. When the user is not detected to issue the second gesture instruction within a preset time, the attribute parameters of the currently displayed application are obtained, and the attribute parameters include data such as the category of the application, the horizontal and vertical screen attributes of the application, the opened comments, and the habits of using the application. According to the attribute parameters of the application, several applications matching the currently displayed application and the split-screen templates corresponding to the several applications are determined, and the several applications matching the currently displayed application and the split-screen templates corresponding to the several applications are determined as the several applications to be displayed and the split-screen templates corresponding to the several applications to be displayed. For example, Figure 4 As shown, when the first gesture instruction is a three-finger downward swipe (activating split screen), and the user is not detected to issue a second gesture instruction within the preset time, the attribute parameters of the currently displayed application, i.e., application 1, are obtained, and application 1, application 2, application 3, and application 4 are determined as several applications to be displayed based on the attribute parameters of application 1, and application 1, application 2, application 3, and application 4 are displayed in split screen.

[0069] Of course, in this embodiment, when the first target operation instruction is a split-screen editing instruction and the user is not detected to issue a third gesture instruction within the preset time, the user's application list can also be read, and the user can select several applications to be displayed and the split-screen templates corresponding to the several applications to be displayed from the application list.

[0070] In a specific embodiment, when the user is monitored to issue a second gesture instruction within a preset time, the several applications to be displayed and the split-screen templates corresponding to the several applications to be displayed are determined according to the second gesture instruction. The determination method is the same as the step of determining the several applications to be displayed and the split-screen templates corresponding to the several applications to be displayed according to the first gesture instruction in the aforementioned steps, and this application will not repeat them here.

[0071] Step S300: display the plurality of applications to be displayed in split-screen according to the split-screen template.

[0072] Specifically, after determining the several applications to be displayed and the split-screen templates corresponding to the several applications to be displayed, the several applications to be displayed can be split-screen displayed according to the split-screen template to achieve the split-screen display of the several applications to be displayed. For example, when it is determined that the several applications to be displayed are Tencent Video and Douyin, and the split-screen template corresponding to the several applications to be displayed is Template 1, Tencent Video and Douyin can be split-screen displayed according to Template 1.

[0073] In a specific embodiment, the method further comprises:

[0074] Step S410: Acquire a third gesture instruction, and determine a second target operation instruction corresponding to the third gesture instruction according to the third gesture instruction; wherein the second target operation instruction is a single-gesture application opening instruction, a split-screen operation instruction, or a multi-gesture application opening instruction;

[0075] Step S420: According to the second target operation instruction, the split-screen status of the plurality of applications to be displayed is adjusted.

[0076] After split-screen display of several applications to be displayed, it is possible to monitor in real time whether the user issues a third gesture instruction. After monitoring the user issuing the third gesture instruction, the user's third gesture instruction is obtained, and the second target operation instruction is determined based on the correspondence between the third gesture instruction and the user-defined gesture instructions and operation instructions. Then, based on the second target operation instruction, the split-screen status of the several applications is adjusted.

[0077] In a specific embodiment, the second target operation instruction is a single-gesture application opening instruction, a split-screen operation instruction, or a multi-gesture application opening instruction, and the split-screen operation instruction includes a split-screen menu pull-up instruction, a split-screen combination favorite instruction, a split-screen template switch instruction, an edit combination application instruction, and an exit split-screen instruction.

[0078] In a specific embodiment, when the second target operation instruction is a single-gesture opening application instruction or a multi-gesture opening application instruction, a new application can be added to the current window-matching application. For example, if the second target operation instruction is to open Toutiao and Mango TV, the user is reminded to use the new window-matching application (Toutiao + Mango TV) to replace the current window-matching application, or to open the recognized instruction in the new window of the current window-matching. If the user chooses to open the recognized instruction in the new window of the current window-matching, Toutiao and Mango TV can be added to the current window-matching application.

[0079] In a specific embodiment, when the second target operation instruction is a split-screen operation instruction, you can pull up the split-screen menu, collect the split-screen combination, switch the split-screen template, edit the combined application, and exit the split screen, etc. After pulling up the split-screen menu, the gesture instruction is a fixed trigger, that is, it only responds to the gesture corresponding to the menu operation under the split-screen menu, and does not respond to other gesture instructions, for example, pull up the split-screen menu instruction (gesture F), collect the split-screen combination instruction (gesture A), switch the split-screen template instruction (gesture B), edit the combined application (gesture C), exit the split screen (gesture D). After the user pulls up the split-screen menu through gesture F, the display terminal only responds to gestures A, gesture B, gesture C, gesture D and gesture F.

[0080] It can be seen that the embodiment of the present invention first obtains the first gesture instruction, determines the first target operation instruction corresponding to the first gesture instruction according to the first gesture instruction, and then determines the several applications to be displayed and the split-screen template corresponding to the several applications to be displayed according to the first target operation instruction. Finally, the several applications to be displayed are split-screen displayed according to the split-screen template. Therefore, the first target operation instruction is determined according to the first gesture instruction, and the several applications to be displayed and the split-screen template are determined according to the first target operation instruction. Users can set the gesture instructions corresponding to the operation instructions according to their own habits, which brings more personalized and customized split-screen functions to users.

[0081] Exemplary Devices

[0082] like Figure 5 As shown in , an embodiment of the present invention provides a split-screen display device based on gesture recognition, and the device includes: an instruction acquisition module 510, an application determination module 520, and a split-screen display module 530. Specifically, the instruction acquisition module 510 is used to acquire a first gesture instruction, and determine a first target operation instruction corresponding to the first gesture instruction according to the first gesture instruction. The application determination module 520 is used to determine a number of applications to be displayed and a split-screen template corresponding to the number of applications to be displayed according to the first target operation instruction. The split-screen display module 530 is used to display the number of applications to be displayed in a split-screen according to the split-screen template.

[0083] Based on the above embodiments, the present invention further provides a display terminal, whose principle block diagram can be shown as follows: Figure 6As shown. The display terminal includes a processor, a memory, a network interface, a display screen, and a temperature sensor connected through a system bus. Among them, the processor of the display terminal is used to provide computing and control capabilities. The memory of the display terminal includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the display terminal is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a split-screen display method based on gesture recognition is implemented. The display screen of the display terminal can be a liquid crystal display screen or an electronic ink display screen, and the temperature sensor of the display terminal is pre-set inside the display terminal to detect the operating temperature of the internal device.

[0084] Those skilled in the art will understand that Figure 6 The principle block diagram shown in the figure is only a block diagram of a partial structure related to the scheme of the present invention, and does not constitute a limitation on the display terminal to which the scheme of the present invention is applied. The specific display terminal may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0085] In one embodiment, a display terminal is provided, comprising a memory and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by one or more processors. The one or more programs include instructions for performing the following operations:

[0086] Acquire a first gesture instruction, and determine a first target operation instruction corresponding to the first gesture instruction according to the first gesture instruction;

[0087] Determining, according to the first target operation instruction, a number of applications to be displayed and split-screen templates corresponding to the number of applications to be displayed;

[0088] The plurality of applications to be displayed are displayed in split screen according to the split screen template.

[0089] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided by the present invention can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0090] In summary, the present invention discloses a split-screen display method based on gesture recognition, a display terminal and a storage medium, including: obtaining a first gesture instruction, determining a first target operation instruction corresponding to the first gesture instruction according to the first gesture instruction; determining a number of applications to be displayed and a split-screen template corresponding to the several applications to be displayed according to the first target operation instruction; and performing split-screen display of the several applications to be displayed according to the split-screen template. The present invention determines the first target operation instruction according to the first gesture instruction, determines the several applications to be displayed and the split-screen template according to the first target operation instruction, and the user can set the gesture instruction corresponding to the operation instruction according to his own habits, bringing a more personalized and customized split-screen function to the user.

[0091] It should be understood that the application of the present invention is not limited to the above examples. For ordinary technicians in this field, improvements or changes can be made based on the above description. All these improvements and changes should fall within the scope of protection of the claims attached to the present invention.

Claims

1. A split-screen display method based on gesture recognition, characterized in that: Applied to a display terminal, the method comprises: Acquire a first gesture instruction, and determine a first target operation instruction corresponding to the first gesture instruction according to the first gesture instruction; Determining, according to the first target operation instruction, a number of applications to be displayed and split-screen templates corresponding to the number of applications to be displayed; Performing split-screen display on the plurality of applications to be displayed according to the split-screen template; The first target operation instruction is a single-gesture application opening instruction, a split-screen editing instruction, or a multi-gesture application opening instruction; The step of determining the plurality of applications to be displayed and the split-screen templates corresponding to the plurality of applications to be displayed according to the first target operation instruction includes: When the first target operation instruction is a multi-gesture application opening instruction, obtaining a number of applications corresponding to the first target operation instruction and split-screen templates corresponding to the applications, and determining the number of applications corresponding to the first target operation instruction and the split-screen templates corresponding to the applications as the number of applications to be displayed and the split-screen templates corresponding to the applications to be displayed; Pre-enter the mapping relationship between user-defined gestures and operation instructions; The step of determining the plurality of applications to be displayed and the split-screen templates corresponding to the plurality of applications to be displayed according to the first target operation instruction further includes: When the first target operation instruction is a split-screen editing instruction, monitoring whether the user issues a second gesture instruction, and when the user is not detected to issue the second gesture instruction within a preset time, obtaining attribute parameters of the currently displayed application; wherein the second gesture instruction is a single-gesture open application instruction or a multi-gesture open application instruction; Determining, according to the attribute parameters, a number of applications that match the currently displayed application and split-screen templates corresponding to the applications, and determining the number of applications that match the currently displayed application and the split-screen templates corresponding to the applications as the number of applications to be displayed and the split-screen templates corresponding to the number of applications to be displayed; When the first target operation instruction is a multi-gesture application opening instruction, a number of applications corresponding to the first target operation instruction and split-screen display templates corresponding to the applications can be determined according to the first target operation instruction, and the number of applications corresponding to the first target operation instruction and the split-screen templates corresponding to the applications are determined as the number of applications to be displayed and the split-screen templates corresponding to the number of applications to be displayed; When the first target operation instruction is a single-gesture instruction to open an application, obtaining an application corresponding to the first target operation instruction, determining the application corresponding to the first target operation instruction and the currently displayed application as the several applications to be displayed, determining a split-screen template that matches the application corresponding to the first target operation instruction and the currently displayed application as the split-screen template corresponding to the several applications to be displayed, and prompting whether to display the applications in a spliced ​​screen; if the user selects yes, displaying the several applications to be displayed in a split-screen according to the split-screen template; if the user selects no, displaying the application corresponding to the first target operation instruction in full screen; The method further comprises: Acquire a third gesture instruction, and determine, according to the third gesture instruction, a second target operation instruction corresponding to the third gesture instruction; wherein the second target operation instruction is a single-gesture application opening instruction, a split-screen operation instruction, or a multi-gesture application opening instruction; According to the second target operation instruction, the split-screen status of the plurality of applications to be displayed is adjusted.

2. The split-screen display method based on gesture recognition according to claim 1, characterized in that: The step of determining a first target operation instruction corresponding to the first gesture instruction according to the first gesture instruction comprises: Obtaining the correspondence between the preset gesture instructions and the operation instructions; A first target operation instruction corresponding to the first gesture instruction is determined according to the first gesture instruction and the correspondence between the gesture instruction and the operation instruction.

3. The split-screen display method based on gesture recognition according to claim 2, characterized in that: The method for setting the correspondence between the gesture instructions and the operation instructions includes: Obtaining a gesture setting operation instruction, and entering a gesture recognition setting interface according to the gesture setting operation instruction; wherein the gesture recognition setting interface includes a single gesture mode and a multi-gesture mode; In the gesture recognition setting interface, gesture instructions corresponding to operation instructions are collected through a camera to set the corresponding relationship between the gesture instructions and the operation instructions.

4. The split-screen display method based on gesture recognition according to claim 1, characterized in that: The split-screen operation instructions include pulling up a split-screen menu instruction, collecting a split-screen combination instruction, switching a split-screen template instruction, editing a combined application instruction, and exiting a split-screen instruction.

5. A display terminal, characterized in that: It includes a memory and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by one or more processors. The one or more programs include steps for executing the split-screen display method based on gesture recognition as described in any one of claims 1-4.

6. A computer-readable storage medium, when the instructions in the storage medium are executed by a processor of an electronic device, enables the electronic device to execute the steps of the split-screen display method based on gesture recognition as described in any one of claims 1 to 4.

Images