Operation gesture control method and device, electronic equipment and storage medium

Abstract

The invention discloses an operation gesture control method and device, electronic equipment and a storage medium, and the method comprises the steps: receiving an opening instruction, sent by a user, of an application program, and obtaining the type of the application program and the current state information of the application program in response to the opening instruction; determining a current operation gesture of the application program based on the type of the application program and the current state information of the application program; generating prompt information based on the current operation gesture of the application program, and sending the prompt information to a user to prompt the user to operate the application program according to the current operation gesture. According to the method disclosed by the invention, the available operation gesture of the application program can be flexibly and dynamically planned for the user according to the type of the application program and the current state information, so that the experience feeling of the user for operating the touch equipment by using the touch operation gesture is improved.

Description

Technical Field

[0001] The present application relates to intelligent gesture recognition technology, and more particularly to an operation gesture control method, device, electronic device and storage medium. Background Art

[0002] Nowadays, with the popularity of smart touch devices, operating devices with gestures has become a convenient and fast interactive method for touch devices. Gestures allow users to open, switch, and close applications with simple touch gestures on the screen without having to click back and forth. Gesture operation has high operating efficiency and a very pleasant operating experience.

[0003] Most of the existing gesture control methods plan various gestures and the corresponding operation contents in advance in the system. When users use gestures to operate touch devices, there are few gestures that can be operated, and most of them are only sliding, zooming and other operations. In addition, the gestures and corresponding functions are directly specified by the system. One gesture can only correspond to one function. The gestures that can be used by different applications or different user groups are fixed. Users must remember each available gesture and its function. This method ignores the different operation requirements of different applications, is not flexible enough, and reduces the user experience of using gestures to operate touch devices.

[0004] Application Contents

[0005] The embodiments of the present application provide an operation gesture control method, device, electronic device and medium, which can flexibly and dynamically plan available operation gestures for users according to different operation requirements of different applications, thereby improving the user's experience of using touch gestures to operate a touch device.

[0006] In a first aspect, the present application provides an operation gesture control method, the method comprising:

[0007] Receiving an application startup instruction sent by a user, and in response to the startup instruction, acquiring the type of the application and current status information of the application;

[0008] Determining a current operation gesture of the application based on the type of the application and current state information of the application;

[0009] Prompt information is generated based on the current operation gesture of the application, and the prompt information is sent to the user to prompt the user to operate the application according to the current operation gesture.

[0010] In a second aspect, the present application provides an operation gesture control device, the device comprising:

[0011] An instruction receiving module, used to receive an application start instruction sent by a user, and in response to the start instruction, obtain the type of the application and the current state information of the application;

[0012] A gesture determination module, used to determine a current operation gesture of the application based on the type of the application and the current state information of the application;

[0013] The gesture sending module is used to generate prompt information based on the current operation gesture of the application, and send the prompt information to the user to prompt the user to operate the application according to the current operation gesture.

[0014] In a third aspect, the present application further provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, an operation gesture control method as described in any one of the present applications is implemented.

[0015] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements an operation gesture control method as described in any one of the present applications.

[0016] In the present application, an application start instruction sent by a user is received, and in response to the start instruction, the type of application and the current status information of the application are obtained; based on the type of application and the current status information of the application, the current operation gesture of the application is determined; based on the current operation gesture of the application, prompt information is generated, and the prompt information is sent to the user to prompt the user to operate the application according to the current operation gesture. The method of the present application can flexibly and dynamically plan the available operation gestures of the application for the user according to the type of application and the current status information, thereby improving the user's experience of operating a touch device using touch operation gestures. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solution of the present application, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0018] Figure 1 A first flow chart of an operation gesture control method provided by the present application;

[0019] Figure 2 A second flow chart of an operation gesture control method provided by the present application;

[0020] Figure 3 A schematic diagram of the structure of an operation gesture control device provided in this application;

[0021] Figure 4 A schematic diagram of the structure of an electronic device provided in this application. DETAILED DESCRIPTION

[0022] The present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the present application, rather than to limit the present application. It should also be noted that, for ease of description, only the parts related to the present application, rather than all structures, are shown in the accompanying drawings.

[0023] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present application.

[0024] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0025] Figure 1 This is a first flow chart of an operation gesture control method provided by the present application. The method of the present application can be applied to scenarios where the user can flexibly and dynamically plan available operation gestures to improve the user's experience of using touch gestures to operate a touch device. The method can be executed by the operation gesture control device provided by the present application, and the device can be implemented in software and / or hardware. In a specific embodiment, the device can be integrated in an electronic device, which can be a server, etc. The following embodiments will be described by taking the device integrated in a server as an example, with reference to Figure 1 , the method may specifically include the following steps:

[0026] S101: Receive an application startup instruction sent by a user, and in response to the startup instruction, obtain the type of the application and current status information of the application.

[0027] The opening instruction is an instruction sent by the user to the server through the application program to instruct the server to open the application program. The application program can be an application program on various electronic devices with touch screens, such as mobile phones, vehicle-mounted terminals, and smart appliances. The types of application programs include financial services, social networking, life services, game entertainment, and photography. The current status information of the application program includes at least: the opening mode of the application program and the display mode of the application program; the opening modes of the application program include at least children's mode, youth mode, and elderly mode.

[0028] In an optional implementation, when a user opens an application through a terminal, the server may receive an opening instruction of the application sent by the user. After receiving the opening instruction of the application, the server responds to the opening instruction and obtains the type and current status information of the application.

[0029] S102: Determine a current operation gesture of the application based on the type of the application and current state information of the application.

[0030] Among them, the types of applications include financial services, social networking, life services, gaming and entertainment, and photography, etc. The current status information of the application includes at least: the opening mode of the application and the display mode of the application; the opening mode of the application includes at least a child mode, a youth mode, and an elderly mode. The current operation gesture is the operation gesture currently available for the application. Specifically, different applications correspond to different operation gestures, and the same operation gesture can correspond to different functions in different applications. For example, when the application is a financial service application, the corresponding function of the three-finger swipe operation gesture can be transfer. When the application is a photography application, the corresponding function of the three-finger swipe operation gesture can be taking a photo. The server can determine the current operation gesture of the application based on the type of application and the current status information of the application.

[0031] In an optional embodiment, after obtaining the type of application and the current status information of the application, the server searches for a standard operation gesture corresponding to the type of application in a predetermined correspondence between the type of application and the operation gesture; determines the difficulty level of the operation gesture corresponding to the type and opening mode of the application based on the opening mode of the application; selects the operation gesture corresponding to the difficulty level of the operation gesture from the standard operation gestures as candidate operation gestures; determines the operation gesture corresponding to the display mode of the application from the candidate operation gestures as the current operation gesture of the application; wherein the display mode of the application includes at least horizontal screen display and vertical screen display.

[0032] S103: Generate prompt information based on the current operation gesture of the application, and send the prompt information to the user to prompt the user to operate the application according to the current operation gesture.

[0033] Among them, the prompt information can be voice information, screen display information, etc. Specifically, different applications and different ways of opening applications correspond to different available operation gestures. When a user opens an application, the server can determine the current operation gesture of the application based on the type of application and the current status information of the application. After determining the current operation gesture of the application, the server can generate prompt information based on the current operation gesture of the application, and display the current operation gesture to the user on the screen of the terminal in turn; at the same time, the current operation gesture is played to the user in the form of voice broadcast to prompt the user to operate the application according to the current operation gesture.

[0034] In an optional implementation, after determining the current operation gesture of the application, the server generates display information based on the current operation gesture, and sends the display information to the user through the display interface of the application; generates voice information based on the current operation gesture, and plays the voice information to the user through a voice announcer. After receiving the prompt information, the user can send an execution operation gesture to the server according to the current operation gesture. The server can receive the execution operation gesture sent by the user; perform gesture recognition on the execution operation gesture based on the current operation gesture of the application to obtain a gesture recognition result; when the gesture recognition result is successful, operate the application according to the execution operation gesture.

[0035] In the solution of this embodiment, an application opening instruction sent by a user is received, and in response to the opening instruction, the type of application and the current status information of the application are obtained; based on the type of application and the current status information of the application, the current operation gesture of the application is determined; based on the current operation gesture of the application, prompt information is generated, and the prompt information is sent to the user to prompt the user to operate the application according to the current operation gesture. The technical solution of this embodiment can flexibly and dynamically plan the available operation gestures of the application for the user according to the type of application and the current status information, thereby improving the user's experience of operating a touch device using touch operation gestures.

[0036] Figure 2 This is a second flow chart of an operation gesture control method provided by the present application. The specific method can be as follows: Figure 2 As shown, the method may include the following steps:

[0037] S201: Receive an application startup instruction sent by a user, and in response to the startup instruction, obtain the type of the application and current status information of the application.

[0038] S202: Search for a standard operation gesture corresponding to the type of application in a predetermined correspondence between the type of application and the operation gesture.

[0039] Among them, the types of applications include financial services, social networking, life services, gaming and entertainment, and photography. Standard operation gestures are all available operation gestures corresponding to the applications opened by the user. Different types of applications correspond to different operation gestures. For example, financial service applications only need to have 10 operation gestures for basic functions such as transfer and screenshot, while entertainment and game applications require 20 operation gestures for various functions such as moving, jumping, combining, and splitting. The correspondence between applications and operation gestures is pre-stored in the server, which is used to record all operation gestures of the type corresponding to different types of applications.

[0040] In an optional implementation, after the server obtains the type of application, it can search for a standard operation gesture corresponding to the type of application opened by the user in the correspondence between the type of application and the operation gesture.

[0041] S203: Based on the opening mode of the application, determine the difficulty level of the operation gesture corresponding to the type and opening mode of the application.

[0042] Among them, the opening modes of the application include at least a children's mode, a youth mode and an elderly mode. Specifically, different types of applications correspond to different standard operation gestures, different opening modes of the same application correspond to operation gestures of different difficulty levels, and each opening mode of different types of applications also corresponds to operation gestures of different difficulty levels. After determining the standard operation gesture corresponding to the type of application, the server can determine the difficulty level of the operation gesture corresponding to the type and opening mode of the application according to the opening mode of the application.

[0043] Exemplarily, when the application is a photography application, there are 20 standard operation gestures corresponding to this type of application. When the application is opened in youth mode, the difficulty level of the operation gestures corresponding to the application is all difficulty levels (20 operation gestures); when the application is opened in child mode or elderly mode, the difficulty level of the operation gestures corresponding to the application is elementary difficulty (10 operation gestures). When the application is a financial service application, there are 10 standard operation gestures corresponding to this type of application. When the application is opened in child mode, the difficulty level of the operation gestures corresponding to the application is elementary difficulty level (3 operation gestures); when the application is opened in elderly mode, the difficulty level of the operation gestures corresponding to the application is elementary difficulty level operation gestures and intermediate difficulty (5 operation gestures). When the application is opened in youth mode, the difficulty level of the operation gestures corresponding to the application is all difficulty levels (10 operation gestures).

[0044] S204: Filter out operation gestures corresponding to the difficulty level of the operation gestures from the standard operation gestures as candidate operation gestures.

[0045] Specifically, after determining the standard operation gestures and the difficulty level of the operation gestures, the server selects the operation gestures corresponding to the difficulty level from each standard operation gesture as a candidate operation gesture. For example, when the application is a photography application, there are 20 standard operation gestures corresponding to this type of application. Among them, there are 5 operation gestures of elementary difficulty, 10 operation gestures of intermediate difficulty, and 5 operation gestures of advanced difficulty. When the opening mode of the application is the elderly mode, the corresponding operation gesture difficulty level is an elementary level operation gesture. The server can then select 5 operation gestures of elementary difficulty from the 20 standard operation gestures, and determine these 5 operation gestures of elementary difficulty as candidate operation gestures.

[0046] S205: Determine an operation gesture corresponding to the display mode of the application program from the candidate operation gestures as the current operation gesture of the application program.

[0047] The display mode of the application includes at least horizontal screen display and vertical screen display. Specifically, the operation gestures corresponding to different display modes of the application are also different. After the server determines the candidate operation program of the application, the server can determine the current operation program corresponding to the candidate operation program according to the display mode of the application.

[0048] Exemplarily, when the application is a photography application, the opening mode of the application is the elderly mode, and the operation gesture difficulty level corresponding to the application is 5 candidate operation gestures of elementary difficulty. Among them is the operation gesture of sliding with two fingers to capture the current screen. When the display mode of the application is vertical, it can be determined that the operation gesture for capturing the current screen is sliding with two fingers along the length of the screen. When the display mode of the application is horizontal, it can be determined that the operation gesture for capturing the current screen is sliding with two fingers along the width of the screen. Furthermore, the server can determine the operation gesture corresponding to the display mode of the application from the candidate operation gestures as the current operation gesture of the application.

[0049] S206: Generate prompt information based on the current operation gesture of the application, and send the prompt information to the user to prompt the user to operate the application according to the current operation gesture.

[0050] The prompt information may be voice information, screen display information, etc. In the embodiment of the present solution, optionally, prompt information is generated based on the current operation gesture of the application, and the prompt information is sent to the user to prompt the user to operate the application according to the current operation gesture, including: generating display information based on the current operation gesture, and sending the display information to the user through the display interface of the application; generating voice information based on the current operation gesture, and playing the voice information to the user through the voice announcer.

[0051] Specifically, the prompt information can be display information or voice information. When the user opens the application, the server can determine the current operation gesture of the application based on the type of application and the current status information of the application. Display information is generated according to the current operation gesture of the application, and the display information is shown to the user through the display interface of the application. At the same time, voice information can be generated according to the current operation gesture, and the voice information is played to the user through the voice announcer. For example, the current operation gesture includes an operation gesture of sliding down with two fingers to take a screenshot. The display interface will show the user a schematic animation of sliding down with two fingers and schematic subtitles of capturing the screen image. At the same time, the voice announcer of the touch device will play the voice message of "Swipe down with two fingers to capture the screen image" to the user.

[0052] Through the above steps, the user can quickly and clearly understand the operation gestures available for the application according to the prompt information, thereby improving the user's experience of operating a touch device using touch operation gestures.

[0053] Furthermore, after the server sends a prompt message to the user through the display interface and the voice announcer, the user can use the operation gesture to operate the application according to the prompt message. In the embodiment of this solution, optionally, when the user uses the operation gesture to operate the application, it includes: receiving an execution operation gesture sent by the user; performing gesture recognition on the execution operation gesture based on the current operation gesture of the application to obtain a gesture recognition result; when the gesture recognition result is successful recognition, operating the application according to the execution operation gesture.

[0054] Among them, the execution operation gesture is an operation gesture sent by the user to the server through the touch screen, which is used to operate the touch device. Specifically, when the user uses the execution operation gesture on the touch screen, the server can receive the execution operation gesture. The execution operation gesture is matched with the current operation gesture of the application to check whether the execution operation gesture exists in the current operation gesture of the application. If so, it can be determined that the gesture recognition result is a successful recognition. If the execution operation gesture does not exist in the current operation gesture of the application, it can be determined that the gesture recognition result is a recognition failure. Further, when the gesture recognition result is a successful recognition, the application is operated according to the execution operation gesture.

[0055] Through the above steps, the server can perform gesture recognition on the execution operation gesture sent by the user, thereby preventing the user from accidentally touching the screen and causing erroneous operation of the device, thereby improving the user experience.

[0056] In this embodiment, an opening instruction of an application sent by a user is received, and in response to the opening instruction, the type of application and the current status information of the application are obtained. In the predetermined correspondence between the type of application and the operation gesture, the standard operation gesture corresponding to the type of application is searched. Based on the opening mode of the application, the difficulty level of the operation gesture corresponding to the type and opening mode of the application is determined. The operation gestures corresponding to the difficulty level of the operation gesture are screened out from the standard operation gestures as candidate operation gestures. The operation gesture corresponding to the display mode of the application is determined from the candidate operation gestures as the current operation gesture of the application. Prompt information is generated based on the current operation gesture of the application, and the prompt information is sent to the user to prompt the user to operate the application according to the current operation gesture. The technical solution of this embodiment can flexibly and dynamically plan the available operation gestures of the application for the user according to the type and current status information of the application, thereby improving the user's experience of operating the touch device using touch operation gestures.

[0057] Figure 3This is a schematic diagram of the structure of the operation gesture control device provided by the present application, and the device is suitable for executing the operation gesture control method provided by the present application. Figure 3 As shown, the device may specifically include:

[0058] The instruction receiving module 301 is used to receive an application start instruction sent by a user, and in response to the start instruction, obtain the type of the application and the current state information of the application;

[0059] A gesture determination module 302, configured to determine a current operation gesture of the application based on the type of the application and the current state information of the application;

[0060] The gesture sending module 303 is used to generate prompt information based on the current operation gesture of the application, and send the prompt information to the user to prompt the user to operate the application according to the current operation gesture.

[0061] Optionally, the gesture determination module 302 is specifically configured to: search for a standard operation gesture corresponding to the type of the application in a predetermined correspondence between the type of the application and the operation gesture;

[0062] A current operation gesture of the application is determined based on the standard operation gesture and current state information of the application.

[0063] Optionally, the current status information of the application includes at least: an opening mode of the application and a display mode of the application; the opening mode of the application includes at least a child mode, a youth mode and an elderly mode.

[0064] Optionally, the gesture determination module 302 is further configured to: determine a candidate operation gesture of the application based on the standard operation gesture and the opening mode of the application;

[0065] An operation gesture corresponding to the display mode of the application is determined from the candidate operation gestures as the current operation gesture of the application; wherein the display mode of the application includes at least horizontal screen display and vertical screen display.

[0066] Optionally, the gesture determination module 302 is further configured to: determine, based on the opening mode of the application, an operation gesture difficulty level corresponding to the type and opening mode of the application;

[0067] The operation gestures corresponding to the difficulty level of the operation gestures are screened out from the standard operation gestures as the candidate operation gestures.

[0068] Optionally, the gesture sending module 303 is specifically used to: generate display information based on the current operation gesture, and display the prompt information to the user through the display interface of the application;

[0069] Voice information is generated based on the current operation gesture, and the voice information is played to the user through a voice announcer.

[0070] Optionally, the gesture sending module 303 is further used to: receive an execution operation gesture sent by a user;

[0071] Performing gesture recognition on the execution operation gesture based on the current operation gesture of the application to obtain a gesture recognition result;

[0072] When the gesture recognition result is successful, the application is operated according to the execution operation gesture.

[0073] The state control device for operation gestures provided in this application can execute the operation gesture control method provided in any embodiment of this application, and has the corresponding functional modules and beneficial effects of the execution method. For the contents not described in detail in this embodiment, please refer to the description in any method embodiment of this application.

[0074] Figure 4 A schematic diagram of the structure of an electronic device provided in this application. Figure 4 A schematic diagram of an electronic device 10 that can be used to implement an embodiment of the present application is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workbenches, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present application described and / or required herein.

[0075] like Figure 4As shown, the electronic device 10 includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0076] A number of components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0077] The processor 11 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as an operation gesture control method.

[0078] In some embodiments, an operation gesture control method may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the operation gesture control method described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to perform an operation gesture control method in any other appropriate manner (e.g., by means of firmware).

[0079] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0080] The computer programs for implementing the methods of the present application may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer programs are executed by the processor, the functions / operations specified in the flow charts and / or block diagrams are implemented. The computer programs may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0081] In the context of the present application, a computer readable storage medium may be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, device or equipment. A computer readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer readable storage medium may be a machine readable signal medium. A more specific example of a machine readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0082] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0083] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0084] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0085] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this application can be executed in parallel, sequentially or in different orders, as long as the expected results of the technical solution of this application can be achieved, and this document is not limited here.

[0086] The above specific implementations do not constitute a limitation on the protection scope of this application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of this application should be included in the protection scope of this application.

[0087] Note that the above are only preferred embodiments of the present application and the technical principles used. Those skilled in the art will understand that the present application is not limited to the specific embodiments herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present application. Therefore, although the present application is described in more detail through the above embodiments, the present application is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present application, and the scope of the present application is determined by the scope of the appended claims.

Claims

1. An operation gesture control method, characterized in that: The method comprises: Receiving an application startup instruction sent by a user, and in response to the startup instruction, acquiring the type of the application and current status information of the application; Determining a current operation gesture of the application based on the type of the application and current state information of the application; Prompt information is generated based on the current operation gesture of the application, and the prompt information is sent to the user to prompt the user to operate the application according to the current operation gesture.

2. The method according to claim 1, characterized in that Determining a current operation gesture of the application based on the type of the application and the current state information of the application includes: In the predetermined correspondence between the type of the application and the operation gesture, searching for a standard operation gesture corresponding to the type of the application; A current operation gesture of the application is determined based on the standard operation gesture and current state information of the application.

3. The method according to claim 2, characterized in that The current status information of the application includes at least: an opening mode of the application and a display mode of the application; the opening mode of the application includes at least a child mode, a youth mode and an elderly mode.

4. The method according to claim 3, characterized in that Determining a current operation gesture of the application based on the standard operation gesture and current state information of the application includes: Determining a candidate operation gesture for the application based on the standard operation gesture and the opening mode of the application; An operation gesture corresponding to the display mode of the application is determined from the candidate operation gestures as the current operation gesture of the application; wherein the display mode of the application includes at least horizontal screen display and vertical screen display.

5. The method according to claim 4, characterized in that Determining a candidate operation gesture for the application based on the standard operation gesture and the opening mode of the application includes: Based on the opening mode of the application, determining the difficulty level of the operation gesture corresponding to the type and opening mode of the application; The operation gestures corresponding to the difficulty level of the operation gestures are screened out from the standard operation gestures as the candidate operation gestures.

6. The method according to claim 1, characterized in that The prompt information includes display information and voice information, and the prompt information is generated based on the current operation gesture of the application program, and the prompt information is sent to the user, including: generating the display information based on the current operation gesture, and sending the display information to the user through the display interface of the application; The voice information is generated based on the current operation gesture, and the voice information is played to the user through a voice announcer.

7. The method according to claim 1, characterized in that The method further comprises: Receive the execution operation gesture sent by the user; Performing gesture recognition on the execution operation gesture based on the current operation gesture of the application to obtain a gesture recognition result; When the gesture recognition result is successful, the application is operated according to the execution operation gesture.

8. An operation gesture control device, characterized in that: The device comprises: An instruction receiving module, used to receive an application start instruction sent by a user, and in response to the start instruction, obtain the type of the application and the current state information of the application; A gesture determination module, used to determine a current operation gesture of the application based on the type of the application and the current state information of the application; The gesture sending module is used to generate prompt information based on the current operation gesture of the application, and send the prompt information to the user to prompt the user to operate the application according to the current operation gesture.

9. An electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the program, the operation gesture control method as described in any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the operation gesture control method as described in any one of claims 1 to 7 is implemented.

Images