Gesture interaction method, device and system and computer readable storage medium

Abstract

The invention relates to a gesture interaction method, device and system and a computer readable storage medium, and the method comprises the steps: obtaining a gesture image of a target object in a projection region of projection equipment, and carrying out the gesture recognition of the gesture image; in response to the recognized first gesture, executing a component selection operation, and determining a target component; in response to the recognized second gesture, displaying at least one function icon based on the target component; identifying a third gesture, obtaining the function icon triggered by the third gesture, and executing an operation corresponding to the triggered function icon; the first gesture, the second gesture and the third gesture are different. According to the method and the device, the projection screen is controlled by utilizing different gestures, and the interaction experience between a user and the projection equipment is improved.

Description

Technical Field

[0001] The present application relates to the field of projection, and in particular to a gesture interaction method, device, system, computer equipment and computer-readable storage medium. Background Art

[0002] Projection equipment connects electronic devices through interfaces or projects images or videos onto screens through wireless projection. Therefore, projection equipment can be used in a variety of scenarios, such as conference reports, family movie watching, and friends gatherings.

[0003] However, when using the projection device, the user cannot directly control it, and there are no physical buttons on the projection device that can be used for control, which affects the user's experience. Therefore, establishing a set of interactive methods for controlling the projection screen can further improve the user's experience. Summary of the invention

[0004] The embodiments of the present application provide a gesture interaction method, device, system and computer-readable storage medium to at least solve the problem of improving the identification of projection devices in the related art.

[0005] In a first aspect, an embodiment of the present application provides a gesture interaction method, including:

[0006] Acquire a gesture image of a target object in a projection area of ​​the projection device, and perform gesture recognition on the gesture image;

[0007] In response to recognizing the first gesture, performing a component selection operation to determine a target component;

[0008] In response to recognizing the second gesture, displaying at least one functional icon based on the target component;

[0009] The third gesture is identified and a function icon triggered by the third gesture is obtained, and an operation corresponding to the triggered function icon is performed; the first gesture, the second gesture and the third gesture are different.

[0010] In one embodiment, performing a component selection operation to determine a target component includes:

[0011] Displaying a direction icon, and obtaining a movement direction and a movement range of the first gesture;

[0012] Control the movement of the directional diagram icon according to the direction of movement;

[0013] In response to the movement stroke stopping, the control direction schematic icon stops, and the component corresponding to the current direction schematic icon is determined as the target component.

[0014] In one embodiment, when the movement directions and movement ranges of two consecutive first gestures are acquired, controlling the movement of the direction diagram icon according to the movement direction includes:

[0015] Based on the position where the direction schematic icon stayed according to the last first gesture movement, the direction schematic icon is controlled to move according to the movement direction of the current first gesture.

[0016] In one embodiment, in response to recognizing the second gesture, displaying at least one function icon based on the target component includes:

[0017] In response to the recognized second gesture, the direction icon is switched to at least one function icon.

[0018] In one embodiment, before acquiring a gesture image of a target object in a projection area of ​​a projection device and performing gesture recognition on the gesture image, the method further includes:

[0019] Detecting a trigger gesture image of a target object within a preset capture time;

[0020] In response to acquiring the trigger gesture image, a gesture control mode is entered to perform gesture recognition.

[0021] In one embodiment, after performing gesture recognition on the gesture image based on the gesture control mode, the method further includes:

[0022] In the gesture control mode, an execution gesture of a target object is not recognized, and the target object is detected within a preset detection time, wherein the execution gesture includes a first gesture, a second gesture, and a third gesture;

[0023] If the target object cannot be detected, exit the gesture control mode; and / or

[0024] If the target object is detected and no execution gesture is detected within the preset time, the gesture control mode is exited.

[0025] In one embodiment, before acquiring the gesture image of the target object in the projection area of ​​the projection device, the method further includes:

[0026] In response to a gesture-triggered start instruction, a mask is displayed in the projection area, wherein the mask is used to increase the brightness of the projection picture and reduce the contrast of the projection picture.

[0027] In a second aspect, an embodiment of the present application provides a gesture interaction device, including:

[0028] A recognition module, used to obtain a gesture image of a target object in a projection area of ​​the projection device, and perform gesture recognition on the gesture image;

[0029] a determination module, configured to, in response to recognizing the first gesture, perform a component selection operation and determine a target component;

[0030] A display module, configured to display at least one function icon based on the target component in response to recognizing the second gesture;

[0031] The execution module is used to identify the third gesture and obtain the function icon triggered by the third gesture, and execute the operation corresponding to the triggered function icon; the first gesture, the second gesture and the third gesture are different.

[0032] In a third aspect, an embodiment of the present application provides a computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the gesture interaction method as described in the first aspect above when executing the computer program.

[0033] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the gesture interaction method as described in the first aspect above.

[0034] The gesture interaction method, device, system and computer-readable storage medium provided by the embodiments of the present application have at least the following technical effects.

[0035] By acquiring the gesture image of the target object in the projection area of ​​the projection device and performing gesture recognition, the corresponding operation is performed for the different gestures recognized. In response to the recognized first gesture, the component selection operation is performed and the target component is determined; in response to the recognized second gesture, at least one function icon is displayed based on the target component; when the third gesture is recognized, the triggered function icon is obtained, and the operation corresponding to the triggered function icon is performed. By recognizing gestures, the control of the projection screen is realized, thereby realizing the control of the projection screen through different gestures, further improving the interactive experience between the user and the projection device.

[0036] Details of one or more embodiments of the present application are set forth in the following drawings and description to make other features, objects, and advantages of the present application more readily apparent. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0038] Figure 1 is a flow chart of a gesture interaction method according to an exemplary embodiment;

[0039] Figure 2 is a schematic diagram of a preset detection area according to an exemplary embodiment;

[0040] Figure 3 is a schematic diagram of a gesture control instruction guide according to an exemplary embodiment;

[0041] Figure 4 is a schematic diagram of a gesture control description according to an exemplary embodiment;

[0042] Figure 5 is a comparison diagram showing a projection picture with a mask added and a projection picture without a mask added according to an exemplary embodiment;

[0043] Figure 6 are three state diagrams of a directional schematic icon according to an exemplary embodiment;

[0044] Figure 7 is a schematic diagram showing a direction schematic icon in a gesture control mode according to an exemplary embodiment;

[0045] Figure 8 is a disk arrangement diagram of function icons according to an exemplary embodiment;

[0046] Fig. 9 is an example diagram of a selected function icon according to an exemplary embodiment;

[0047] Fig.10 is a schematic diagram showing a function icon according to an exemplary embodiment;

[0048] Fig.11 is a flowchart of exiting and starting a gesture control mode according to an exemplary embodiment;

[0049] Fig.12 is a block diagram of a gesture interaction device according to an exemplary embodiment;

[0050] Fig.13 is a block diagram of an electronic device according to an exemplary embodiment.

[0051] In the above drawings, the meanings of the reference numerals are as follows:

[0052] 100, preset detection area, 200, wall, 300, projection equipment;

[0053] 400, projection image with mask added, 401, projection image without mask added;

[0054] 500, inactive state of the mode schematic symbol, 501, active state of the mode schematic symbol, 502, motion state of the mode schematic symbol;

[0055] 600, disc status of function icon, 601, confirmation icon, 602, menu icon, 603, return icon, 604, home icon. DETAILED DESCRIPTION

[0056] In order to make the purpose, technical solutions and advantages of the present application clearer, the present application is described and illustrated below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not intended to limit the present application. Based on the embodiments provided in the present application, all other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present application.

[0057] Obviously, the drawings described below are only some examples or embodiments of the present application. For ordinary technicians in this field, the present application can also be applied to other similar scenarios based on these drawings without creative work. In addition, it can also be understood that although the efforts made in this development process may be complicated and lengthy, for ordinary technicians in this field related to the content disclosed in this application, some changes in design, manufacturing or production based on the technical content disclosed in this application are just conventional technical means, and should not be understood as insufficient content disclosed in this application.

[0058] Reference to "embodiments" in this application means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those of ordinary skill in the art that the embodiments described in this application may be combined with other embodiments without conflict.

[0059] Unless otherwise defined, the technical terms or scientific terms involved in this application should be understood by people with ordinary skills in the technical field to which this application belongs. The words "one", "a", "a", "the" and the like involved in this application do not indicate a quantitative limitation, and may represent the singular or plural. The terms "include", "comprise", "have" and any of their variations involved in this application are intended to cover non-exclusive inclusions; for example, a process, method, system, product or device that includes a series of steps or modules (units) is not limited to the listed steps or units, but may also include steps or units that are not listed, or may also include other steps or units inherent to these processes, methods, products or devices. The words "connect", "connected", "coupled" and the like involved in this application are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. The "multiple" involved in this application refers to two or more. "And / or" describes the association relationship of associated objects, indicating that there may be three relationships, for example, "A and / or B" can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the objects before and after are in an "or" relationship. The terms "first", "second", "third", etc. involved in this application are only used to distinguish similar objects and do not represent a specific ordering of the objects.

[0060] Based on the above situation, the embodiments of the present application provide a gesture interaction method, device, system and computer-readable storage medium.

[0061] In a first aspect, an embodiment of the present application provides a gesture interaction method. Figure 1 is a flowchart of a gesture interaction method according to an exemplary embodiment. Figure 1 As shown, the gesture interaction method includes:

[0062] Step S101: Acquire a gesture image of a target object in a projection area of ​​a projection device, and perform gesture recognition on the gesture image.

[0063] When the target object enters the preset detection area, the projection device detects the gesture of the target object, obtains the gesture image of the target object, and performs gesture recognition on the obtained gesture image based on the recognition algorithm. Figure 2 is a schematic diagram of a preset detection area according to an exemplary embodiment, such as Figure 2 As shown, the projection device 300 projects onto the wall 200, and the preset detection area 100 includes the projection area of ​​the projection device and the boundary area of ​​the projection area.

[0064] In one embodiment, before step S101, the method further includes:

[0065] Step S1001: Detect a trigger gesture image of a target object within a preset capture time.

[0066] Figure 3 is a schematic diagram of a gesture control instruction guide according to an exemplary embodiment. Figure 3 As shown, the target object enters the preset detection area, and the trigger gesture is displayed according to the gesture control instructions displayed on the projection screen. Optionally, the preset capture time includes 3 seconds and 5 seconds. The detection trigger gesture of the target object within the preset capture time is used to prevent the target object from mistakenly entering the gesture control mode.

[0067] Optionally, Figure 4 is a schematic diagram of a gesture control description according to an exemplary embodiment. Figure 4 As shown, the gesture control instructions include control instructions for palm gestures, finger gestures, and fist gestures. The content guided by the gesture control instructions includes the method of starting the gesture control mode, usage specifications, and gesture control instructions. For example, the gesture control mode can be entered by triggering a palm gesture and maintaining the palm gesture for 3 seconds. In the gesture control mode, the gesture operation is best performed when the person is within 1 meter of the projection distance, and when using any gesture operation, the hand surface must be fully illuminated. Among them, the gesture control gestures also include fist gestures for directional navigation operations; finger gestures are used for click confirmation operations; palm gestures are used to expand function buttons, and combined with finger gestures to complete shortcut operations.

[0068] Step S1002: In response to acquiring the trigger gesture image, entering a gesture control mode to perform gesture recognition.

[0069] When the projection device enters the gesture control mode in response to acquiring the trigger gesture image, gesture recognition is performed in the gesture control mode.

[0070] When the projection device enters the gesture control mode based on the trigger gesture image, a mask is displayed in the projection area. The mask is a whiteboard layer with a transparency less than 100. When the mask is displayed, the mask is superimposed in front of the projection image. Figure 5 FIG. 1 is a diagram showing a comparison of a projection image with and without a mask added according to an exemplary embodiment. Figure 5 As shown, from the visual effect point of view, compared with the projection picture 401 without adding a mask, the projection picture 400 with adding a mask reduces the contrast of the projection picture and also increases the brightness of the projection picture, making the gesture more obvious in the picture, thereby improving the recognition accuracy of the projection device for the displayed gesture.

[0071] Step S102: In response to recognizing the first gesture, executing a component selection operation to determine a target component.

[0072] In the gesture control mode, the projection screen displays a direction icon and displays the initially selected component, that is, the projection screen displays the focus. The direction icon can be at any position on the projection screen. When the projection device responds to the first gesture and obtains the movement direction and movement range of the first gesture, the focus and the direction icon on the projection screen move along the movement direction of the first gesture until the movement range of the first gesture ends, and the component corresponding to the current direction icon is determined as the target component.

[0073] Optionally, the directional icon corresponds to a component, that is, the position corresponding to the directional icon is the selected component. According to the position where the directional icon stops last, the corresponding component is determined, and thus it is confirmed as the target component.

[0074] Optionally, the direction schematic icon moves at a preset speed, and the focus of the current component moves to the corresponding component following the direction and speed of the direction schematic icon, and finally takes the component as the focus and selects it as the target component.

[0075] Optionally, when the direction icon moves once, the focus of the current component moves once in the direction of the direction icon, and the adjacent component in the same direction of movement is selected as the target component. If the direction icon moves multiple times in succession, the focus moves multiple times according to the direction of movement, and the component last selected by the focus is selected as the target component. For example, if the direction icon moves to the right three times, the focus moves to the right three times, and the third component from the right is selected as the target component.

[0076] The direction diagram is marked with three states, the first state is an inactive state, the second state is an active state, and the third state is a moving state. Figure 6 are three state diagrams of a directional schematic icon according to an exemplary embodiment, such as Figure 6 As shown, the direction schematic icon 500 in the inactive state is used to indicate that the projection screen is in gesture control mode, the direction schematic icon 501 in the active state is used to indicate that the projection device recognizes the first gesture and can move within the projection screen, and the direction schematic icon 502 in the moving state indicates that the first gesture is in motion.

[0077] In one embodiment, Figure 7 is a schematic diagram showing a direction icon in a gesture control mode according to an exemplary embodiment. Figure 7 As shown, the directional icon shows an inactive state, an active state, and a motion state in the gesture control mode.

[0078] After entering the gesture control mode, a direction schematic icon is displayed on the projection screen, and the direction schematic icon is in an inactive state. When the target object is ready to be controlled with the first gesture, the first gesture is displayed, and the direction schematic icon is in an active state, so that the target object confirms that the projection device has recognized the first gesture and can control the projection screen. If the target object displays the first gesture and then switches to other gestures, and it is not an execution gesture, the direction schematic icon switches from an active state to an inactive state. The first gesture of the target object moves according to specific needs, and at this time, the mode schematic icon is in a moving state. The projection device obtains the movement direction and movement range of the first gesture, and controls the direction schematic icon to move according to the movement direction of the first gesture. When the movement range of the first gesture stops, the control direction schematic icon also stops. It should be noted that the direction schematic icon can only be further switched to a moving state and moved according to the first gesture when it is in an activated state.

[0079] In one embodiment, when the movement directions and movement distances of two consecutive first gestures are acquired, the direction icon is controlled to move in the movement direction of the current first gesture based on the position where the direction icon stayed during the last first gesture movement.

[0080] By identifying the first gesture and selecting the target component according to the movement of the first gesture. The direction diagram icon moves on the projection screen to show whether the projection device recognizes the first gesture, thereby reducing recognition errors. At the same time, according to identifying the first gesture and obtaining the movement direction and movement range of the first gesture, the focus is moved according to the movement direction and movement range to determine the target component, and then the focus operation of the projection end in most projection devices can be adapted, so that it has adaptability and can improve the user's interactive experience, and the operation selection can be performed through the first gesture.

[0081] Step S103: in response to recognizing the second gesture, displaying at least one function icon based on the target component.

[0082] In response to recognizing the second gesture, the direction icon is switched to at least one function icon. The function icon is used to complete the shortcut operation. Optionally, the function icon includes a confirmation icon, a return icon, a home icon, and a menu icon.

[0083] For example, if the user wants to switch from the current interface to the home page interface, the second gesture is displayed, and the current direction icon is switched to a function icon. The user can select the home page icon in the function icon to switch to the home page interface.

[0084] Optionally, the direction icon is switched to at least one function icon, and the expansion modes of the function icons include a grid state, a strip state, and a disk state. For example, the arrangement state of the function icons is a four-grid state, the arrangement state of the function icons is a strip state with the function icons arranged vertically, and the arrangement state of the function icons is a disk, and the function icons are arranged around the disk.

[0085] Figure 8 is a disk arrangement diagram of function icons according to an exemplary embodiment. Figure 8 As shown, the disc state 600 of the function icons arranges the confirmation icon 601, the menu icon 602, the return icon 603 and the home icon 604 in a clockwise order.

[0086] Fig. 9 is an example diagram of a selected function icon according to an exemplary embodiment. Fig. 9 As shown, the confirmation icon 601 is selected, the background color of the icon is different from the background colors of other icons, and the direction diagram icon is in an activated state and displayed above the confirmation icon 601.

[0087] In one embodiment, Fig.10 is a schematic diagram showing a function icon according to an exemplary embodiment, such as Fig.10 As shown, in gesture control mode, function icons are displayed through palm gestures, and confirmation operations are performed through finger gestures.

[0088] By displaying at least one function icon for the user to quickly select, the user's operation is facilitated. On the other hand, by displaying at least one function icon through the second gesture, the interactive experience between the user and the projection device can be improved, and quick operation can be performed.

[0089] Step S104, identifying a third gesture and acquiring the function icon triggered by the third gesture, and performing an operation corresponding to the triggered function icon; the first gesture, the second gesture and the third gesture are different.

[0090] The third gesture is used to: when the projection device recognizes the third gesture and the third gesture triggers the function icon, the operation corresponding to the triggered function icon is executed. For example, if the third gesture triggers the home icon in the function icon, the projection screen jumps from the current page to the home page.

[0091] On the other hand, the third gesture can also be used to confirm the current page. For example, if the current page is a page for playing a movie, the movie can be paused by the third gesture. If the current page is a home page, the selected component can be confirmed.

[0092] The first gesture, the second gesture, and the third gesture are different, and they can complete the linkage control of the projection screen. For example, the first gesture is used to control the focus to move until it moves to the target component. Based on the target component, the second gesture is displayed so that the direction icon is switched to at least one function button. The user uses the third gesture to make a selection according to his needs, such as selecting the confirmation icon, that is, confirming the selection of the component. The component is also displayed according to the built-in content. For example, if the built-in content of the component is a video, the content of the video is displayed on the projection screen after the third gesture is confirmed.

[0093] The third gesture is equivalent to the confirmation button in the remote control. It performs air confirmation through gestures, which facilitates the user's use and improves the user experience, thereby further enhancing the user's interactive experience with the projection device.

[0094] In another embodiment, Fig.11 is a flowchart showing exiting and starting a gesture control mode according to an exemplary embodiment. Fig.11 As shown, after the gesture image is gesture recognized, the following steps are specifically included:

[0095] Step 1110: In the gesture control mode, the execution gesture of the target object is not recognized, and the target object is detected within a preset detection time, wherein the execution gesture includes a first gesture, a second gesture, and a third gesture.

[0096] The projection device enters the gesture control mode and performs an execution gesture of identifying the target object. Optionally, the first gesture, the second gesture and the third gesture in the execution gesture may be a fist gesture, a palm gesture and a finger gesture. If the execution gesture of the target object is identified, it is detected whether the target object is still in a preset detection area.

[0097] Step 1112: If the target object cannot be detected, then exit the gesture control mode. And / or

[0098] If the projection device cannot recognize the execution gesture and does not detect the target object within the preset detection time, the gesture mode will be exited. For example, if the preset detection time is set to 10 seconds, then if the execution gesture is not recognized and the target object is not detected within 10 seconds, the gesture control mode will be exited.

[0099] Step 1113: If the target object is detected and no execution gesture is detected within a preset time period, exit the gesture control mode.

[0100] If the projection device cannot recognize the execution gesture, but detects the target object within the preset detection time, it will detect the execution gesture again within the preset time, and if the execution gesture is not detected within the preset time, the gesture control mode will be exited. For example, the preset time is set to 15 seconds, the target object performs the next gesture operation after completing the previous gesture operation, and does not show any execution gesture within 15 seconds, so the projection device cannot detect the execution gesture within the preset time of 15 seconds, and then exits the gesture control mode.

[0101] In one embodiment, the user can also control the start and end of the gesture control mode through an external device. Optionally, the external device includes a remote control and a button on the projection device. Taking the remote control as an example, the user uses the remote control to control the projection screen and selects to start or end the gesture control mode through the settings of the projection screen.

[0102] To sum up, the gesture interaction method provided in the embodiment of the present application controls the projection screen through different first gestures, second gestures and third gestures, completes the remote control of the projection screen by gestures, completes different operations on the projection screen according to gestures, and improves the user experience of the projection device.

[0103] In a second aspect, an embodiment of the present application provides a gesture interaction device. Fig.12 FIG. 1 is a block diagram of a gesture interaction device according to an exemplary embodiment. Fig.12 As shown, the gesture interaction device includes:

[0104] A recognition module, used to obtain a gesture image of a target object in a projection area of ​​the projection device, and perform gesture recognition on the gesture image;

[0105] a determination module, configured to, in response to recognizing the first gesture, perform a component selection operation and determine a target component;

[0106] A display module, configured to display at least one function icon based on the target component in response to recognizing the second gesture;

[0107] The execution module is used to identify the third gesture and obtain the function icon triggered by the third gesture, and execute the operation corresponding to the triggered function icon; the first gesture, the second gesture and the third gesture are different.

[0108] In summary, the gesture interaction device provided by the present application, in the recognition module, obtains the gesture image of the target object in the projection area of ​​the projection device, performs gesture recognition on it, and performs corresponding operations for different recognized gestures. In the determination module, in response to the recognized first gesture, the component selection operation is executed and the target component is determined; in the display module, in response to the recognized second gesture, at least one function icon is displayed based on the target component; in the execution module, the third gesture is recognized, the triggered function icon is obtained, and the operation corresponding to the triggered function icon is executed. By recognizing gestures, the control of the projection screen is realized, thereby realizing the control of the projection screen through different gestures, further improving the interactive experience between the user and the projection device.

[0109] It should be noted that the gesture interaction device provided in this embodiment is used to implement the above-mentioned implementation mode, and the descriptions that have been made will not be repeated. As used above, the terms "module", "unit", "subunit", etc. can be a combination of software and / or hardware that implements a predetermined function. Although the device described in the above embodiment is preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceivable.

[0110] In a third aspect, an embodiment of the present application provides an electronic device, Fig.13 FIG. 1 is a block diagram of an electronic device according to an exemplary embodiment. Fig.13 As shown, the electronic device may include a processor 81 and a memory 82 storing computer program instructions.

[0111] Specifically, the processor 81 may include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or may be configured to implement one or more integrated circuits of the embodiments of the present application.

[0112] Among them, the memory 82 may include a large-capacity memory for data or instructions. By way of example and not limitation, the memory 82 may include a hard disk drive (HDD), a floppy disk drive, a solid-state drive (SSD), a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a universal serial bus (USB) drive, or a combination of two or more of these. Where appropriate, the memory 82 may include a removable or non-removable (or fixed) medium. Where appropriate, the memory 82 may be inside or outside the data processing device. In a specific embodiment, the memory 82 is a non-volatile memory. In a specific embodiment, the memory 82 includes a read-only memory (ROM) and a random access memory (RAM). Where appropriate, the ROM may be a mask-programmed ROM, a programmable ROM (Programmable Read-Only Memory, PROM for short), an erasable PROM (ErasableProgrammable Read-Only Memory, EPROM for short), an electrically erasable PROM (Electrically ErasableProgrammable Read-Only Memory, EEPROM for short), an electrically alterable ROM (ElectricallyAlterableRead-Only Memory, EAROM for short) or a flash memory (FLASH) or a combination of two or more of these. Under appropriate circumstances, the RAM can be a static random access memory (SRAM) or a dynamic random access memory (DRAM), wherein the DRAM can be a fast page mode dynamic random access memory (FPMDRAM), an extended data output dynamic random access memory (EDODRAM), a synchronous dynamic random access memory (SDRAM), etc.

[0113] The memory 82 may be used to store or cache various data files required for processing and / or communication, as well as possible computer program instructions executed by the processor 81 .

[0114] The processor 81 implements any one of the gesture interaction methods in the above embodiments by reading and executing computer program instructions stored in the memory 82 .

[0115] In one embodiment, the gesture interaction device may further include a communication interface 83 and a bus 80. Fig.13 As shown, the processor 81, the memory 82, and the communication interface 83 are connected via a bus 80 and communicate with each other.

[0116] The communication interface 83 is used to implement communication between the modules, devices, units and / or equipment in the embodiment of the present application. The communication port 83 can also implement data communication with other components such as: external devices, image / data acquisition equipment, databases, external storage, and image / data processing workstations.

[0117] The bus 80 includes hardware, software or both, and couples the components of the gesture interaction device to each other. The bus 80 includes but is not limited to at least one of the following: a data bus (DataBus), an address bus (Address Bus), a control bus (Control Bus), an expansion bus (ExpansionBus), and a local bus (Local Bus). By way of example and not limitation, bus 80 may include an Accelerated Graphics Port (AGP) or other graphics bus, an Extended Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), a HyperTransport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an InfiniBand interconnect, a Low Pin Count (LPC) bus, a memory bus, a Micro Channel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a Video Electronics Standards Association Local Bus (VLB) bus, or other suitable buses, or a combination of two or more of the above. Bus 80 may include one or more buses, where appropriate. Although embodiments of the present application describe and illustrate a particular bus, the present application contemplates any suitable bus or interconnect.

[0118] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having a program stored thereon, and when the program is executed by a processor, the gesture interaction method provided in the first aspect is implemented.

[0119] The readable storage medium may include but is not limited to: a portable disk, a hard disk, a random access memory, a read-only memory, an erasable programmable read-only memory, an optical storage device, a magnetic storage device or any suitable combination of the above.

[0120] In a possible implementation manner, the present invention can also be implemented in the form of a program product, which includes a program code. When the program product is run on a terminal device, the program code is used to enable the terminal device to execute the steps of the gesture interaction method provided in the first aspect.

[0121] The program code for executing the present invention may be written in any combination of one or more programming languages, and may be executed entirely on a user device, partially on a user device, as an independent software package, partially on a user device and partially on a remote device, or entirely on a remote device.

[0122] The technical features of the above-described embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0123] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.

Claims

1. A gesture interaction method, characterized in that: The method is applied to a projection device, comprising: Acquire a gesture image of a target object in a projection area of ​​the projection device, and perform gesture recognition on the gesture image; In response to recognizing the first gesture, performing a component selection operation to determine a target component; In response to recognizing the second gesture, displaying at least one function icon based on the target component; Recognize a third gesture and obtain the function icon triggered by the third gesture, and perform an operation corresponding to the triggered function icon; the first gesture, the second gesture and the third gesture are different.

2. The gesture interaction method according to claim 1, characterized in that: The performing component selection operation and determining the target component includes: Displaying a direction icon, and obtaining the movement direction and movement range of the first gesture; Control the movement of the direction diagram icon according to the movement direction; In response to the movement stroke stopping, the direction schematic icon is controlled to stop, and the component corresponding to the current direction schematic icon is determined as the target component.

3. The gesture interaction method according to claim 2, characterized in that: In the case of acquiring the movement direction and movement range of the first gesture twice in succession, controlling the movement of the direction diagram icon according to the movement direction includes: Based on the position where the direction schematic icon stayed according to the last movement of the first gesture, the direction schematic icon is controlled to move according to the current movement direction of the first gesture.

4. The gesture interaction method according to claim 2, characterized in that: In response to recognizing the second gesture, displaying at least one function icon based on the target component includes: In response to the recognized second gesture, the direction icon is switched to at least one function icon.

5. The gesture interaction method according to claim 1, characterized in that: Before acquiring the gesture image of the target object in the projection area of ​​the projection device and performing gesture recognition on the gesture image, the method further includes: Detecting a trigger gesture image of a target object within a preset capture time; In response to acquiring the trigger gesture image, a gesture control mode is entered to perform the gesture recognition.

6. The gesture interaction method according to claim 1, characterized in that: After performing gesture recognition on the gesture image based on the gesture control mode, the method further includes: In the gesture control mode, an execution gesture of a target object is not recognized, and the target object is detected within a preset detection time, wherein the execution gesture includes a first gesture, a second gesture, and a third gesture; If the target object cannot be detected, exiting the gesture control mode; and / or If the target object is detected and the execution gesture is not detected within a preset time period, the gesture control mode is exited.

7. The gesture interaction method according to any one of claims 1 to 6, characterized in that: Before acquiring the gesture image of the target object in the projection area of ​​the projection device, the method further includes: In response to a gesture-triggered start instruction, a mask is displayed in the projection area, wherein the mask is used to increase the brightness of the projection picture and reduce the contrast of the projection picture.

8. A gesture interaction device, characterized in that: include: A recognition module, used to obtain a gesture image of a target object in a projection area of ​​the projection device, and perform gesture recognition on the gesture image; a determination module, configured to, in response to recognizing the first gesture, perform a component selection operation and determine a target component; A display module, configured to display at least one function icon based on the target component in response to recognizing a second gesture; an execution module, configured to recognize a third gesture, obtain the function icon triggered by the third gesture, and execute an operation corresponding to the triggered function icon; The first gesture, the second gesture, and the third gesture are different.

9. An electronic device, characterized in that: It comprises a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the gesture interaction method as claimed in any one of claims 1 to 7 when executing the computer program.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the gesture interaction method according to any one of claims 1 to 7 is implemented.

Images