Gesture control method and device for smart device, and smart device

Abstract

The present application relates to the field of gesture control technology, and discloses a gesture control method for smart devices. The gesture control method for smart devices includes a first application detecting a gesture image and identifying a gesture in the gesture image; the first application sends gesture information of the gesture to the second application when the second application has a gesture requirement, so that the second application executes the operation instruction corresponding to the gesture information; wherein the smart device includes a first application and a second application. The first application of the present application sends gesture information of a gesture that meets the gesture requirement to the second application when the second application has a gesture requirement, so that the second application can execute the operation instruction corresponding to the gesture detected by the first application, thereby simplifying the data calculation process of the second application and improving the response speed of the gesture. The present application also discloses a gesture control device for smart devices and a smart device.

Description

Technical Field

[0001] The present application relates to the field of gesture control technology, for example, to a gesture control method, apparatus and smart device for smart devices. Background Art

[0002] Currently, many smart devices, such as smart TVs, are controlled by remote controls or touch controls. Whether the user controls the smart device using the remote control or by touch control, the user needs to directly touch the remote control or the screen during the control process.

[0003] In the process of implementing the embodiments of the present disclosure, it is found that there are at least the following problems in the related art:

[0004] In actual applications, it often happens that the user's hands are occupied and it is inconvenient to touch the remote control or screen. Smart devices need a popular control method that does not require users to touch. Summary of the invention

[0005] In order to provide a basic understanding of some aspects of the disclosed embodiments, a brief summary is given below. The summary is not an extensive review, nor is it intended to identify key / critical components or delineate the scope of protection of these embodiments, but rather serves as a prelude to the detailed description that follows.

[0006] The embodiments of the present disclosure provide a gesture control method, apparatus and smart device for a smart device to solve the technical problem that control through a remote controller or touch requires the user to touch the remote controller or the screen to achieve control of the smart device.

[0007] In some embodiments, the gesture control method for a smart device includes: a first application detects a gesture image and recognizes the gesture in the gesture image; when the second application has a gesture requirement, the first application sends gesture information of the gesture to the second application, so that the second application executes the operation instruction corresponding to the gesture information; wherein the smart device includes the first application and the second application.

[0008] In some embodiments, the gesture control method for a smart device includes: a second application expresses a gesture requirement so that a first application can obtain the gesture requirement; the second application receives gesture information sent by the first application, and executes an operation instruction corresponding to the gesture information; wherein the smart device includes a first application and a second application; the gesture information is gesture information corresponding to the gesture in a gesture image detected by the first application.

[0009] In some embodiments, the gesture control apparatus for a smart device includes a processor and a memory storing program instructions, wherein the processor executes the above-mentioned gesture control method for a smart device when running the program instructions.

[0010] In some embodiments, the smart device includes a first application, a second application, and the above-mentioned gesture control apparatus for a smart device.

[0011] The gesture control method, apparatus and smart device for smart devices provided in the embodiments of the present disclosure can achieve the following technical effects:

[0012] The first application detects a gesture image and identifies the gesture in the gesture image; when the second application has a gesture requirement, the first application sends gesture information of the gesture to the second application, so that the second application executes the operation instruction corresponding to the gesture information; in this way, the second application that needs the gesture control function can express the gesture requirement so that the first application recognizes the gesture in the gesture image, and sends the gesture information of the gesture that meets the gesture requirement to the second application, so that the second application can execute the operation instruction corresponding to the gesture detected by the first application, so that the user can control the smart device through non-contact gesture control, which facilitates the user's control operation and improves the convenience of controlling the smart device.

[0013] The above general description and the following description are exemplary and explanatory only and are not intended to limit the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] One or more embodiments are exemplarily described by corresponding drawings, which do not limit the embodiments. Elements with the same reference numerals in the drawings are shown as similar elements, and the drawings do not constitute a scale limitation, and wherein:

[0015] Figure 1 is a schematic diagram of a gesture control method for a smart device provided by an embodiment of the present disclosure;

[0016] Figure 2 is a schematic diagram of another gesture control method for a smart device provided by an embodiment of the present disclosure;

[0017] Figure 3 is a schematic diagram of interaction between a first application and a second application provided by an embodiment of the present disclosure;

[0018] Figure 4 is another schematic diagram of interaction between a first application and a second application provided by an embodiment of the present disclosure;

[0019] Figure 5is another schematic diagram of interaction between a first application and a second application provided by an embodiment of the present disclosure;

[0020] Figure 6 Schematic diagram of a gesture control device for a smart device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0021] In order to be able to understand the features and technical contents of the embodiments of the present disclosure in more detail, the implementation of the embodiments of the present disclosure is described in detail below in conjunction with the accompanying drawings. The attached drawings are for reference only and are not used to limit the embodiments of the present disclosure. In the following technical description, for the convenience of explanation, a full understanding of the disclosed embodiments is provided through multiple details. However, one or more embodiments can still be implemented without these details. In other cases, to simplify the drawings, well-known structures and devices can be simplified for display.

[0022] The terms "first", "second", etc. in the specification and claims of the embodiments of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the terms used in this way can be interchanged where appropriate, so that the embodiments of the embodiments of the present disclosure described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions.

[0023] Unless otherwise stated, the term "plurality" means two or more.

[0024] In the embodiment of the present disclosure, the character " / " indicates that the preceding and following objects are in an "or" relationship. For example, A / B indicates: A or B.

[0025] The term "and / or" is a description of the association relationship between objects, indicating that three relationships can exist. For example, A and / or B means: A or B, or, A and B.

[0026] Combination Figure 1 As shown, an embodiment of the present disclosure provides a gesture control method for a smart device, wherein the smart device includes a first application and a second application, including:

[0027] S11, the first application detects a gesture image and recognizes a gesture in the gesture image.

[0028] S12, when the second application has a gesture requirement, the first application sends gesture information of the gesture to the second application, so that the second application executes the operation instruction corresponding to the gesture information.

[0029] By adopting the gesture control method for smart devices provided by the embodiments of the present disclosure, a gesture image can be detected by a first application, and a gesture in the gesture image can be recognized; when the second application has a gesture requirement, the first application sends gesture information of the gesture to the second application, so that the second application executes the operation instruction corresponding to the gesture information; in this way, the second application requiring the gesture control function can express the gesture requirement so that the first application recognizes the gesture in the gesture image, and sends the gesture information of the gesture that meets the gesture requirement to the second application, so that the second application can execute the operation instruction corresponding to the gesture detected by the first application, thereby allowing the user to control the smart device through a non-contact gesture control method, facilitating the user's control operation and improving the convenience of controlling the smart device.

[0030] In this article, the smart device can be a smart home appliance such as a smart refrigerator, a smart TV, a smart air conditioner, a smart speaker, a smart washing machine, or a smart portable device such as a smart phone or a tablet computer, and is not specifically limited here. The embodiment of the present disclosure takes the application of the gesture control method to a smart TV as an example, and other embodiments of the present application also apply the gesture control method to other smart devices. The smart device here needs to have an image acquisition function and be able to install applications to enable the first application to detect the gesture image. When the second application has a gesture requirement, the first application sends the gesture information corresponding to the gesture in the gesture image to the second application, so that the second application executes the operation instruction corresponding to the received gesture information, and quickly implements the function corresponding to the operation instruction.

[0031] Generally, a smart TV with gesture control function is provided with a camera for capturing images, and after identifying the captured gesture images, it is mapped into key commands of the remote control, and the user can control the smart TV by making gestures. For example, when the user makes an upward swipe gesture, when the smart TV captures the upward swipe gesture image, it parses the upward swipe gesture from the gesture image, and maps the upward swipe gesture into the key command of the upward button of the remote control. In this way, in order to control the application of the smart TV through gestures, for example, to control the smart TV to perform a video playback function, the user often needs to make multiple gestures, and the application of the smart TV also needs to obtain gesture images multiple times, identify the gestures in the gesture images, and then map the gestures into key commands, resulting in a large amount of data calculation in the process of the smart TV application to complete the function of playing videos, resulting in a slow response speed of the application controlled by gestures.

[0032] By adopting the gesture control method for smart devices provided by the embodiment of the present disclosure, a gesture image can be detected by a first application program, and a gesture in the gesture image can be recognized; when the second application program has a gesture requirement, the first application program sends gesture information of the gesture to the second application program, so that the second application program executes the operation instruction corresponding to the gesture information. The process of detecting gesture images and recognizing gestures in gesture images is separated, and there is no need for each second application program to perform the steps of detecting gesture images and recognizing gestures respectively; the first application program is used to perform the steps of detecting gesture images and recognizing gestures, and when any second application program has a gesture requirement, the second application program expresses the requirement to the first application program. In this way, the second application program receives the gesture information corresponding to the gesture, so that the second application program can execute the operation instruction corresponding to the gesture information, which not only realizes non-contact control of smart devices, facilitates the user's control operation, and improves the convenience of controlling smart devices, but also simplifies the data calculation process of the second application program, and improves the response speed of the gesture control application program.

[0033] Optionally, the smart device may further include a camera and a master control switch. When the master control switch is turned off, the camera is disabled and the first application does not detect gesture images; when the master control switch is turned on, the camera is enabled, and the first application acquires and detects gesture images by controlling the camera to acquire images.

[0034] Here, the gesture requirement may include a gesture that the second application needs to use; and the gesture information may include a gesture number corresponding to the gesture that needs to be used.

[0035] Optionally, the second application includes a correspondence between the gestures it needs to use and the operation instructions. When the second application receives a gesture number, it can determine the corresponding gesture according to the gesture number, and map the gesture into an operation instruction to execute the operation instruction, thereby realizing the gesture image detected by the first application and identifying the gesture in the gesture image. When the second application has a gesture requirement, the gesture can be converted into an operation instruction that the second application can execute. In this way, the second application can execute control instructions that are different from other applications, thereby realizing customized gesture operations by writing the correspondence between preset gesture information and operation instructions into the second application.

[0036] Optionally, the gesture control method for a smart device further includes: the first application detects whether the second application has a gesture requirement before or after recognizing the gesture. In this way, the second application does not need to perform the steps of detecting gesture images and recognizing gestures, which can simplify the data calculation process of the second application and improve the response speed of the gesture control application.

[0037] Optionally, after the first application detects the gesture image, it first identifies the gesture in the detected gesture image, and then detects whether the second application has a gesture requirement. When it is detected that the second application has a gesture requirement, the gesture information corresponding to the identified gesture is sent to the second application, so that the second application can execute the operation instruction corresponding to the gesture information.

[0038] Optionally, after the first application detects the gesture image, it first detects whether the second application has a gesture requirement. If it is detected that the second application has a gesture requirement, it then identifies the gesture in the gesture image that meets the gesture requirement; and sends the gesture information corresponding to the identified gesture to the second application, so that the second application can execute the operation instructions corresponding to the gesture information.

[0039] Optionally, the first application detects whether the second application has a gesture requirement, including: the first application detects a shared file, and determines whether the shared file contains a gesture requirement written by the second application.

[0040] Optionally, when the first application detects a gesture image, the gesture in the detected gesture image can be first identified, and then the shared file can be detected to determine whether the shared file contains the gesture requirement written by the second application. When it is detected that the shared file contains the gesture requirement written by the second application, it is determined that the second application has a gesture requirement; at this time, the gesture information corresponding to the identified gesture is sent to the second application, so that the second application can execute the operation instruction corresponding to the gesture information.

[0041] Optionally, when the first application detects a gesture image, the shared file can be detected first, and it can be determined whether the shared file contains the gesture requirement written by the second application. When it is detected that the shared file contains the gesture requirement written by the second application, it is determined that the second application has a gesture requirement. At this time, the gesture in the gesture image is identified, and the gesture information corresponding to the identified gesture is sent to the second application, so that the second application can execute the operation instruction corresponding to the gesture information.

[0042] Optionally, sending gesture information of the gesture to the second application includes: sending a broadcast containing the gesture information to the second application. When the second application receives the gesture information, it can determine the operation instruction corresponding to the gesture information and execute the operation instruction. In this way, the second application does not need to perform the steps of detecting gesture images and recognizing gestures, which not only realizes non-contact control of the smart device, facilitates the user's control operation, improves the convenience of controlling the smart device, but also simplifies the data calculation process of the second application and improves the response speed of the gesture control application.

[0043] Here, the second application may also register a broadcast receiver when writing a gesture requirement into the shared file, so that when the first application sends a broadcast containing gesture information to the second application, the second application can receive the gesture information contained in the broadcast.

[0044] At this time, the second application needs to adapt to the gesture recognition performance of the first application, for example, recognition speed, recognition frequency, and delay.

[0045] In this way, gesture information is transmitted between the first application and the second application through the broadcast mechanism. Since the second application writes gesture requirements into a shared file, and the shared file is a file that can be accessed by any application, any second application can write gesture requirements into the shared file and register a broadcast receiver without adding additional adaptation steps, and the versatility is high.

[0046] Optionally, the first application detects whether the second application has a gesture requirement, including: the first application detects whether the content transmitted by the second application includes the gesture requirement of the second application.

[0047] Optionally, when the first application detects a gesture image, the gesture in the detected gesture image may be first identified, and then the content transmitted by the second application may be detected to see whether the gesture requirement of the second application is included. When it is detected that the content transmitted by the second application includes the gesture requirement written by the second application, it is determined that the second application has a gesture requirement; at this time, the gesture information corresponding to the identified gesture is sent to the second application, so that the second application can execute the operation instruction corresponding to the gesture information.

[0048] Optionally, when the first application detects a gesture image, it can first detect whether the content transmitted by the second application contains the gesture requirement of the second application. When it is detected that the content transmitted by the second application contains the gesture requirement written by the second application, it is determined that the second application has a gesture requirement. At this time, the gesture in the gesture image is identified, and the gesture information corresponding to the identified gesture is sent to the second application, so that the second application can execute the operation instruction corresponding to the gesture information.

[0049] Optionally, before the first application detects the gesture image, the gesture control method for a smart device further includes: the first application establishes a connection with the second application, so that the first application and the second application establish a connection channel capable of bidirectional information transmission, so that the second application can transmit gesture requirements to the first application, and the first application can transmit gesture information to the second application.

[0050] Here, the connection between the first application and the second application can be established under the Android Interface Definition Language (AIDL). The gesture requirements and gesture information between the first application and the second application are transmitted through the AIDL mechanism, and the second application initiates the connection request. When the first application returns a connection confirmation to the second application, the first application establishes a connection with the second application.

[0051] The connection request may include the package name or class name of the second application; the connection confirmation may include a synchronization (SYNC) flag. Here, the synchronization flag refers to the identification information of processing data using the SYNC function; specifically, after the SYNC function puts all modified block buffers into the write queue, it runs the return command without waiting for the actual disk write operation to end.

[0052] In this way, the gesture requirements and gesture information are transmitted between the first application and the second application through the AIDL mechanism, and the information transmission is more secure, customized, and responsive. In addition, the second application can also issue gesture recognition parameter requirements through the AIDL interface as required; gesture recognition parameters include the camera's image acquisition resolution, the camera's image acquisition interval, and data filtering standards.

[0053] Optionally, the gesture requirement acquisition method for establishing a connection between the first application and the second application has a higher priority than the gesture requirement acquisition method under the broadcast mechanism. The connection establishment method is applied to the second application with a higher degree of association, and the broadcast mechanism is applied to the second application with a lower degree of association.

[0054] Combination Figure 2 As shown, the embodiment of the present disclosure also provides a gesture control method for a smart device, the smart device includes a first application and a second application, including:

[0055] S21, the second application expresses a gesture requirement so that the first application can obtain the gesture requirement.

[0056] S22, the second application receives the gesture information sent by the first application, and executes the operation instruction corresponding to the gesture information.

[0057] The gesture information is gesture information corresponding to the gesture in the gesture image detected by the first application.

[0058] By adopting the gesture control method for smart devices provided by the embodiments of the present disclosure, gesture requirements can be expressed through the second application so that the first application can obtain the gesture requirements; the second application receives the gesture information sent by the first application, and executes the operation instructions corresponding to the gesture information; in this way, the second application that needs the gesture control function can express the gesture requirements so that the first application can recognize the gesture in the gesture image, and send the gesture information of the gesture that meets the gesture requirements to the second application, so that the second application can execute the operation instructions corresponding to the gesture detected by the first application, which not only realizes non-contact control of the smart device, facilitates the user's control operation, and improves the convenience of controlling the smart device, but also simplifies the data calculation process of the second application and improves the response speed of the gesture.

[0059] Optionally, expressing the gesture requirement includes: writing the gesture requirement into a shared file, so that the first application can obtain the gesture requirement of the second application by detecting the shared file. In this way, when the second application receives the gesture information, it can determine the operation instruction corresponding to the gesture information and execute the operation instruction. Not only does it realize non-contact control of smart devices, facilitate user control operations, and improve the convenience of controlling smart devices, it can also simplify the data calculation process of the second application and improve the response speed of the gesture control application.

[0060] Optionally, the second application can also register a broadcast receiver when writing a gesture requirement into the shared file, so that when the first application sends a broadcast containing gesture information to the second application, the second application can receive the gesture information contained in the broadcast. Here, the gesture requirement can include the gesture that the second application needs to use; the gesture information can include the gesture number corresponding to the gesture that needs to be used.

[0061] Optionally, expressing the gesture requirement includes: sending the gesture requirement to the first application when the first application establishes a connection with the first application. In this way, the second application establishes a connection with the first application to achieve two-way information transmission between the first application and the second application. The second application can transmit the gesture requirement to the first application, and the first application can transmit gesture information to the second application.

[0062] Optionally, the second application includes a correspondence between gestures and operation instructions that it needs to use. When the second application receives gesture information, it can determine the corresponding gesture based on the gesture information and map the gesture into an operation instruction to execute the operation instruction, thereby realizing that when the second application has a gesture requirement, the gesture can be converted into an operation instruction that the second application can execute. In this way, the second application can respond to the matching of gesture information and control instructions that are different from other applications, so that customized gesture operations can be implemented by writing the preset correspondence between gesture information and operation instructions into the second application.

[0063] In some embodiments, Figure 3 and Figure 4 As shown, the first application detects a gesture image and recognizes a gesture in the gesture image, including:

[0064] S111, detecting a gesture image.

[0065] S112, recognizing a gesture in the gesture image.

[0066] In some embodiments, Figure 3 and Figure 4 As shown, when the second application has a gesture requirement, the first application sends gesture information of the gesture to the second application so that the second application executes the operation instruction corresponding to the gesture information, including:

[0067] S121, reading a shared file.

[0068] S122, determining that the second application has a gesture requirement.

[0069] S123: Send gesture information of the gesture to the second application.

[0070] In some embodiments, Figure 3 and Figure 4 As shown, the second application expresses the gesture requirement so that the first application can obtain the gesture requirement, including:

[0071] S211, writing gesture requirements into the shared file.

[0072] Combination Figure 3 As shown, when the first application detects a gesture image, it can first identify the gesture in the gesture image, and then read the shared file to determine whether the shared file contains the gesture requirement written by the second application. When it is detected that the shared file contains the gesture requirement written by the second application, it is determined that the second application has a gesture requirement; at this time, the gesture information of the gesture is sent to the second application, and the second application executes the operation instruction corresponding to the gesture information.

[0073] Combination Figure 4 As shown, when the first application detects a gesture image, it can first read the shared file and determine whether the shared file contains the gesture requirement written by the second application. When it is detected that the shared file contains the gesture requirement written by the second application, it is determined that the second application has a gesture requirement. At this time, the gesture in the gesture image is identified, and the gesture information of the gesture is sent to the second application, and the second application executes the operation instruction corresponding to the gesture information.

[0074] In some embodiments, Figure 5 As shown, the first application establishes a connection with the second application, including:

[0075] S01, the second application sends a connection request to the first application.

[0076] S02, the first application returns a connection confirmation to the second application.

[0077] Combination Figure 5 As shown, under the AIDL mechanism, the second application first initiates a connection request, and the first application returns a connection confirmation to the second application. At this time, the first application and the second application establish a connection channel that can transmit information in both directions. The second application expresses a gesture requirement to the first application, the first application determines that the second application has a gesture requirement, and the first application sends gesture information to the second application; the second application receives the gesture information sent by the first application and executes the operation instruction corresponding to the gesture information.

[0078] In this way, the gesture requirement is expressed through the second application so that the first application can obtain the gesture requirement; the second application receives the gesture information sent by the first application, and executes the operation instruction corresponding to the gesture information; in this way, the second application that needs the gesture control function can express the gesture requirement so that the first application can recognize the gesture in the gesture image, and send the gesture information of the gesture that meets the gesture requirement to the second application, so that the second application can execute the operation instruction corresponding to the gesture detected by the first application, which not only realizes the non-contact control of the smart device, facilitates the user's control operation, and improves the convenience of controlling the smart device, but also simplifies the data calculation process of the second application and improves the response speed of the gesture.

[0079] Combination Figure 6As shown, an embodiment of the present disclosure provides a gesture control device for a smart device, including a processor 100 and a memory 101. Optionally, the device may also include a communication interface 102 and a bus 103. The processor 100, the communication interface 102, and the memory 101 may communicate with each other through the bus 103. The communication interface 102 may be used for information transmission. The processor 100 may call the logic instructions in the memory 101 to execute the gesture control method for a smart device of the above embodiment.

[0080] In addition, the logic instructions in the memory 101 described above may be implemented in the form of software functional units and when sold or used as independent products, may be stored in a computer-readable storage medium.

[0081] The memory 101 is a computer-readable storage medium that can be used to store software programs and computer executable programs, such as program instructions / modules corresponding to the method in the embodiment of the present disclosure. The processor 100 executes the functional application and data processing by running the program instructions / modules stored in the memory 101, that is, the gesture control method for the smart device in the above embodiment is implemented.

[0082] The memory 101 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application required for at least one function; the data storage area may store data created according to the use of the terminal device, etc. In addition, the memory 101 may include a high-speed random access memory and may also include a non-volatile memory.

[0083] An embodiment of the present disclosure provides a smart device, including a first application, a second application, and the above-mentioned gesture control apparatus for the smart device.

[0084] The smart device here can be a smart home appliance such as a smart refrigerator, a smart TV, a smart air conditioner, a smart speaker, a smart washing machine, or a smart portable device such as a smart phone or a tablet computer, without any specific limitation. The smart device only needs to have an image acquisition function and be able to install an application.

[0085] The smart device provided by the embodiment of the present disclosure can detect gesture images through the first application and recognize gestures in the gesture images; when the second application has a gesture requirement, the first application sends gesture information of the gesture to the second application, so that the second application executes the operation instruction corresponding to the gesture information; in this way, the second application that needs the gesture control function can express the gesture requirement so that the first application recognizes the gesture in the gesture image, and sends the gesture information of the gesture that meets the gesture requirement to the second application, so that the second application can execute the operation instruction corresponding to the gesture detected by the first application, which not only realizes non-contact control of the smart device, facilitates the user's control operation, and improves the convenience of controlling the smart device, but also simplifies the data calculation process of the second application and improves the response speed of the gesture.

[0086] An embodiment of the present disclosure provides a computer-readable storage medium storing computer-executable instructions, wherein the computer-executable instructions are configured to execute the gesture control method for a smart device.

[0087] An embodiment of the present disclosure provides a computer program product, which includes a computer program stored on a computer-readable storage medium, and the computer program includes program instructions. When the program instructions are executed by a computer, the computer executes the above-mentioned gesture control method for a smart device.

[0088] The computer-readable storage medium mentioned above may be a transient computer-readable storage medium or a non-transitory computer-readable storage medium.

[0089] The technical solution of the embodiment of the present disclosure can be embodied in the form of a software product, which is stored in a storage medium and includes one or more instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in the embodiment of the present disclosure. The aforementioned storage medium may be a non-transient storage medium, including: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and other media that can store program codes, or a transient storage medium.

[0090] The above description and the accompanying drawings fully illustrate the embodiments of the present disclosure so that those skilled in the art can practice them. Other embodiments may include structural, logical, electrical, process and other changes. The embodiments represent only possible changes. Unless explicitly required, separate components and functions are optional, and the order of operation may vary. The parts and features of some embodiments may be included in or replace the parts and features of other embodiments. Moreover, the words used in this application are only used to describe the embodiments and are not used to limit the claims. As used in the description of the embodiments and the claims, unless the context clearly indicates, the singular forms of "a", "an" and "the" are intended to include plural forms as well. Similarly, the term "and / or" as used in this application refers to any and all possible combinations of listings containing one or more associated ones. In addition, when used in the present application, the term "comprise" and its variants "comprises" and / or comprising refer to the presence of stated features, wholes, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or groups thereof. In the absence of further restrictions, the elements defined by the sentence "comprising a ..." do not exclude the presence of other identical elements in the process, method or device comprising the elements. In this article, each embodiment may focus on the differences from other embodiments, and the same and similar parts between the various embodiments may refer to each other. For the methods, products, etc. disclosed in the embodiments, if they correspond to the method part disclosed in the embodiments, then the relevant parts can refer to the description of the method part.

[0091] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software may depend on the specific application and design constraints of the technical solution. The technicians may use different methods for each specific application to implement the described functions, but such implementations should not be considered to exceed the scope of the embodiments of the present disclosure. The technicians may clearly understand that, for the convenience and simplicity of description, the specific working processes of the systems, devices and units described above may refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.

[0092] In the embodiments disclosed herein, the disclosed methods and products (including but not limited to devices, equipment, etc.) can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units can be only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between each other shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms. The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to implement this embodiment. In addition, each functional unit in the embodiment of the present disclosure may be integrated in a processing unit, or each unit may exist physically alone, or two or more units may be integrated in one unit.

[0093] The flowchart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to the embodiment of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of the code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. In some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, which can depend on the functions involved. In the description corresponding to the flowchart and the block diagram in the accompanying drawings, the operations or steps corresponding to different boxes can also occur in a different order from the order disclosed in the description, and sometimes there is no specific order between different operations or steps. For example, two consecutive operations or steps can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, which can depend on the functions involved. Each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented by a dedicated hardware-based system that performs the specified functions or actions, or may be implemented by a combination of dedicated hardware and computer instructions.

Claims

1. A gesture control method for a smart device, wherein the smart device comprises a first application and a second application, characterized in that: include: The first application detects a gesture image and recognizes a gesture in the gesture image; When the second application has a gesture requirement, the first application sends gesture information of the gesture to the second application, so that the second application executes the operation instruction corresponding to the gesture information; The gesture control method further includes: The first application detects whether the second application has a gesture requirement before or after recognizing the gesture; The gesture requirement includes the gesture that the second application needs to use; the gesture information includes the gesture number corresponding to the gesture that needs to be used; The gesture requirement is expressed by the second application, specifically including: in the second application with a low degree of association, writing the gesture requirement into a shared file, so that the first application can obtain the gesture requirement of the second application by detecting the shared file and register a broadcast receiver; or, in the second application with a high degree of association, sending the gesture requirement to the first application when the first application establishes a connection with the second application.

2. The gesture control method according to claim 1, characterized in that: The first application detects whether the second application has a gesture requirement, including: The first application detects a shared file, and determines whether the shared file contains a gesture requirement written by the second application.

3. The gesture control method according to claim 2, characterized in that: The sending the gesture information of the gesture to the second application comprises: Sending a broadcast including the gesture information to the second application.

4. The gesture control method according to claim 1, characterized in that: The first application detects whether the second application has a gesture requirement, including: The first application detects whether the content transmitted by the second application includes a gesture requirement of the second application.

5. The gesture control method according to claim 4, characterized in that: Before detecting the gesture image, the first application further includes: The first application establishes a connection with the second application.

6. A gesture control method for a smart device, wherein the smart device includes a first application and a second application, characterized in that: include: The second application expresses a gesture requirement so that the first application can obtain the gesture requirement; The second application receives the gesture information sent by the first application, and executes the operation instruction corresponding to the gesture information; The gesture information is gesture information corresponding to the gesture in the gesture image detected by the first application; the gesture requirement includes the gesture required to be used by the second application; the gesture information includes the gesture number corresponding to the gesture required to be used; The expression of gesture requirements includes: writing gesture requirements into a shared file in a second application with a low degree of association, so that the first application can obtain the gesture requirements of the second application by detecting the shared file and register a broadcast receiver; or, in a second application with a high degree of association, sending gesture requirements to the first application when a connection is established between the first application and the second application.

7. A gesture control device for a smart device, comprising a processor and a memory storing program instructions, characterized in that: The processor is configured to execute the gesture control method for a smart device according to any one of claims 1 to 6 when executing the program instructions.

8. A smart device, comprising a first application and a second application, characterized in that: It also includes the gesture control device for smart devices as claimed in claim 7.

Images