Gesture operation method and device of smart television, electronic equipment and storage medium

Abstract

The application discloses a gesture operation method and device of a smart television, electronic equipment and a storage medium. The gesture operation method of the smart television comprises the following steps: collecting a first current gesture image through an image collection device corresponding to the smart television; and generating a television control instruction corresponding to a preset standard gesture image in the case that the preset standard gesture image is recognized from the first current gesture image. The application solves the technical problem of low convenience in use of the prior art smart television.

Description

Technical Field

[0001] This application relates to the field of smart TV technology, and in particular to a gesture operation method, device, electronic device and storage medium for a smart TV. Background Technology

[0002] With the rapid development of smart TVs, their functions and content are becoming increasingly diverse, but operation is also becoming more complex. Currently, smart TV operation mainly relies on remote control on the display interface. The controls for various smart TV functions are often widely distributed across the display interface, even within different levels of menus. For example, switching TV modes might require finding the settings button on the main screen, entering the settings interface, finding the mode settings button, and then using the remote control to select the corresponding TV mode. However, each display interface may contain numerous buttons, and due to the increased functionality, each button is small and displays limited information. The function of many buttons is often unclear before clicking. Users not only need to accurately locate the corresponding button on each display interface but may also need to search further after entering a secondary display interface, making operation extremely cumbersome and inconvenient. This is especially true for the elderly and children, who may find it difficult to master the numerous complex operation methods, rendering many functions unusable and significantly reducing the convenience of using smart TVs. Summary of the Invention

[0003] The main objective of this application is to provide a gesture operation method, device, electronic device, and storage medium for smart TVs, aiming to solve the technical problem of low ease of use of existing smart TVs.

[0004] To achieve the above objectives, this application provides a gesture operation method for a smart TV, comprising the following steps:

[0005] The first current gesture image is captured by the image acquisition device corresponding to the smart TV;

[0006] If a preset standard gesture image is recognized from the first current gesture image, a TV control command corresponding to the preset standard gesture image is generated.

[0007] This application also provides a gesture operation device for a smart TV, the gesture operation device for the smart TV comprising:

[0008] The image acquisition module is used to acquire the first current gesture image through the image acquisition device corresponding to the smart TV;

[0009] The TV control command generation module is used to generate TV control commands corresponding to the preset standard gesture image when a preset standard gesture image is recognized from the first current gesture image.

[0010] This application also provides an electronic device, which is a physical device, comprising: a memory, a processor, and a program for the gesture operation method of the smart TV stored in the memory and executable on the processor. When the program for the gesture operation method of the smart TV is executed by the processor, it can implement the steps of the gesture operation method of the smart TV as described above.

[0011] This application also provides a storage medium, which is a computer-readable storage medium, storing a program that implements a gesture operation method for a smart TV. When the program for the gesture operation method for a smart TV is executed by a processor, it implements the steps of the gesture operation method for a smart TV as described above.

[0012] This application provides a gesture operation method, device, electronic device, and storage medium for a smart TV. It acquires a first current gesture image using an image acquisition device corresponding to the smart TV, thus capturing the image of the user's current gesture. Then, by recognizing a preset standard gesture image from the first current gesture image, it generates a TV control command corresponding to the preset standard gesture image, achieving the conversion between gesture images and TV control commands. In this way, users can control the smart TV by making gestures matching the preset standard gesture image while watching TV. Compared to controlling the smart TV by finding buttons on the display interface, gesture operation is more intuitive and expressive, easier for the elderly and children to remember, and has a lower learning cost, making it easier to master. This overcomes the technical shortcomings of traditional smart TVs where the difficulty in mastering numerous complex operation methods significantly reduces the convenience of using the TV, thus improving the ease of use of smart TVs. Attached Figure Description

[0013] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0014] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0015] Figure 1This is a flowchart illustrating the first embodiment of the gesture operation method for a smart TV in this application;

[0016] Figure 2 This is a flowchart illustrating the second embodiment of the gesture operation method for a smart TV in this application;

[0017] Figure 3 This is a flowchart illustrating the third embodiment of the gesture operation method for a smart TV in this application;

[0018] Figure 4 This is a schematic diagram of the structure of an embodiment of the gesture operation device for a smart TV in this application;

[0019] Figure 5 This is a schematic diagram of the device structure of the hardware operating environment involved in the gesture operation method of the smart TV in this application embodiment.

[0020] The purpose, features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0021] To make the above-mentioned objects, features, and advantages of the present invention more apparent and understandable, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0022] Example 1

[0023] This application provides a gesture operation method for a smart TV. In the first embodiment of the gesture operation method for a smart TV, refer to... Figure 1 This includes the following steps:

[0024] Step S10: Acquire the first current gesture image through the image acquisition device corresponding to the smart TV;

[0025] The execution subject of the method in this embodiment can be a gesture operation device of a smart TV, or a gesture operation terminal device or server of a smart TV. This embodiment takes a gesture operation device of a smart TV as an example. The gesture operation device of the smart TV can be integrated into terminal devices such as smart TVs, smartphones, tablets, and computers with data processing functions.

[0026] In this embodiment, it should be noted that the image acquisition device refers to a device that uses the photo-to-electric conversion function of an optoelectronic device to convert the light signal on its photosensitive surface into an electrical signal that is proportional to the light signal. Examples include cameras, webcams, and cameras. The image acquisition device can be a component originally configured in the smart TV, or it can be independent of the smart TV but can communicate with it. For example, for a smart TV that does not originally have a camera, an additional camera can be added, or a camera from a mobile phone or other electronic device can be used. After these image acquisition devices are connected to the smart TV, gesture images can be acquired. The first current gesture image can be a static gesture image, multiple static gesture images, a dynamic image, or a video image over a period of time, etc.

[0027] For example, when a user needs to control a smart TV, they can make a corresponding gesture. The gesture operation device of the smart TV performs image acquisition through the image acquisition device and extracts the first current gesture image corresponding to the user's gesture from the acquired image.

[0028] In one feasible implementation, the first current gesture image can be continuously acquired through the image acquisition device corresponding to the smart TV after the smart TV is powered on and running. Alternatively, the first current gesture image can be acquired through the image acquisition device corresponding to the smart TV in response to a gesture recognition trigger operation. The gesture recognition trigger operation can be a user operation, such as a user triggering a gesture recognition authentication function. The gesture recognition authentication function can be set according to actual conditions, and this embodiment does not limit it. The gesture recognition trigger operation can also be an operation automatically triggered by the system, such as automatically triggering the gesture recognition trigger operation after powering on. The timing of the automatic trigger by the system can be set according to actual conditions, and this embodiment does not limit it.

[0029] Optionally, the step of acquiring the first current gesture image through the image acquisition device corresponding to the smart TV includes:

[0030] Step S11: In response to the gesture recognition trigger operation, turn on the image acquisition device of the smart TV;

[0031] In this embodiment, it should be noted that the user's operation of the TV is not continuous. If the image acquisition device continuously acquires images, it will be unable to acquire valuable gesture images most of the time, and it will also consume power and perform image transmission and recognition continuously, resulting in a waste of resources.

[0032] For example, after the smart TV is powered on, it continuously monitors for gesture recognition trigger operations. Upon detecting a gesture recognition trigger operation, the smart TV's image acquisition device is activated in response to the gesture recognition trigger operation. The gesture recognition trigger operation can be a user operation, such as a user triggering a gesture recognition authentication function. The gesture recognition authentication function can be set according to actual conditions, and this embodiment does not limit it. The gesture recognition trigger operation can also be an operation automatically triggered by the system, such as automatically triggering the gesture recognition trigger operation after powering on. The timing of automatic system triggering can be set according to actual conditions, and this embodiment does not limit it.

[0033] Step S12: Acquire the first current gesture image using the image acquisition device.

[0034] For example, after the gesture recognition needs to be triggered, the user can make the corresponding gesture according to the actual TV operation they want to perform. The gesture operation device of the smart TV performs image acquisition through the image acquisition device and extracts the first current gesture image corresponding to the user's gesture from the acquired image.

[0035] In this embodiment, the image acquisition device is activated by triggering operation through gesture recognition. The image acquisition device can be activated only when there is a need to acquire gesture images. Therefore, each time power and resources are consumed for image acquisition, a gesture image with practical value can be acquired, which improves the effective utilization of resources and reduces resource waste.

[0036] Optionally, before the step of acquiring the first current gesture image through the image acquisition device corresponding to the smart TV, the method further includes:

[0037] Step A10: In response to the standard gesture setting operation, a second current gesture image is captured by the image acquisition device corresponding to the smart TV;

[0038] Step A20: Determine the second current gesture image as a preset standard gesture image.

[0039] In this embodiment, it should be noted that the system can pre-set standard gestures for users to refer to and execute, so that the TV can execute the corresponding TV control commands. However, different people have different habits. If users perform gesture operations according to the standard gestures set by the system, the difficulty of memorizing gesture operations that do not conform to their own habits will increase.

[0040] For example, a user can set a standard gesture through the gesture settings interface. In response to the standard gesture setting operation, the image acquisition device corresponding to the smart TV acquires a second current gesture image and determines the second current gesture image as the preset standard gesture image.

[0041] In one feasible implementation, the step of acquiring a second current gesture image through an image acquisition device corresponding to a smart TV and determining the second current gesture image as a preset standard gesture image may include acquiring multiple second current gesture images multiple times through the image acquisition device corresponding to the smart TV. The step of determining the second current gesture image as the preset standard gesture image includes: selecting one of the second current gesture images as the preset standard gesture image when the similarity between all the second current gesture images is higher than a preset first similarity threshold.

[0042] It should be noted that the similarity thresholds in this embodiment can be the same or different, and can be determined according to the actual situation. This embodiment does not impose any restrictions on this.

[0043] In this embodiment, by customizing the preset standard gesture image, on the one hand, users have a deeper impression of the customized standard gesture image, remember it more clearly, and find it easier to remember, making gesture operation simpler and more convenient. On the other hand, the customization method can increase the fun of gesture operation, making it easier for users to accept and get used to this operation method.

[0044] Step S20: If a preset standard gesture image is recognized from the first current gesture image, a TV control command corresponding to the preset standard gesture image is generated.

[0045] In this embodiment, it should be noted that the preset standard gesture image is a pre-stored standard gesture image corresponding to the TV control command. It can be preset by the system or pre-entered by the user through the settings interface. A smart TV may have multiple functions that can be controlled by gestures, and different functions correspond to different TV control commands. Therefore, different or the same standard gesture images can be set for different TV control commands. For example, a gesture image of waving the palm upwards can correspond to a TV control command of swiping upwards, and a gesture image of the entire process of the hand moving from a fist to a peace sign can correspond to a TV control command of logging into a specific account, etc. The TV control command refers to the command used to control the TV to achieve the corresponding function, such as a TV control command for logging into an account, a TV control command for switching accounts, a TV control command for switching TV modes, etc.

[0046] For example, after acquiring the first current gesture image, image recognition technology can be used to perform similarity matching between the first current gesture image and a plurality of pre-stored standard gesture images. If the similarity between the first current gesture image and at least one of the pre-stored standard gesture images is higher than a preset second similarity threshold, it is determined that a preset standard gesture image has been identified from the first current gesture image, and a TV control command corresponding to the preset standard gesture image is generated. If the similarity between the first current gesture image and the plurality of pre-stored standard gesture images is not higher than the preset second similarity threshold, it is determined that no preset standard gesture image has been identified from the first current gesture image, and the process can return to the step of acquiring the first current gesture image through the image acquisition device corresponding to the smart TV.

[0047] In one feasible implementation, the method of matching the first current gesture image with a preset standard gesture image using image recognition technology can be to extract the current gesture trajectory from the first current gesture image and match the current gesture trajectory with the standard gesture trajectory of the preset standard gesture image. Alternatively, the method of matching the first current gesture image with a preset standard gesture image using image recognition technology can be to extract the current gesture contour from the first current gesture image and match the current gesture contour with the standard gesture contour of the preset standard gesture image. When the gesture image includes multiple frames of gesture images, the method of matching the first current gesture image with a preset standard gesture image using image recognition technology can also be to extract the current gesture contour corresponding to each frame from the first current gesture image and match each current gesture contour with the standard gesture contour of the corresponding frame in the preset standard gesture image.

[0048] Optionally, the step of generating a TV control command corresponding to the preset standard gesture image when a preset standard gesture image is recognized from the first current gesture image includes:

[0049] Step S21: Extract the current gesture trajectory and the current gesture execution time from the first current gesture image;

[0050] In this embodiment, it should be noted that controlling a smart TV may also include operations requiring authorization, such as logging into an account or switching TV modes. When logging into an account, authorization is required due to the potential involvement of privacy information and assets. Similarly, when switching TV modes, since many parents now set up children's modes to restrict their children's viewing content, user identity verification is also necessary. Different people making the same gesture may have a high degree of similarity in gesture outline or trajectory, but the speed may differ; for example, the speed at which an elderly person and a child make the same gesture is usually different. Therefore, compared to outline recognition or trajectory recognition, matching both gesture trajectory and gesture execution time to determine whether a preset standard gesture image has been recognized can simultaneously verify user identity and avoid accidental operations—that is, users unintentionally making gestures that match the standard gesture image. The speed at which the same gesture is made for different purposes will also vary; therefore, matching gesture execution time can further improve the accuracy of TV control commands.

[0051] For example, after acquiring the first current gesture image, feature extraction can be performed on the first current gesture image to obtain the current gesture trajectory and the current gesture execution time. The feature extraction method is similar to the prior art and will not be described in detail here. The current gesture trajectory refers to the trajectory of the current gesture from start to finish. For example, the trajectory of the peace sign gesture can be the trajectory of the entire process from clenching the fist to gradually extending the index and middle fingers upwards. The current gesture execution time refers to the time from start to finish of the current gesture.

[0052] Step S22: If the current gesture trajectory matches the standard gesture trajectory of the preset standard gesture image, and the current gesture execution time matches the standard gesture execution time of the preset standard gesture image, then determine that the preset standard gesture image is identified from the first current gesture image.

[0053] Step S23: Generate TV control commands corresponding to the preset standard gesture images.

[0054] For example, the current gesture trajectory is matched with the standard gesture trajectory of a preset standard gesture image for similarity, and the execution time of the current gesture is compared with the execution time of the standard gesture of the preset standard gesture image. If the similarity between the current gesture trajectory and the standard gesture trajectory of the preset standard gesture image is higher than a preset third similarity threshold, and the error between the execution time of the current gesture and the execution time of the standard gesture of the preset standard gesture image is within a preset error range, it is determined that a preset standard gesture image has been identified from the first current gesture image, and a TV control command corresponding to the preset standard gesture image is generated. If at least one of the following conditions is not met: the similarity between the current gesture trajectory and the standard gesture trajectory of the preset standard gesture image is higher than the preset third similarity threshold, and the error between the execution time of the current gesture and the execution time of the standard gesture of the preset standard gesture image is within a preset error range, it is determined that a preset standard gesture image has not been identified from the first current gesture image, and the process can return to the step of acquiring the first current gesture image through the image acquisition device corresponding to the smart TV.

[0055] In one feasible implementation, multiple different TV control commands may correspond to the same standard gesture image. The step of generating a TV control command corresponding to the preset standard gesture image when a preset standard gesture image is identified from the first current gesture image may include: when a preset standard gesture image is identified from the first current gesture image, detecting multiple TV operations corresponding to the preset standard gesture image; and generating a TV control command corresponding to each of the TV operations.

[0056] In one feasible implementation, after the step of generating the TV control command corresponding to the preset standard gesture image, the image acquisition device can also be turned off to avoid wasting resources due to the image acquisition device being constantly on.

[0057] In this embodiment, a first current gesture image is captured by the image acquisition device corresponding to the smart TV, realizing the acquisition of the image of the user's current gesture. Then, by recognizing a preset standard gesture image from the first current gesture image, a TV control command corresponding to the preset standard gesture image is generated, realizing the conversion between gesture image and TV control command. In this way, while watching TV, the user can control the smart TV by making gestures that match the preset standard gesture image. Compared with the method of controlling the smart TV by finding buttons on the display interface, gesture operation is more intuitive and expressive, which is easier for the elderly and children to remember, with a lower learning cost, and is therefore easier to master. This overcomes the technical defects of the smart TV, which is difficult to master due to numerous complicated operation methods, resulting in many functions being unusable and greatly reducing the convenience of using the smart TV, thus improving the ease of use of the smart TV.

[0058] Example 2

[0059] Furthermore, referring to Figure 2 Based on the above embodiments of this application, in the second embodiment of this application, the same or similar content as the above embodiments can be referred to the above description, and will not be repeated hereafter. Based on this, the standard gesture image includes a first standard gesture image, and the step of generating a TV control command corresponding to the preset standard gesture image when a preset standard gesture image is recognized from the first current gesture image includes:

[0060] Step B10: If it is determined that the gesture recognition trigger operation is an account login gesture recognition trigger operation, obtain the first target account corresponding to the account login gesture recognition trigger operation and the first standard gesture image corresponding to the first target account.

[0061] In this embodiment, it should be noted that currently, smart TVs offer some paid content for users to purchase as needed. After purchase, the right to use the paid features is allocated to the corresponding account, resulting in differences in assets and available functions across different accounts. Users need to log in to their accounts to access their associated resources and records. Currently, login methods such as password login, mobile verification code login, and mobile QR code login are commonly used. These login methods are relatively complex, requiring several steps to complete, increasing the difficulty for users. If a user forgets their password or their mobile phone is not readily available, they will be unable to log in.

[0062] For example, after acquiring the first current gesture image, the specific gesture recognition trigger operation type can be determined based on the relevant information of the gesture recognition trigger operation. If the gesture recognition trigger operation is determined to be an account login gesture recognition trigger operation, the first target account corresponding to the account login gesture recognition trigger operation and the first standard gesture image corresponding to the first target account can be obtained.

[0063] In one feasible implementation, the account login gesture recognition trigger operation can be a click operation to log in to the first target account, or a click operation to click the gesture login button corresponding to the first target account. For example, if the default account login is gesture recognition login, clicking the icon of the first target account on the account login interface is the account login gesture recognition trigger operation; or if the account login interface includes an account input box and a password input box, clicking the password input box after the account input box is completed can be the account login gesture recognition trigger operation.

[0064] Step B20: If the first standard gesture image is recognized from the first current gesture image, generate a TV control command to log in to the first target account.

[0065] For example, after obtaining the first current gesture image and the first standard gesture image corresponding to the first target account, image recognition technology can be used to perform similarity matching between the first current gesture image and the first standard gesture image. If the similarity is detected to be higher than a preset fourth similarity threshold, it is determined that the first standard gesture image has been identified from the first current gesture image, and then a TV control command for logging into the first target account is generated. If the similarity is detected to be lower than the preset fourth similarity threshold, it is determined that the first standard gesture image has not been identified from the first current gesture image, and prompts such as login failure and gesture mismatch can be output, and the process can return to the step of acquiring the first current gesture image through the image acquisition device corresponding to the smart TV.

[0066] Optionally, the standard gesture image includes a second standard gesture image, and the step of generating a TV control command corresponding to the preset standard gesture image when a preset standard gesture image is recognized from the first current gesture image includes:

[0067] Step C10: If it is determined that the gesture recognition trigger operation is an account switching gesture recognition trigger operation, obtain the second target account corresponding to the account switching gesture recognition trigger operation, and the second standard gesture image corresponding to the second target account;

[0068] In this embodiment, it should be noted that when logging into one account and needing to log into another account, account switching is possible. Switching accounts requires user identity authentication of the switched account.

[0069] For example, after acquiring the first current gesture image, the specific gesture recognition trigger operation type can be determined based on the relevant information of the gesture recognition trigger operation. If it is determined that the gesture recognition trigger operation is an account switching gesture recognition trigger operation, the second target account corresponding to the account switching gesture recognition trigger operation and the second standard gesture image corresponding to the second target account can be obtained.

[0070] In one feasible implementation, the account switching gesture recognition trigger operation can be a click operation to log in to the second target account when the first target account is logged in, or a click operation to click the gesture login button corresponding to the second target account when the first target account is logged in. For example, when the first target account is logged in, clicking the icon of the second target account on the account login interface is an account switching gesture recognition trigger operation; or when the first target account is logged in, clicking the password input box after entering the second target account in the account input box is an account login gesture recognition trigger operation.

[0071] Step C20: If the second standard gesture image is recognized from the first current gesture image, a TV control command for logging into the second target account is generated.

[0072] For example, after acquiring the first current gesture image and the second standard gesture image corresponding to the second target account, image recognition technology can be used to perform similarity matching between the first current gesture image and the second standard gesture image. If the similarity is detected to be higher than a preset fifth similarity threshold, it is determined that the second standard gesture image has been identified from the first current gesture image, and a TV control command for logging into the second target account is generated to switch the currently logged-in account to the second target account. If the similarity is detected to be lower than the preset fifth similarity threshold, it is determined that the second standard gesture image has not been identified from the first current gesture image, and prompts such as account switching failure and gesture mismatch can be output, and the process can return to the step of acquiring the first current gesture image through the image acquisition device corresponding to the smart TV.

[0073] In this embodiment, gesture recognition has a low learning cost, which can help users log in and switch accounts more easily, quickly and conveniently. Especially for the elderly, gesture recognition is more intuitive and expressive, and is more conducive to memory and operation.

[0074] Example 3

[0075] Furthermore, referring to Figure 3 Based on the above embodiments of this application, in the second embodiment of this application, the same or similar content as the above embodiments can be referred to the above description, and will not be repeated hereafter. In addition, the standard gesture image includes a third standard gesture image, and the step of generating a TV control command corresponding to the preset standard gesture image when a preset standard gesture image is recognized from the first current gesture image includes:

[0076] Step D10: If the third standard gesture image is recognized from the first current gesture image, determine the target pattern corresponding to the third standard gesture image;

[0077] Step D20: Generate a TV control command to switch the TV mode to the target mode.

[0078] In this embodiment, it should be noted that currently, smart TVs offer different TV modes for different types of users. For example, children's mode may encrypt some TV functions, while elderly mode may display larger fonts and more prominent information. Users can also set custom modes to place frequently used functions and applications in more convenient locations. TVs can be shared by multiple users, and different people will have their own operating habits when controlling the device. TV mode settings can easily match these habits. However, currently, switching between TV modes is quite complex, requiring users to navigate through multiple levels of menus using the remote control, which is inconvenient and results in low actual usage. For example, elderly users may not switch TV modes due to operational difficulties and instead force themselves to operate in normal mode, leading to a poor user experience.

[0079] For example, after acquiring the first current gesture image, image recognition technology can be used to perform similarity matching between the first current gesture image and a plurality of pre-stored standard gesture images. If the similarity between the first current gesture image and the third standard gesture image is higher than a preset second similarity threshold, it is determined that the third standard gesture image has been identified from the first current gesture image. Then, based on the mapping relationship between the preset standard gesture image and the TV control command, the target TV control command corresponding to the third standard gesture image is determined. If the target TV control command is determined to be a TV control command to switch to the target TV mode, a TV control command to switch the TV mode to the target mode is generated. If the similarity between the first current gesture image and the plurality of pre-stored standard gesture images is not higher than the corresponding second similarity threshold, it is determined that the preset standard gesture image has not been identified from the first current gesture image, and the process can return to the step of acquiring the first current gesture image through the image acquisition device corresponding to the smart TV.

[0080] In this embodiment, gesture recognition has a low learning cost, which can help users switch TV modes more easily, quickly and conveniently. Especially for the elderly, gesture recognition is more intuitive and expressive, which is more conducive to memory and operation, thereby increasing the usage rate of TV modes and making smart TVs more suitable for each user's usage habits, thus improving the user experience.

[0081] Example 4

[0082] Furthermore, embodiments of this application also provide a gesture operation device for a smart TV, referring to... Figure 4 The gesture control device of the smart TV includes:

[0083] Image acquisition module 10 is used to acquire the first current gesture image through the image acquisition device corresponding to the smart TV;

[0084] The TV control command generation module 20 is used to generate TV control commands corresponding to the preset standard gesture image when a preset standard gesture image is recognized from the first current gesture image.

[0085] Optionally, the image acquisition module 10 is further configured to:

[0086] In response to a gesture recognition trigger, the image acquisition device of the smart TV is activated.

[0087] The first current gesture image is acquired using the image acquisition device.

[0088] Optionally, the television control command generation module 20 is further configured to:

[0089] If it is determined that the gesture recognition trigger operation is an account login gesture recognition trigger operation, the first target account corresponding to the account login gesture recognition trigger operation and the first standard gesture image corresponding to the first target account are obtained.

[0090] If the first standard gesture image is recognized from the first current gesture image, a TV control command for logging into the first target account is generated.

[0091] Optionally, the television control command generation module 20 is further configured to:

[0092] If it is determined that the gesture recognition trigger operation is an account switching gesture recognition trigger operation, the second target account corresponding to the account switching gesture recognition trigger operation and the second standard gesture image corresponding to the second target account are obtained.

[0093] If the second standard gesture image is recognized from the first current gesture image, a TV control command for logging into the second target account is generated.

[0094] Optionally, the television control command generation module 20 is further configured to:

[0095] If the third standard gesture image is recognized from the first current gesture image, the target pattern corresponding to the third standard gesture image is determined;

[0096] Generate a TV control command to switch the TV mode to the target mode.

[0097] Optionally, the television control command generation module 20 is further configured to:

[0098] Extract the current gesture trajectory and the current gesture execution time from the first current gesture image;

[0099] If the current gesture trajectory matches the standard gesture trajectory of the preset standard gesture image, and the current gesture execution time matches the standard gesture execution time of the preset standard gesture image, then it is determined that the preset standard gesture image is identified from the first current gesture image.

[0100] Generate TV control commands corresponding to the preset standard gesture images.

[0101] Optionally, before the operation of acquiring the first current gesture image through the image acquisition device corresponding to the smart TV, the gesture operation device of the smart TV further includes a standard gesture setting module, which is used for:

[0102] In response to standard gesture settings, a second current gesture image is captured via the image acquisition device corresponding to the smart TV.

[0103] The second current gesture image is determined as a preset standard gesture image.

[0104] The gesture operation device for smart TVs provided by this invention adopts the gesture operation method for smart TVs in the above embodiments, solving the technical problem of low ease of use of existing smart TVs. Compared with the prior art, the beneficial effects of the gesture operation device for smart TVs provided by this invention are the same as the beneficial effects of the gesture operation method for smart TVs provided in the above embodiments, and other technical features in this gesture operation device for smart TVs are the same as the features disclosed in the methods of the above embodiments, and will not be repeated here.

[0105] Example 5

[0106] Furthermore, embodiments of the present invention provide an electronic device, the electronic device comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the gesture operation method of the smart TV in the above embodiments.

[0107] The following is for reference. Figure 5 The diagram illustrates a structural schematic of an electronic device suitable for implementing embodiments of the present disclosure. The electronic devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as Bluetooth headsets, mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. Figure 5 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.

[0108] like Figure 5 As shown, an electronic device may include a processing unit (such as a central processing unit, graphics processing unit, etc.) that can perform various appropriate actions and processes based on a program stored in read-only memory (ROM) or a program loaded from a storage device into random access memory (RAM). The RAM also stores various programs and arrays required for the operation of the electronic device. The processing unit, ROM, and RAM are interconnected via a bus. Input / output (I / O) interfaces are also connected to the bus.

[0109] Typically, the following systems can be connected to the I / O interface: input devices including, for example, touchscreens, touchpads, keyboards, mice, image sensors, microphones, accelerometers, gyroscopes, etc.; output devices including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices including, for example, magnetic tapes, hard disks, etc.; and communication devices. Communication devices allow electronic devices to communicate wirelessly or wiredly with other devices to exchange arrays. Although electronic devices with various systems are shown in the figures, it should be understood that it is not required to implement or possess all the systems shown. More or fewer systems may be implemented alternatively.

[0110] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device, or installed from a storage device, or installed from a ROM. When the computer program is executed by a processing device, it performs the functions defined above in the methods of embodiments of this disclosure.

[0111] The electronic device provided by this invention employs the gesture operation method of the smart TV in the above embodiments, solving the technical problem of low ease of use of existing smart TVs. Compared with the prior art, the beneficial effects of the electronic device provided by the embodiments of this invention are the same as the beneficial effects of the gesture operation method of the smart TV provided in the above embodiments, and other technical features in this electronic device are the same as the features disclosed in the methods of the above embodiments, and will not be repeated here.

[0112] It should be understood that various parts of this disclosure can be implemented using hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics may be combined in any suitable manner in one or more embodiments or examples.

[0113] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in the present invention should be included within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

[0114] Example 6

[0115] Furthermore, this embodiment provides a computer-readable storage medium having computer-readable program instructions stored thereon, the computer-readable program instructions being used to execute the gesture operation method of the smart TV in the above embodiment.

[0116] The computer-readable storage medium provided in this embodiment of the invention may be, for example, a USB flash drive, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, system, or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0117] The aforementioned computer-readable storage medium may be included in an electronic device or may exist independently without being assembled into an electronic device.

[0118] The aforementioned computer-readable storage medium carries one or more programs, which, when executed by an electronic device, cause the electronic device to: acquire a first current gesture image via an image acquisition device corresponding to the smart TV; and, if a preset standard gesture image is identified from the first current gesture image, generate a TV control command corresponding to the preset standard gesture image.

[0119] Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0120] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0121] The modules described in the embodiments of this disclosure can be implemented in software or hardware. The names of the modules do not necessarily limit the functionality of the unit itself.

[0122] The computer-readable storage medium provided by this invention stores computer-readable program instructions for executing the gesture operation method of the aforementioned smart TV, thus solving the technical problem of low ease of use of existing smart TVs. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in the embodiments of this invention are the same as the beneficial effects of the gesture operation method of the smart TV provided in the above embodiments, and will not be repeated here.

[0123] Example 7

[0124] Furthermore, this application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the gesture operation method for a smart TV as described above.

[0125] The computer program product provided in this application solves the technical problem of low ease of use of existing smart TVs. Compared with the prior art, the beneficial effects of the computer program product provided in the embodiments of this invention are the same as the beneficial effects of the gesture operation method for smart TVs provided in the above embodiments, and will not be repeated here.

[0126] The above are merely preferred embodiments of this application and do not limit the patent scope of this application. Any equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent scope of this application.

Claims

1. A gesture operation method for a smart TV, characterized in that, The gesture operation method of the smart TV includes the following steps: The first current gesture image is captured by the image acquisition device corresponding to the smart TV; If a preset standard gesture image is recognized from the first current gesture image, a TV control command corresponding to the preset standard gesture image is generated; The step of generating a TV control command corresponding to the preset standard gesture image when a preset standard gesture image is recognized from the first current gesture image includes: Extract the current gesture trajectory and the current gesture execution time from the first current gesture image; If the current gesture trajectory matches the standard gesture trajectory of the preset standard gesture image, and the current gesture execution time matches the standard gesture execution time of the preset standard gesture image, then it is determined that the preset standard gesture image is identified from the first current gesture image. Generate TV control commands corresponding to the preset standard gesture images.

2. The gesture operation method for a smart TV as described in claim 1, characterized in that, The step of acquiring the first current gesture image through the image acquisition device corresponding to the smart TV includes: In response to a gesture recognition trigger, the image acquisition device of the smart TV is activated. The first current gesture image is acquired using the image acquisition device.

3. The gesture operation method for a smart TV as described in claim 2, characterized in that, The standard gesture image includes a first standard gesture image. The step of generating a TV control command corresponding to the preset standard gesture image when a preset standard gesture image is identified from the first current gesture image includes: If it is determined that the gesture recognition trigger operation is an account login gesture recognition trigger operation, the first target account corresponding to the account login gesture recognition trigger operation and the first standard gesture image corresponding to the first target account are obtained. If the first standard gesture image is recognized from the first current gesture image, a TV control command for logging into the first target account is generated.

4. The gesture operation method for a smart TV as described in claim 2, characterized in that, The standard gesture image includes a second standard gesture image. The step of generating a TV control command corresponding to the preset standard gesture image when a preset standard gesture image is recognized from the first current gesture image includes: If it is determined that the gesture recognition trigger operation is an account switching gesture recognition trigger operation, the second target account corresponding to the account switching gesture recognition trigger operation and the second standard gesture image corresponding to the second target account are obtained. If the second standard gesture image is recognized from the first current gesture image, a TV control command for logging into the second target account is generated.

5. The gesture operation method for a smart TV as described in claim 1, characterized in that, The standard gesture image includes a third standard gesture image. The step of generating a TV control command corresponding to the preset standard gesture image when a preset standard gesture image is identified from the first current gesture image includes: If the third standard gesture image is recognized from the first current gesture image, the target pattern corresponding to the third standard gesture image is determined; Generate a TV control command to switch the TV mode to the target mode.

6. The gesture operation method for a smart TV as described in any one of claims 1-5, characterized in that, Before the step of acquiring the first current gesture image through the image acquisition device corresponding to the smart TV, the method further includes: In response to standard gesture settings, a second current gesture image is captured via the image acquisition device corresponding to the smart TV. The second current gesture image is determined as a preset standard gesture image.

7. A gesture operation device for a smart TV, characterized in that, The gesture control device of the smart TV includes: The image acquisition module is used to acquire the first current gesture image through the image acquisition device corresponding to the smart TV; The TV control command generation module is used to generate TV control commands corresponding to the preset standard gesture image when a preset standard gesture image is recognized from the first current gesture image. The television control command generation module is also used for: Extract the current gesture trajectory and the current gesture execution time from the first current gesture image; If the current gesture trajectory matches the standard gesture trajectory of the preset standard gesture image, and the current gesture execution time matches the standard gesture execution time of the preset standard gesture image, then it is determined that the preset standard gesture image is identified from the first current gesture image. Generate TV control commands corresponding to the preset standard gesture images.

8. An electronic device, characterized in that, The electronic device includes: At least one processor; and, A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the steps of the gesture operation method of the smart TV according to any one of claims 1 to 6.

9. A storage medium, characterized in that, The storage medium is a computer-readable storage medium, and the computer-readable storage medium stores a program that implements the gesture operation method of a smart TV. The program that implements the gesture operation method of a smart TV is executed by a processor to implement the steps of the gesture operation method of a smart TV as described in any one of claims 1 to 6.

Images