Terminal control method and device, storage medium and electronic equipment

Abstract

The invention provides a terminal control method and device, a storage medium and electronic device.The terminal control method comprises the steps that in response to the received target data sent by a wearable device, the target data is sent to the wearable device within the time corresponding to the received target data; and identifying actions in a video picture within a first preset duration acquired by a camera of the terminal, and executing an operation corresponding to the target action information in response to actions corresponding to the target action information contained in the target data identified in the video picture. According to the terminal control method provided by the embodiment of the invention, the terminal can be controlled based on the detection and identification of the wearable device and the terminal camera on the specific action of the user, so that the accuracy of the control operation is improved.

Description

Technical Field

[0001] The technical solution disclosed herein relates to the technical field of electronic equipment, and in particular to a terminal control method and device, a storage medium, and an electronic device. Background Art

[0002] Most of the existing touch screen terminals are capacitive screens. In many scenarios, such as low temperature scenarios, strong magnetic field scenarios, underwater scenarios, etc., the electric field distribution of the terminal capacitive screen will change, resulting in reduced sensitivity of the terminal's touch screen function, inaccurate touch screen response or failure. In this case, it is impossible to accurately control the terminal based on touch screen operations. Summary of the invention

[0003] In view of this, embodiments of the present disclosure provide a terminal control method and device, a storage medium, and an electronic device.

[0004] According to a first aspect of the present disclosure, a terminal control method is proposed, the method comprising:

[0005] In response to receiving the target data sent by the wearable device, identifying an action in a video image within a first preset time length acquired by a camera of the terminal within a time corresponding to the reception of the target data;

[0006] In response to recognizing in the video screen an action corresponding to the target action information included in the target data, an operation corresponding to the target action information is performed.

[0007] In combination with any embodiment provided in the present disclosure, the target data includes at least one of the following:

[0008] Acceleration data collected by an acceleration sensor installed in the wearable device;

[0009] The wearable device identifies the collected acceleration data to obtain motion recognition data.

[0010] In combination with any implementation manner provided in the present disclosure, the identifying of an action in a video image within a first preset time length acquired by a camera of a terminal within a time corresponding to receiving the target data includes:

[0011] The action in the video picture within a first preset time length obtained by the camera of the terminal before receiving the target data is identified.

[0012] In combination with any implementation manner provided in the present disclosure, the termination time of the video picture is the time when the target data is received.

[0013] In combination with any embodiment provided by the present disclosure, in response to receiving target data sent by the wearable device, identifying an action in a video screen within a first preset time length acquired by a camera of the terminal within a time corresponding to receiving the target data, includes:

[0014] Establishing communication interconnection with the wearable device;

[0015] In response to receiving the target data sent by the wearable device through the established communication interconnection, an action in a video picture within a first preset time length acquired by a camera of the terminal during a time corresponding to the reception of the target data is identified.

[0016] In combination with any embodiment provided by the present disclosure, in response to receiving the target data sent by the wearable device, before identifying the action in the video picture within the first preset time length acquired by the camera of the terminal within the time corresponding to the receiving of the target data, the method also includes:

[0017] Turn on the target mode; wherein, in the target mode, the terminal acquires and saves the video image in real time through the camera of the terminal.

[0018] In combination with any implementation manner provided in the present disclosure, the terminal is provided with an exclusive storage space, and the exclusive storage space is used to store video images of a second preset duration, and the second preset duration is greater than or equal to the first preset duration;

[0019] The method further comprises:

[0020] The acquired video images of the second preset duration are stored in the dedicated storage space.

[0021] In combination with any embodiment provided in the present disclosure, the method further includes:

[0022] In response to the duration of exiting the target mode reaching a third preset duration, the video frames stored in the dedicated storage space are deleted.

[0023] In combination with any embodiment provided in the present disclosure, the method is applied to an underwater scene, and the operation corresponding to the target action information is starting to shoot;

[0024] In response to identifying an action corresponding to the target action information included in the target data in the video picture, executing an operation corresponding to the target action information includes:

[0025] In response to recognizing an action corresponding to the target action information in the video picture, shooting is started.

[0026] In combination with any implementation manner provided in the present disclosure, different action information corresponds to different operations;

[0027] The method further comprises:

[0028] In response to receiving an adjustment instruction for the first action information, an operation corresponding to the first action information is adjusted based on information in the adjustment instruction.

[0029] According to a second aspect of the present disclosure, a terminal control method is proposed, the method comprising:

[0030] determining activity data of a target part of a user wearing the wearable device;

[0031] When it is determined that the activity data is target data, the target data is sent to the terminal, so that when the terminal determines that the action in the video picture within the first preset time length acquired by the camera includes an action corresponding to the target action information contained in the target data, the terminal performs an operation corresponding to the target action information.

[0032] In combination with any embodiment provided in the present disclosure, determining the activity data of the target part of the user wearing the wearable device includes:

[0033] Collecting acceleration data of the target part through an acceleration sensor installed in the wearable device;

[0034] The acceleration data is determined as the activity data.

[0035] In combination with any implementation manner provided in the present disclosure, determining the acceleration data as the activity data includes:

[0036] Recognizing the collected acceleration data to obtain action recognition data;

[0037] The action recognition data is determined as the activity data.

[0038] According to a third aspect of the present disclosure, a terminal control device is provided, the device comprising:

[0039] an identification module, configured to, in response to receiving target data sent by the wearable device, identify an action in a video image within a first preset time length acquired by a camera of the terminal within a time corresponding to receiving the target data;

[0040] The execution module is used to execute an operation corresponding to the target action information in response to identifying an action corresponding to the target action information contained in the target data in the video picture.

[0041] According to a fourth aspect of the present disclosure, a terminal control device is provided, the device comprising:

[0042] A determination module, used to determine activity data of a target part of a user wearing a wearable device;

[0043] A sending module is used to send the target data to the terminal when it is determined that the activity data is target data, so that when the terminal determines that the video picture within the first preset time length acquired through the camera includes an action corresponding to the target action information contained in the target data, the terminal performs an operation corresponding to the target action information.

[0044] According to a fifth aspect of the present disclosure, a computer-readable storage medium is provided, wherein the machine-readable storage medium stores machine-readable instructions, and when the machine-readable instructions are called and executed by a processor, the processor is prompted to implement the terminal control method of any embodiment of the present disclosure.

[0045] According to a sixth aspect of the present disclosure, there is provided an electronic device, comprising:

[0046] processor;

[0047] a memory for storing processor-executable instructions;

[0048] The processor is configured to execute the terminal control method of any embodiment of the present disclosure.

[0049] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:

[0050] The terminal control method and device, storage medium and electronic device provided in the embodiments of the present disclosure, in response to receiving target data sent by a wearable device, identify the action in the video picture within the first preset time length obtained by the camera of the terminal during the time corresponding to the reception of the target data. And when it is determined that the action corresponding to the target action information contained in the target data is identified in the video picture, the operation corresponding to the target action information is performed. In the terminal control method provided in the embodiments of the present disclosure, the terminal can control the terminal based on the detection and recognition of the user's specific actions by the wearable device and the terminal camera, thereby improving the accuracy of the control operation.

[0051] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0053] Figure 1 is a flow chart of a terminal control method according to an exemplary embodiment of the present disclosure;

[0054] Figure 2 is a flow chart of another terminal control method according to an exemplary embodiment of the present disclosure;

[0055] Figure 3 is a flow chart of another terminal control method according to an exemplary embodiment of the present disclosure;

[0056] Figure 4 is a schematic structural diagram of a terminal control device according to an exemplary embodiment of the present disclosure;

[0057] Figure 5 is a schematic structural diagram of another terminal control device according to an exemplary embodiment of the present disclosure;

[0058] Figure 6 It is a schematic structural diagram of an electronic device according to an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION

[0059] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0060] The terms used in this disclosure are for the purpose of describing specific embodiments only and are not intended to limit the disclosure. The singular forms of "a", "said" and "the" used in this disclosure and the appended claims are also intended to include plural forms unless the context clearly indicates otherwise. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.

[0061] It should be understood that although the terms first, second, third, etc. may be used in the present disclosure to describe various information, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present disclosure, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".

[0062] With the continuous development and progress of technology, touch screens are being used more and more widely. For example, they are used in various terminals such as smartphones, tablets, and self-service machines, bringing great convenience to people's lives. However, in many scenarios, such as low temperature scenarios, strong magnetic field scenarios, and underwater scenarios, the sensitivity of the touch screen function will decrease, resulting in the inability to control the terminal based on touch screen operations.

[0063] Specifically, since most of the screens of existing touch screen terminals are capacitive screens, and the capacitive screen detects touch based on the charge of the human body. In low temperature scenarios, the charge of the human body will weaken or disappear temporarily, resulting in the inability of the capacitive screen to effectively detect touch. Therefore, in low temperature scenarios, the sensitivity of the touch screen function will be reduced, resulting in the inability to control the terminal based on touch screen operations. In strong magnetic field scenarios, since strong magnetic fields will generate strong electromagnetic fields, they may interfere with the electric field distribution of the capacitive screen. Therefore, in strong magnetic field scenarios, the sensitivity of the touch screen function will be reduced. In underwater scenarios, since water is a medium with good conductivity, when water covers the capacitive screen of the terminal, it may also interfere with the electric field distribution of the capacitive screen, resulting in false touches, failures, or failures to sense normally. Therefore, in underwater scenarios, it is also impossible to control the terminal based on touch screen operations.

[0064] In view of this, the present disclosure provides a terminal control method. In this method, the terminal can be controlled based on various actions of the user. At the same time, in order to improve the accuracy of the control of the terminal, this example method uses a wearable device and a terminal to detect and identify various actions of the user. As mentioned above, this method can be applied to various scenarios where the sensitivity of the touch screen function of the terminal is reduced in low temperature, strong magnetic field, underwater, etc., resulting in the inability to control the terminal based on touch screen operation.

[0065] The terminal control method of the embodiment of the present disclosure is described in detail below with reference to the accompanying drawings.

[0066] Figure 1 FIG. 1 is a flow chart of a terminal control method according to an exemplary embodiment of the present disclosure, and the method can be executed by the terminal. Figure 1 As shown, the exemplary embodiment method may include the following steps:

[0067] In step 101, in response to receiving target data sent by a wearable device, an action in a video image within a first preset time length acquired by a camera of a terminal within a time corresponding to the reception of the target data is identified.

[0068] Among them, the wearable device can be a smart watch, a smart bracelet, smart glasses, etc. The target data can be data that meets preset conditions. For example, it can be data containing target action information, and the target action information can be pre-set action information, such as: swinging arms up and down, swinging arms left and right, nodding, shaking head, etc., and each action information has an operation corresponding to it. For example, swinging the arms up and down corresponds to turning on the terminal screen, swinging the arms left and right corresponds to turning off the terminal screen, nodding corresponds to starting to play music, and shaking head corresponds to stopping playing music. The first preset duration can be determined according to the duration required to execute the action of controlling the terminal, for example, it can be set to 2 seconds, or it can be set to 1.5 seconds, and the present disclosure does not limit this.

[0069] In a specific implementation, the wearable device can collect activity data of a specified part of the user wearing the wearable device, and determine whether the activity data is target data containing target action information. For example, when the wearable device is a smart bracelet, the smart bracelet can determine the activity data of the hand of the user wearing the bracelet, and then determine whether it is target data containing target action information based on the activity data. Exemplarily, the target action information can be swinging the arm up and down. For another example, when the wearable device is smart glasses, the smart glasses can determine the activity data of the head of the user wearing the glasses, and then determine whether it is target data containing target action information based on the activity data. Exemplarily, the target action information can be nodding.

[0070] When the wearable device determines that the collected activity data is target data containing target action information, the target data can be sent to the terminal, and then the terminal can recognize the action in the video picture within a first preset time length obtained by the camera of the terminal during the time corresponding to the reception of the target data. For example, the terminal can recognize the action in the video picture within two seconds before and after the reception of the target action information.

[0071] In an optional example, the terminal may identify the action in the video screen within a first preset time length obtained by the terminal's camera before receiving the target data. For example, the terminal may identify the action in the video screen within 2 seconds before receiving the target action information. Alternatively, the terminal may identify the action in the video screen within 1.5 seconds before receiving the target action information.

[0072] Since the wearable device will send the target data to the terminal after determining that the collected activity data is the target data, in other words, the time when the user performs the target action should be within a short time before the terminal receives the target data. Therefore, in this example, the terminal can only recognize the actions in the video screen within the first preset time length obtained by the camera of the terminal before receiving the target data. On the one hand, it can reduce the occupation of computing resources, reduce the time required for action recognition, and perform subsequent processing faster. On the other hand, it can avoid misjudgment and improve the accuracy of terminal control.

[0073] In an optional example, the termination time of the video picture may be the time when the target data is received.

[0074] For example, when the target data is received at 10:15:30 and the first preset time is 2 seconds, the terminal can identify the video images between 10:15:28 and 10:15:30, thereby avoiding misjudgment and improving the accuracy of terminal control.

[0075] In step 102, in response to identifying an action corresponding to the target action information included in the target data in the video picture, an operation corresponding to the target action information is performed.

[0076] In an optional example, the target data may include at least one of the following:

[0077] Acceleration data collected by an acceleration sensor installed in the wearable device;

[0078] The wearable device identifies the collected acceleration data to obtain motion recognition data.

[0079] When the target data is acceleration data, the terminal can identify the received acceleration data to obtain the target action information contained in the target data. When the target data is action recognition data, the terminal can directly extract the target action information from the action recognition data.

[0080] When the target action information included in the target data sent by the wearable device is swinging the arm up and down, the terminal can determine whether there is an arm swinging action in the video picture. If it is determined that the arm swinging action is recognized in the video picture, an operation corresponding to the arm swinging up and down is performed. According to the above embodiment, the operation corresponding to the arm swinging up and down can be turning on the terminal screen.

[0081] When the target action information included in the target data sent by the wearable device is a nod, the terminal can determine whether there is a nod action in the video picture. If it is determined that a nod action is recognized in the video picture, an operation corresponding to the nod is performed. From the above embodiment, it can be obtained that the operation corresponding to the nod can be to start playing music.

[0082] In the terminal control method provided by the embodiment of the present disclosure, the terminal can control the terminal based on the detection and recognition of specific actions of the user by the wearable device and the terminal camera, thereby improving the accuracy of terminal control.

[0083] Figure 2 1 is a flowchart of another terminal control method according to an exemplary embodiment of the present disclosure, and the method is applied to a terminal. In the description of this embodiment, the same steps as those in any of the above embodiments will be briefly described without further elaboration. For details, please refer to any of the above embodiments. In this embodiment, the method will be applied to an underwater scene as an example for further introduction. Figure 2 As shown, the exemplary embodiment method may include the following steps:

[0084] In step 201, the target mode is turned on.

[0085] Wherein, in the target mode, the terminal acquires and saves video images in real time through the front camera of the terminal.

[0086] In this example, the target mode may be an underwater mode. Optionally, the terminal may turn on the underwater mode after receiving an instruction to turn on the underwater mode from a user. Alternatively, the terminal may automatically turn on the underwater mode when detecting that the terminal is currently underwater.

[0087] Exemplarily, the terminal may set a dedicated storage space for storing a second preset time length of video images acquired in real time by the front camera of the terminal after the underwater mode is turned on. For example, a 10-second video image acquired in real time by the camera of the terminal may be stored in the dedicated storage space.

[0088] In step 202, a communication connection is established with a wearable device.

[0089] The communication interconnection may be a wired communication interconnection, or may be a wireless communication interconnection, for example, a communication interconnection is established through Bluetooth or wifi (Wireless Fidelity), which is not limited in the present disclosure.

[0090] It should be noted that the present disclosure does not limit the execution order of the above steps 201 and 202. In practical applications, the terminal may first execute step 201 and then execute step 202. Alternatively, the terminal may first execute step 202 and then execute step 201. Alternatively, the terminal may simultaneously execute steps 201 and 202, which is not limited by the present disclosure.

[0091] In step 203, in response to receiving the target data sent by the wearable device through the established communication interconnection, the action in the video picture within a first preset time length obtained by the camera of the terminal during the time corresponding to the reception of the target data is identified.

[0092] In this example, the operation corresponding to the action information "draw a circle clockwise" can be preset as starting to shoot.

[0093] When the terminal is in an underwater scene and receives target data containing target action information sent by the wearable device through the above-mentioned wired communication interconnection or wireless communication interconnection established, such as drawing a clockwise circle, the terminal identifies the action in the video picture within the first preset time length obtained by the terminal's camera during the time corresponding to the target data containing the target action information of drawing a clockwise circle.

[0094] In step 204, in response to identifying an action corresponding to the target action information included in the target data in the video picture, filming is started.

[0095] If it is determined that a clockwise circle drawing action is recognized in the video picture, an operation corresponding to the clockwise circle drawing is performed. From the above, it can be obtained that the operation corresponding to the clockwise circle drawing can be starting to shoot.

[0096] It should be noted that the above description uses the operation corresponding to the target action as starting shooting as an example. In actual applications, the operation corresponding to the above target action information can also be stopping shooting, which can be specifically set by relevant staff based on actual conditions, and the present disclosure does not limit this.

[0097] In an optional example, different action information corresponds to different operations, such as the above, swinging the arm up and down corresponds to turning on the terminal screen, and swinging the arm left and right corresponds to turning off the terminal screen.

[0098] In this example, the above correspondence can be modified by the user. Specifically, when the terminal receives an adjustment instruction for the first action information, it can adjust the operation corresponding to the first action information based on the information in the adjustment instruction. For example, the operation corresponding to the above-mentioned up and down swinging of the arm can be changed from turning on the terminal screen to turning on the flashlight.

[0099] Optionally, the user may also perform an addition operation or a deletion operation on the above-mentioned corresponding relationship, which is not limited in the present disclosure.

[0100] In an optional example, the terminal may delete the video images stored in the dedicated storage space when it is determined that the duration of exiting the target mode reaches a third preset duration. For example, the terminal may delete the video images stored in the dedicated storage space when it is determined that the duration of exiting the underwater mode reaches 10 minutes, thereby reducing the occupancy of the terminal memory.

[0101] In the terminal control method provided in the embodiment of the present disclosure, when the terminal is in an underwater scene, the terminal can be controlled to start shooting based on the detection and recognition of the user's specific actions by the wearable device and the terminal camera, thereby solving the problem that underwater shooting operations are difficult in existing implementations.

[0102] Figure 3 FIG. 1 is a flow chart of a terminal control method according to an exemplary embodiment of the present disclosure, and the method can be executed by a wearable device. Figure 1 As shown, the exemplary embodiment method may include the following steps:

[0103] In step 301, activity data of a target part of a user wearing the wearable device is determined.

[0104] The wearable device may be a smart watch, a smart bracelet, smart glasses, etc.

[0105] When the wearable device is a smart watch or a smart bracelet, the activity data of the arm of the user wearing the smart watch or the smart bracelet can be determined.

[0106] In an optional example, a smart watch or smart bracelet may collect acceleration data of the user's arm through an acceleration sensor installed therein, and then determine the acceleration data as the activity data.

[0107] In another optional example, a smart watch or a smart bracelet may identify the collected acceleration data to obtain motion recognition data, and then determine the motion recognition data as the activity data.

[0108] When the wearable device is a smart glasses, activity data of the head of a user wearing the smart glasses may be determined.

[0109] Similar to the above, the smart glasses can obtain the acceleration data of the user's head through the acceleration sensor installed on the smart glasses, and then determine the acceleration data as the activity data. Alternatively, the smart glasses can identify the collected acceleration data to obtain motion recognition data, and then determine the motion recognition data as the activity data.

[0110] In step 302, when it is determined that the activity data is target data, the target data is sent to the terminal so that when the terminal determines that the video picture within the first preset time length acquired through the camera includes an action corresponding to the target action information contained in the target data, the terminal performs an operation corresponding to the target action information.

[0111] The target data may be data that meets a preset condition, for example, data containing target action information.

[0112] In this example, the wearable device can pre-acquire the action information set by the user as the target action information. For example, it may include: swinging arms up and down, swinging arms left and right, drawing circles clockwise, nodding, shaking head, etc. When the wearable device determines that the current activity data contains one of the above-mentioned target action information, the activity data is determined as the target data and sent to the terminal, so that the terminal further determines whether the user has performed the action corresponding to the target action information within the aforementioned first preset time length based on the video picture acquired within the first preset time length. And after determining to execute, perform the operation corresponding to the target action information.

[0113] In the terminal control method provided in the embodiment of the present disclosure, a wearable device and a terminal camera may be used in combination to detect and identify specific actions of the user, thereby improving the accuracy of terminal control.

[0114] For the aforementioned method embodiments, for the sake of simplicity of description, they are all expressed as a series of action combinations, but those skilled in the art should know that the present disclosure is not limited by the described order of actions, because according to the present disclosure, certain steps can be performed in other orders or simultaneously.

[0115] Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily required by the present disclosure.

[0116] Corresponding to the aforementioned application function implementation method embodiment, the present disclosure also provides an application function implementation device and a corresponding terminal embodiment.

[0117] Figure 4 is a schematic diagram of a terminal control device according to an exemplary embodiment of the present disclosure. Figure 4 As shown, the terminal control device may include:

[0118] The recognition module 41 is used to recognize the action in the video picture within a first preset time length obtained by the camera of the terminal within the time corresponding to the received target data in response to receiving the target data sent by the wearable device.

[0119] The execution module 42 is used to execute an operation corresponding to the target action information in response to identifying an action corresponding to the target action information included in the target data in the video picture.

[0120] Optionally, the target data includes at least one of the following:

[0121] Acceleration data collected by an acceleration sensor installed in the wearable device.

[0122] The wearable device identifies the collected acceleration data to obtain motion recognition data.

[0123] Optionally, the recognition module 41, when used to recognize an action in a video image within a first preset time length acquired by a camera of a terminal within a time corresponding to receiving the target data, includes:

[0124] The action in the video picture within a first preset time length obtained by the camera of the terminal before receiving the target data is identified.

[0125] Optionally, the termination time of the video picture is the time when the target data is received.

[0126] Optionally, the recognition module 41, in response to receiving target data sent by the wearable device, recognizes an action in a video image within a first preset time length acquired by a camera of the terminal within a time corresponding to receiving the target data, including:

[0127] Establishing communication with the wearable device.

[0128] In response to receiving the target data sent by the wearable device through the established communication interconnection, an action in a video picture within a first preset time length acquired by a camera of the terminal during a time corresponding to the reception of the target data is identified.

[0129] Optional, in Figure 4 Based on the modules shown, the terminal control device may further include:

[0130] The opening module is used to open the target mode; wherein, in the target mode, the terminal acquires and saves the video image in real time through the camera of the terminal.

[0131] Optionally, the terminal is provided with an exclusive storage space, and the exclusive storage space is used to store video images of a second preset duration, and the second preset duration is greater than or equal to the first preset duration.

[0132] exist Figure 4 Based on the modules shown, the terminal control device may further include:

[0133] The saving module is used to save the acquired video images of the second preset time length in the dedicated storage space.

[0134] Optional, in Figure 4 Based on the modules shown, the terminal control device may further include:

[0135] The deleting module is used to delete the video images stored in the exclusive storage space in response to the duration of exiting the target mode reaching a third preset duration.

[0136] Optionally, the method is applied to an underwater scene, and the operation corresponding to the target action information is starting shooting.

[0137] The execution module 42, when used to execute an operation corresponding to the target action information in response to identifying an action corresponding to the target action information included in the target data in the video picture, includes:

[0138] In response to recognizing an action corresponding to the target action information in the video picture, shooting is started.

[0139] Optionally, different action information corresponds to different operations.

[0140] exist Figure 4 Based on the modules shown, the terminal control device may further include:

[0141] The adjustment module is used to adjust the operation corresponding to the first action information based on the information in the adjustment instruction in response to receiving the adjustment instruction for the first action information.

[0142] Figure 5 is a schematic diagram of a terminal control device according to an exemplary embodiment of the present disclosure. Figure 4 As shown, the terminal control device may include:

[0143] The determination module 51 is used to determine the activity data of the target part of the user wearing the wearable device.

[0144] The sending module 52 is used to send the target data to the terminal when it is determined that the activity data is target data, so that when the terminal determines that the video picture within the first preset time length acquired through the camera includes an action corresponding to the target action information contained in the target data, the terminal performs an operation corresponding to the target action information.

[0145] Optionally, the determination module 51, when used to determine the activity data of the target part of the user wearing the wearable device, includes:

[0146] The acceleration data of the target part is collected by an acceleration sensor installed in the wearable device.

[0147] The acceleration data is determined as the activity data.

[0148] Optionally, the determining module 51, when used to determine the acceleration data as the activity data, includes:

[0149] The collected acceleration data is identified to obtain action recognition data.

[0150] The action recognition data is determined as the activity data.

[0151] For the device embodiments, since they basically correspond to the method embodiments, the relevant parts can refer to the partial description of the method embodiments. The device embodiments described above are only schematic, wherein the units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the disclosed solution. A person of ordinary skill in the art may understand and implement it without creative work.

[0152] Accordingly, an embodiment of the present disclosure provides an electronic device, comprising: a processor; and a memory for storing instructions executable by the processor; wherein the processor is configured to execute the terminal control method of any embodiment of the present disclosure.

[0153] Figure 6 FIG. 6 is a schematic diagram showing a structure of an electronic device 600 according to an exemplary embodiment. For example, the electronic device 600 may be a terminal, a wearable device, or the like.

[0154] Reference Figure 6, the electronic device 600 may include one or more of the following components: a processing component 602 , a memory 604 , a power component 606 , a multimedia component 608 , an audio component 610 , an input / output (I / O) interface 612 , a sensor component 614 , and a communication component 616 .

[0155] The processing component 602 generally controls the overall operation of the electronic device 600, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 602 may include one or more processors 620 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 602 may include one or more modules to facilitate the interaction between the processing component 602 and other components. For example, the processing component 602 may include a multimedia module to facilitate the interaction between the multimedia component 608 and the processing component 602.

[0156] The memory 604 is configured to store various types of data to support operations on the device 600. Examples of such data include instructions for any application or method operating on the electronic device 600, contact data, phone book data, messages, pictures, videos, etc. The memory 604 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0157] The power supply component 606 provides power to the various components of the electronic device 600. The power supply component 606 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 600.

[0158] The multimedia component 608 includes a screen that provides an output interface between the electronic device 600 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 608 includes a front camera and / or a rear camera. When the electronic device 600 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0159] The audio component 610 is configured to output and / or input audio signals. For example, the audio component 610 includes a microphone (MIC), and when the electronic device 600 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 604 or sent via the communication component 616. In some embodiments, the audio component 610 also includes a speaker for outputting audio signals.

[0160] I / O interface 612 provides an interface between processing component 602 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0161] The sensor assembly 614 includes one or more sensors for providing various aspects of status assessment for the electronic device 600. For example, the sensor assembly 614 can detect the open / closed state of the electronic device 600, the relative positioning of the components, such as the display and keypad of the electronic device 600, and the sensor assembly 614 can also detect the position change of the electronic device 600 or a component of the electronic device 600, the presence or absence of contact between the user and the electronic device 600, the orientation or acceleration / deceleration of the electronic device 600, and the temperature change of the electronic device 600. The sensor assembly 614 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 614 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 614 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0162] The communication component 616 is configured to facilitate wired or wireless communication between the electronic device 600 and other devices. The electronic device 600 can access a wireless network based on a communication standard, such as WiFi, 4G or 5G, 4G LTE, 5G NR or a combination thereof. In an exemplary embodiment, the communication component 616 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 616 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0163] In an exemplary embodiment, the electronic device 600 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0164] In an exemplary embodiment, a non-temporary computer-readable storage medium is also provided, such as a memory 604 including instructions. When the instructions in the storage medium are executed by a processor 620 of an electronic device 600, the electronic device 600 is enabled to execute the terminal control method of any embodiment of the present disclosure.

[0165] The non-transitory computer-readable storage medium may be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

[0166] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0167] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A terminal control method, characterized in that: The method comprises: In response to receiving the target data sent by the wearable device, identifying an action in a video image within a first preset time length acquired by a camera of the terminal within a time corresponding to the reception of the target data; In response to recognizing in the video screen an action corresponding to the target action information included in the target data, an operation corresponding to the target action information is performed.

2. The method according to claim 1, characterized in that The target data includes at least one of the following: Acceleration data collected by an acceleration sensor installed in the wearable device; The wearable device identifies the collected acceleration data to obtain motion recognition data.

3. The method according to claim 1, characterized in that The identifying of the action in the video picture within a first preset time length acquired by the camera of the terminal within the time corresponding to the receiving of the target data includes: The action in the video picture within a first preset time length obtained by the camera of the terminal before receiving the target data is identified.

4. The method according to claim 1, characterized in that: The end time of the video picture is the time when the target data is received.

5. The method according to claim 1, characterized in that The step of identifying, in response to receiving the target data sent by the wearable device, an action in a video image within a first preset time length acquired by a camera of the terminal during a time corresponding to receiving the target data, includes: Establishing communication interconnection with the wearable device; In response to receiving the target data sent by the wearable device through the established communication interconnection, an action in a video picture within a first preset time length acquired by a camera of the terminal during a time corresponding to the reception of the target data is identified.

6. The method according to claim 1, characterized in that In response to receiving the target data sent by the wearable device, before identifying the action in the video picture within a first preset time length acquired by the camera of the terminal within the time corresponding to the receiving of the target data, the method also includes: Turn on the target mode; wherein, in the target mode, the terminal acquires and saves the video image in real time through the camera of the terminal.

7. The method according to claim 6, characterized in that The terminal is provided with an exclusive storage space, and the exclusive storage space is used to store video images of a second preset duration, and the second preset duration is greater than or equal to the first preset duration; The method further comprises: The acquired video images of the second preset duration are stored in the dedicated storage space.

8. The method according to claim 7, characterized in that The method further comprises: In response to the duration of exiting the target mode reaching a third preset duration, the video frames stored in the dedicated storage space are deleted.

9. The method according to claim 1, characterized in that: The method is applied to underwater scenes, and the operation corresponding to the target action information is starting to shoot; In response to identifying an action corresponding to the target action information included in the target data in the video picture, executing an operation corresponding to the target action information includes: In response to recognizing an action corresponding to the target action information in the video picture, shooting is started.

10. The method according to claim 1, characterized in that Different action information corresponds to different operations; The method further comprises: In response to receiving an adjustment instruction for the first action information, an operation corresponding to the first action information is adjusted based on information in the adjustment instruction.

11. A terminal control method, characterized in that: The method comprises: determining activity data of a target part of a user wearing the wearable device; When it is determined that the activity data is target data, the target data is sent to the terminal, so that when the terminal determines that the video picture within the first preset time length acquired through the camera includes an action corresponding to the target action information contained in the target data, the terminal performs an operation corresponding to the target action information.

12. The method according to claim 11, characterized in that The determining of the activity data of the target part of the user wearing the wearable device includes: Collecting acceleration data of the target part through an acceleration sensor installed in the wearable device; The acceleration data is determined as the activity data.

13. The method according to claim 12, characterized in that The step of determining the acceleration data as the activity data comprises: Recognizing the collected acceleration data to obtain action recognition data; The action recognition data is determined as the activity data.

14. A terminal control device, characterized in that: The device comprises: an identification module, configured to, in response to receiving target data sent by the wearable device, identify an action in a video image within a first preset time length acquired by a camera of the terminal within a time corresponding to receiving the target data; The execution module is used for executing an operation corresponding to the target action information in response to identifying an action corresponding to the target action information contained in the target data in the video picture.

15. A terminal control device, characterized in that: The device comprises: A determination module, used to determine activity data of a target part of a user wearing a wearable device; A sending module is used to send the target data to the terminal when it is determined that the activity data is target data, so that when the terminal determines that the video picture within the first preset time length acquired through the camera includes an action corresponding to the target action information contained in the target data, the terminal performs an operation corresponding to the target action information.

16. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the method described in any one of claims 1 to 10 or the steps of the method described in any one of claims 11 to 13 are implemented.

17. An electronic device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to execute the steps of any one of the methods of claims 1-10, or the steps of any one of the methods of claims 11-13.

Images