Action detection method and device, electronic equipment and storage medium

Abstract

This application relates to a motion detection method, apparatus, electronic device, and storage medium, belonging to the field of terminal technology. The method includes: determining a first action and a second action through a first system, wherein the first action is a user's action, and the second action is an action included in a video segment currently being played by a second electronic device, the second electronic device being an electronic device that has established a communication connection with the first electronic device; switching from the first system to the second system when the similarity between the first action and the second action is less than a first preset threshold; and playing the video segment corresponding to the second action through the second system; wherein the power consumption of the first system is less than the power consumption of the second system. This solution eliminates the need to run the second system during periods when motion correction reminders to the user are not required, thereby enriching the content of the detected motion data while saving power consumption of the first electronic device.

Description

Technical Field

[0001] This application relates to the field of terminal technology, and in particular to a motion detection method, device, electronic device, and storage medium. Background Technology

[0002] With the development of terminal technology, the functions of terminals are becoming increasingly diverse. For example, terminals can play videos to assist users in their movements.

[0003] In related technologies, users can move along with the video content while it is playing on a terminal. To detect the user's movement, wearable devices connected to the terminal are often used to collect the user's movement data. For example, wearable devices can detect data such as the user's heart rate and energy expenditure.

[0004] In the aforementioned related technologies, in order to save power consumption, wearable devices can only detect information such as the user's heart rate and energy expenditure, resulting in limited functionality. This necessitates enriching the content of motion data detection while maintaining low power consumption. Therefore, a low-power motion detection method is urgently needed. Summary of the Invention

[0005] This application provides a motion detection method, apparatus, electronic device, and storage medium, which can reduce the power consumption of electronic devices while providing abundant motion data. The technical solution is as follows:

[0006] On the one hand, an action detection method is provided, applied to a first electronic device, the first electronic device being capable of running a first system and a second system, the method comprising:

[0007] The first system determines a first action and a second action. The first action is the user's action, and the second action is the action included in the video segment currently being played by the second electronic device. The second electronic device is an electronic device that has established a communication connection with the first electronic device.

[0008] If the similarity between the first action and the second action is less than a first preset threshold, switch from the first system to the second system;

[0009] The second system plays the video segment corresponding to the second action;

[0010] The power consumption of the first system is less than that of the second system.

[0011] On the other hand, a motion detection device is provided, applied to a first electronic device, the first electronic device being capable of operating a first system and a second system, the device comprising:

[0012] The determining module is used to determine a first action and a second action through the first system, wherein the first action is a user's action and the second action is an action included in the video segment currently being played by the second electronic device, and the second electronic device is an electronic device that has established a communication connection with the first electronic device.

[0013] The switching module is used to switch from the first system to the second system when the similarity between the first action and the second action is less than a first preset threshold.

[0014] The playback module is used to play the video segment corresponding to the second action through the second system;

[0015] The power consumption of the first system is less than that of the second system.

[0016] On the other hand, an electronic device is provided, the electronic device including a processor and a memory; the memory stores at least one piece of program code, the at least one piece of program code being executed by the processor to implement the motion detection method as described above.

[0017] On the other hand, a computer-readable storage medium is provided that stores at least one piece of program code, the at least one piece of program code being executed by a processor to implement the action detection method as described above.

[0018] On the other hand, a computer program product is provided, the computer program product storing at least one piece of program code, the at least one piece of program code being executed by a processor to implement the motion detection method as described above.

[0019] In this embodiment, a first action and a second action are determined by a first system. When the difference between the first action and the second action is large, the system automatically switches from the first system to the second system. The second system then corrects the user's actions. Since the power consumption of the first system is less than that of the second system, the second system does not need to be run during periods when there is no need to remind the user to correct their actions. This enriches the content of the detected motion data while saving the power consumption of the first electronic device. Attached Figure Description

[0020] Figure 1 A schematic diagram illustrating an implementation environment provided by an exemplary embodiment of this application is shown;

[0021] Figure 2 A structural block diagram of a first electronic device illustrated in an exemplary embodiment of this application is shown;

[0022] Figure 3A flowchart illustrating an exemplary embodiment of the action detection method of this application is shown;

[0023] Figure 4 A flowchart illustrating an exemplary embodiment of the action detection method of this application is shown;

[0024] Figure 5 A flowchart illustrating an exemplary embodiment of the action detection method of this application is shown;

[0025] Figure 6 A flowchart illustrating an exemplary embodiment of the action detection method of this application is shown;

[0026] Figure 7 A flowchart illustrating an exemplary embodiment of the action detection method of this application is shown;

[0027] Figure 8 A flowchart illustrating an exemplary embodiment of the action detection method of this application is shown;

[0028] Figure 9 A block diagram of an action detection device illustrated in an exemplary embodiment of this application is shown. Detailed Implementation

[0029] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0030] In this document, "multiple" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. Furthermore, the relevant data involved in this application can be data authorized by the user or fully authorized by all parties.

[0031] Please refer to Figure 1 This diagram illustrates an implementation environment for the motion detection method provided in an exemplary embodiment of this application. The implementation environment includes a first electronic device 100 and a second electronic device 200. The first electronic device 100 and the second electronic device 200 are connected via communication.

[0032] The second electronic device 200 can play video so that the user can follow the video's movements. The first electronic device 100 can detect the user's motion data based on the video played by the second electronic device 200, so that the user can understand their movement status. For example, a first application is installed in the first electronic device 100, and a second application is installed in the second electronic device 200. The first application is used to detect the user's movement process and obtain the user's motion data. The second application is used to play the video. The first application and the second application can be the same application or different applications; this embodiment does not specifically limit this.

[0033] When the first application and the second application are the same application, the first application (second application) performs the different functions described above on the first electronic device 100 and the second electronic device 200, respectively. Specifically, the first application (second application) on both the first electronic device 100 and the second electronic device 200 logs into the same account so that the first electronic device 100 can perform motion detection based on the video played by the second electronic device 200.

[0034] When the first application and the second application are different applications, the first application and the second application can be linked by an account, so that the first electronic device 100 can determine the currently playing video through the linked second electronic device 200, so as to perform motion detection on the user based on the video.

[0035] In some embodiments, the implementation environment further includes a server, with the first electronic device 100 and the second electronic device 200 respectively establishing communication connections with the server. The server serves as the backend server for the first application and the second application. The first electronic device 100 and the second electronic device 200 can obtain data such as the video to be played and the corresponding action set from the server.

[0036] The first electronic device 100 can be a wearable electronic device, such as a watch or glasses. The second electronic device 200 can be at least one of a mobile phone, tablet computer, or PC (Personal Computer). The server can be at least one of a single server, a server cluster consisting of multiple servers, a cloud server, a cloud computing platform, and a virtualization center.

[0037] In this embodiment, the first electronic device 100 is capable of running a first system and a second system. Please refer to... Figure 2This diagram illustrates a structural block diagram of a first electronic device provided in an exemplary embodiment of this application. The first electronic device 100 in this application includes one or more of the following components: a first processor 110, a second processor 120, and a memory 130.

[0038] In some embodiments, both the first processor 110 and the second processor 120 may include one or more processing cores. The first processor 110 and the second processor 120 are connected to various parts within the entire first electronic device 100 via various interfaces and lines. They perform various functions and process data of the first electronic device 100 by running or executing instructions, programs, code sets, or instruction sets stored in the memory 130, and by calling data stored in the memory 130. Optionally, both the first processor 110 and the second processor 120 may be implemented using at least one hardware form of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), or Programmable Logic Array (PLA). Both the first processor 110 and the second processor 120 may integrate one or a combination of several of the following: Central Processing Unit (CPU), Graphics Processing Unit (GPU), Neural-network Processing Unit (NPU), and modem. The CPU primarily handles the operating system, user interface, and applications; the GPU is responsible for rendering and drawing the content to be displayed on the screen; the NPU is used to implement artificial intelligence (AI) functions; and the modem is used for wireless communication. It is understood that the modem may not be integrated into the first processor 110 or the second processor 120, but may be implemented as a separate chip.

[0039] In this embodiment, the first electronic device 100 can use different processors to run different systems under different usage scenarios, thereby maintaining the operating state of the first electronic device 100. For example, when the first electronic device 100 does not need to run an application, such as when the first electronic device 100 is in a locked state, the electronic device 100 can run the first processor 110 to implement the first system. When the first electronic device 100 is running an application, the running processor can be switched from the first processor 110 to the second processor 120, thereby switching from the first system to the second system.

[0040] In some embodiments, the memory 130 includes random access memory (RAM) and may also include read-only memory (ROM). Optionally, the memory 130 includes a non-transitory computer-readable storage medium. The memory 130 can be used to store instructions, programs, code, code sets, or instruction sets. The memory 130 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as touch function, sound playback function, image playback function, etc.), instructions for implementing the various method embodiments described below, etc.; the data storage area may store data (such as audio data, telephone book, etc.) created based on the use of the first electronic device 100.

[0041] In some embodiments, the first electronic device 100 further includes a display screen. The display screen is a display component for displaying a user interface. Optionally, the display screen is a touch-enabled display screen, allowing the user to perform touch operations on the display screen using a finger, stylus, or any suitable object. The display screen is typically located on the front panel of the first electronic device 100. The display screen can be designed as a full-screen, curved screen, irregularly shaped screen, dual-sided screen, or foldable screen. The display screen can also be designed as a combination of a full-screen and a curved screen, or a combination of an irregularly shaped screen and a curved screen, etc., which are not limited in this embodiment.

[0042] In addition, those skilled in the art will understand that the structure of the first electronic device 100 shown in the above figures does not constitute a limitation on the first electronic device 100. The first electronic device 100 may include more or fewer components than shown, or combine certain components, or have different component arrangements. For example, the first electronic device 100 may also include components such as a microphone, speaker, radio frequency circuit, input unit, sensor, audio circuit, Wireless Fidelity (Wi-Fi) module, power supply, and Bluetooth module, which will not be described in detail here.

[0043] It should be noted that the second electronic device 200 can run both the first and second systems, or it can run only one system. In this embodiment, the method by which the second electronic device runs the system is not specifically limited. Correspondingly, the second electronic device 200 may have the same or different structure as the first electronic device 100; in this embodiment, this is not specifically limited.

[0044] In this embodiment, the first electronic device can detect the user's movement based on the video played by the second electronic device, thereby providing a reminder to the user. During the user's movement detection process, the electronic device can switch between the first and second systems to achieve different functions. Please refer to... Figure 3 The diagram illustrates a flowchart of an action detection method according to an exemplary embodiment of this application. The method includes:

[0045] Step S301: The first electronic device determines a first action and a second action through the first system. The first action is the user's action, and the second action is the action included in the video segment currently being played by the second electronic device. The second electronic device is an electronic device that has established a communication connection with the first electronic device.

[0046] The first action is the action performed by the user during movement. In this step, the first electronic device detects the user's action through the first system to obtain the user's first action. For example, the first electronic device captures the user's movement using a camera, performs image analysis on the movement, and obtains the user's first action. The camera can be a camera installed on the first electronic device, or a camera that has established a communication connection with the first electronic device. In this embodiment, no specific limitation is made. Another example is that the first electronic device detects the user's action using a sensor. For example, it can detect the user's hand-raising action using a gravity sensor.

[0047] The second action is the action included in the video segment currently being played by the second electronic device. The second electronic device plays a video, which can be a sports instruction video or other video used to guide the user's movement. This video includes at least one video segment corresponding to an action. In this step, the first electronic device determines the second action corresponding to the currently playing video segment based on the video playback progress.

[0048] It should be noted that the first electronic device can determine the first action first, and then determine the second action. Accordingly, in response to detecting the first action, the first electronic device determines the second action included in the current video segment.

[0049] Alternatively, the first electronic device can determine the second action first, and then determine the first action. Accordingly, the first electronic device determines the second action corresponding to the currently playing video segment, and then performs action detection to obtain the first action.

[0050] The first electronic device can also simultaneously determine the first action and the second action. Accordingly, the first electronic device simultaneously determines the second action included in the currently playing video segment, and determines the user's first action.

[0051] In the embodiments of this application, the order in which the first electronic device determines the first action and the second action is not specifically limited.

[0052] After determining the first action and the second action, the first electronic device compares the first action and the second action to determine the similarity between the first action and the second action. If the similarity between the first action and the second action is not less than a first preset threshold, the first electronic device continues to execute step S301. If the similarity between the first action and the second action is less than the first preset threshold, the first electronic device executes step S302.

[0053] Step S302: When the similarity between the first action and the second action is less than a first preset threshold, the first electronic device switches from the first system to the second system, wherein the power consumption of the first system is less than the power consumption of the second system.

[0054] See Figure 4 The first electronic device performs motion detection through a first system. When the difference between the first action and the second action is significant, the first electronic device switches from the first system to the second system to correct the user's actions through the second system. Accordingly, in response to the similarity between the first action and the second action being less than a first preset threshold, the first electronic device generates a system switching command; based on the system switching command, it wakes up the second system and sets the first system to a sleep state.

[0055] In the embodiments of this application, the electronic device switches from the first system to the second system based on the system switching command, thereby realizing the detection of user actions in the low-power first system, and switching to the second system only when it is necessary to correct the user's actions, thereby reducing the power consumption of the electronic device.

[0056] It should be noted that the statement "the power consumption of the first system is less than that of the second system" refers to the power consumption of both systems under the same operating conditions. For example, when both the first and second systems are detecting user actions, the power consumption of the first system is less than that of the second system.

[0057] Step S303: The first electronic device plays the video segment corresponding to the second action through the second system.

[0058] In this step, the first electronic device displays an action detail interface through the second system, and plays the video segment corresponding to the second action on the action detail interface.

[0059] It should be noted that the first electronic device can play the video segment corresponding to the second action through the second system after switching to the second system. The first electronic device can also display playback and cancellation options in the action details interface after switching to the second system. In response to a trigger operation of the playback option, it plays the video segment corresponding to the second action; in response to a trigger operation of the cancellation option, or if no trigger operation of the playback option is detected within a preset time, it switches back to the first system and continues executing step S301 through the first system. Alternatively, the first electronic device can display playback and cancellation options in the action details interface before system switching. In response to a trigger operation of the playback option, it executes the step of switching from the first system to the second system and playing the video segment corresponding to the second action through the second system; in response to a trigger operation of the cancellation option, or if no trigger operation of the playback option is detected within a preset time, it continues executing step S301 through the first system.

[0060] Another point to note is that while the first electronic device detects the user's first action, it can also detect the user's heart rate, energy expenditure, and other information. After the video playback is complete, it sends the detected heart rate changes, total energy expenditure, and other data to the second electronic device for recording and display.

[0061] In this embodiment, a first action and a second action are determined by a first system. When the difference between the first action and the second action is large, the system automatically switches from the first system to the second system. The second system then corrects the user's actions. Since the power consumption of the first system is less than that of the second system, the second system does not need to be run during periods when there is no need to remind the user to correct their actions. This enriches the content of the detected motion data while saving the power consumption of the first electronic device.

[0062] It should be noted that when the first electronic device detects that the similarity between the first action and the second action is less than a first preset threshold, it can switch to the second system and play the video segment corresponding to the second action through the second system. Alternatively, the first electronic device can first alert the user through other means when the difference between the first and second actions is small, and only switch to the second system to play the video segment corresponding to the second action when the difference between the first and second actions is large. Please refer to [reference needed]. Figure 5 The diagram illustrates a flowchart of an action detection method according to an exemplary embodiment of this application. The method includes:

[0063] Step S501: The first electronic device determines a first action and a second action through the first system. The first action is the user's action, and the second action is the action included in the video segment currently being played by the second electronic device. The second electronic device is an electronic device that has established a communication connection with the first electronic device.

[0064] This step is based on the same principle as step S301, and will not be repeated here.

[0065] Step S502: When the similarity between the first action and the second action is less than a first preset threshold and the similarity between the first action and the second action is greater than a second preset threshold, the first electronic device outputs an action correction prompt, which prompts the user to adjust the first action to achieve the second action.

[0066] The second preset threshold is less than the first preset threshold.

[0067] The motion correction prompt can be any message that can prompt the user. For example, the motion correction prompt can be a vibration prompt, a voice prompt, etc. In this embodiment of the application, the type of motion correction prompt is not specifically limited.

[0068] In this embodiment of the application, when the similarity between the first action and the second action is less than a first preset threshold but greater than a second preset threshold, the user is prompted to perform action correction by outputting an action correction prompt, thereby preventing frequent switching between the first system and the second system, and thus preventing malfunctions caused by system switching.

[0069] Step S503: If the similarity between the first action and the second action is not greater than a second preset threshold, switch from the first system to the second system, wherein the power consumption of the first system is less than the power consumption of the second system.

[0070] This step is based on the same principle as step S302, and will not be repeated here.

[0071] Step S504: The first electronic device plays the video segment corresponding to the second action through the second system.

[0072] This step is based on the same principle as step S303, and will not be repeated here.

[0073] In this embodiment, a first action and a second action are determined by a first system. When the difference between the first action and the second action is large, the system automatically switches from the first system to the second system. The second system then corrects the user's actions. Since the power consumption of the first system is less than that of the second system, the second system does not need to be run during periods when there is no need to remind the user to correct their actions. This enriches the content of the detected motion data while saving the power consumption of the first electronic device.

[0074] In this embodiment, the first electronic device can determine the video segment corresponding to the second action based on the playback time point in the second electronic device. Please refer to... Figure 6The diagram illustrates a flowchart of an action detection method according to an exemplary embodiment of this application. The method includes:

[0075] Step S601: The first electronic device determines a first action and a second action through the first system. The first action is the user's action, and the second action is the action included in the video segment currently being played by the second electronic device. The second electronic device is an electronic device that has established a communication connection with the first electronic device.

[0076] This step is based on the same principle as step S301, and will not be repeated here.

[0077] Step S602: When the similarity between the first action and the second action is less than a first preset threshold, the first electronic device switches from the first system to the second system, wherein the power consumption of the first system is less than the power consumption of the second system.

[0078] This step is based on the same principle as step S302, and will not be repeated here.

[0079] Step S603: The first electronic device obtains the video to which the video segment corresponding to the second action belongs through the second system.

[0080] The video includes at least one video segment corresponding to an action.

[0081] In this embodiment, an action detection connection is established between the first electronic device and the second electronic device. The second electronic device sends a detection command to the first electronic device, the command carrying a video identifier of the video segment currently being played by the second electronic device. The first electronic device receives the detection command and, based on the video identifier carried in the command, obtains the video segment to which the second electronic device is currently playing.

[0082] In some embodiments, the second electronic device stores multiple correspondences between videos and video identifiers. In this step, based on the video identifier, the video corresponding to the video identifier is retrieved from the correspondence. In some embodiments, the second electronic device generates a retrieval request based on the video identifier and sends the retrieval request to the server. Correspondingly, the server sends the video corresponding to the video identifier to the first electronic device based on the retrieval request, and the first electronic device receives the video sent by the server.

[0083] Step S604: The first electronic device determines the time point corresponding to the second action in the video.

[0084] This time point corresponds to the playback progress of the video in the second electronic device. Accordingly, in some embodiments, the first electronic device obtains the time point corresponding to the playback progress of the video in the second electronic device.

[0085] Step S605: The first electronic device starts playing the video segment from that point in time on the action details interface.

[0086] In this step, the first electronic device plays a video segment of the video in the action details interface of the first electronic device based on the time point.

[0087] In this embodiment, the video segment played in the first electronic device is determined by the time point of video playback in the second electronic device, thereby ensuring that the first electronic device can accurately play the video corresponding to the second action, so that the user does not need to adjust the video playback progress, thus optimizing the user experience.

[0088] In this embodiment, a first action and a second action are determined by a first system. When the difference between the first action and the second action is large, the system automatically switches from the first system to the second system. The second system then corrects the user's actions. Since the power consumption of the first system is less than that of the second system, the second system does not need to be run during periods when there is no need to remind the user to correct their actions. This enriches the content of the detected motion data while saving the power consumption of the first electronic device.

[0089] In this embodiment, when the first electronic device is playing the video segment corresponding to the second action, the second electronic device can pause the video playback so that the user can continue the movement based on the previous progress after correcting the first action. Accordingly, the first and second electronic devices control the video playback through information interaction. Please refer to... Figure 7 This document illustrates a flowchart of an exemplary embodiment of an action detection method according to this application. In this embodiment, the method is described using the interaction between a first electronic device and a second electronic device to control the playback of video as an example. The method includes:

[0090] Step S701: The second electronic device sends a detection command to the first electronic device. The detection command includes the video identifier of the video segment currently being played by the second electronic device.

[0091] See Figure 8 A motion detection connection is established between the first electronic device and the second electronic device. The second electronic device sends a detection command to the first electronic device, which carries the video identifier of the video segment currently being played by the second electronic device. The first electronic device receives the detection command and, based on the video identifier carried in the detection command, retrieves the video segment currently being played by the second electronic device.

[0092] Step S702: The first electronic device receives the detection command sent by the second electronic device.

[0093] See Figure 8In this step, after receiving the detection command, the second electronic device sends a response message for the detection command to the second electronic device.

[0094] One point to note is that you should continue to refer to [link / reference needed]. Figure 8 After the first electronic device establishes a connection with the second electronic device, and the second electronic device has started playing video, the second electronic device can send an alignment instruction to the first electronic device based on the current playback progress of the video. This alignment instruction instructs the first electronic device to start detection from the second action corresponding to that playback progress. This prevents the first electronic device from making incorrect action detections and improves the accuracy of the detection.

[0095] Step S703: The first electronic device determines the set of actions corresponding to the video from the action library based on the video identifier.

[0096] The action library includes a mapping between video identifiers and action sets for multiple videos. In this step, the first electronic device determines the action set corresponding to a video identifier from the mapping between video identifiers and action sets using that video identifier.

[0097] It should be noted that the action library is stored locally on the first electronic device, or it may be stored on a server. This embodiment of the application does not impose a specific limitation. When the action library is stored on a server, the process by which the first electronic device obtains the action set is the same as the principle in step S603 where the first electronic device obtains the video from the server based on the video identifier, and will not be described again here.

[0098] Step S704: The first electronic device determines a first action and a second action through the first system. The first action is the user's action, and the second action is the action included in the video segment currently being played by the second electronic device. The second electronic device is an electronic device that has established a communication connection with the first electronic device.

[0099] This step is based on the same principle as step S301, and will not be repeated here.

[0100] Step S705: If the similarity between the first action and the second action is less than a first preset threshold, the first electronic device switches from the first system to the second system.

[0101] This step is based on the same principle as step S302, and will not be repeated here.

[0102] Step S706: The first electronic device plays the video segment corresponding to the second action through the second system.

[0103] This step is based on the same principle as step S303, and will not be repeated here.

[0104] Step S707: The first electronic device sends a pause playback command to the second electronic device.

[0105] The pause playback command is used to instruct the second electronic device to pause playback of the video segment to which the second action belongs.

[0106] Step S708: The second electronic device receives a pause playback command.

[0107] Step S709: The second electronic device pauses playback of the video based on the pause playback command.

[0108] In this implementation, the second electronic device pauses the video playback based on the pause playback command of the first electronic device, thereby preventing the user from missing the video playing on the second electronic device while watching the video segment corresponding to the second action through the first electronic device, thus optimizing the user experience.

[0109] Step S710: In response to the completion of playback of the video segment corresponding to the second action, the first electronic device sends a continue playback command to the second electronic device.

[0110] The "continue playing" instruction is used to instruct the second electronic device to continue playing the video segment to which the second action belongs.

[0111] It should be noted that before the first electronic device sends the continue playback command to the second electronic device, it can also confirm whether to trigger the second electronic device to continue playing the video. Accordingly, the first electronic device displays a return to training option; in response to the triggering operation of the return to training option, step S709 is executed. In this way, the user can loop the video segment corresponding to the second action, thus optimizing the user experience.

[0112] Step S711: The first electronic device switches from the second system to the first system.

[0113] In this implementation, when the first electronic device finishes playing the video segment corresponding to the second action, the first electronic device switches back from the second system to the first system. This timely switch back to the first system reduces the power consumption of the first electronic device.

[0114] Step S712: The second electronic device continues to play the video.

[0115] It should be noted that during the process of the first electronic device detecting user actions, if the communication connection between the first electronic device and the second electronic device is lost, the first electronic device can start a playback timer. Therefore, when the connection between the first and second electronic devices is re-established, the first electronic device can determine the currently playing video segment based on the playback timer. Accordingly, in response to the loss of communication between the first and second electronic devices, the first electronic device starts a playback timer; in response to the re-establishment of communication between the first and second electronic devices, it determines the currently playing video segment based on the playback timer.

[0116] One point to note is that, see Figure 8 When the video playback is complete, the second electronic device sends an end command to the first electronic device. This end command is used to instruct the first electronic device to end the detection of the user's actions.

[0117] Another point to note is that during the period when the communication connection between the first electronic device and the second electronic device is disconnected, if the playback time of the first electronic device reaches the total playback duration of the video, the first electronic device will automatically exit the detection of the user's actions. This prevents the first electronic device from malfunctioning when the communication connection between the first electronic device and the second electronic device is disconnected.

[0118] In this embodiment, a first action and a second action are determined by a first system. When the difference between the first action and the second action is large, the system automatically switches from the first system to the second system. The second system then provides action correction reminders to the user. Since the power consumption of the first system is less than that of the second system, the second system does not need to be run during periods when action correction reminders to the user are not required. This enriches the content of the detected motion data while saving power consumption of the first electronic device.

[0119] Please refer to Figure 9 This diagram illustrates a structural block diagram of an action detection device according to an embodiment of this application. The action detection device can be implemented as all or part of a processor through software, hardware, or a combination of both. The device includes:

[0120] The first determining module 901 is used to determine a first action and a second action through the first system. The first action is the user's action, and the second action is the action included in the video segment currently being played by the second electronic device. The second electronic device is an electronic device that has established a communication connection with the first electronic device.

[0121] The switching module 902 is used to switch from the first system to the second system when the similarity between the first action and the second action is less than a first preset threshold.

[0122] The playback module 903 is used to play the video segment corresponding to the second action through the second system;

[0123] The power consumption of the first system is less than that of the second system.

[0124] In some embodiments, the playback module 903 includes:

[0125] The acquisition unit is used to acquire, through the second system, the video to which the video segment corresponding to the second action belongs, the video including at least one video segment corresponding to the action;

[0126] A determining unit is used to determine the time point corresponding to the second action in the video;

[0127] The playback unit is used to play the video segment of the video starting from the specified time point on the action details interface.

[0128] In some embodiments, the device further includes:

[0129] The first sending module is used to send a pause playback command to the second electronic device, the pause playback command being used to instruct the second electronic device to pause playback of the video segment to which the second action belongs;

[0130] The second sending module is used to send a continue playback command to the second electronic device in response to the completion of playback of the video segment corresponding to the second action. The continue playback command is used to instruct the second electronic device to continue playing the video to which the video segment corresponding to the second action belongs.

[0131] The switching module 902 is also used to switch from the second system to the first system.

[0132] In some embodiments, the device further includes:

[0133] The display module is used to show the return to training options;

[0134] The second sending module is used to send a continue playback command to the second electronic device in response to the triggering operation of the return training option.

[0135] In some embodiments, the device further includes:

[0136] The output module is used to output an action correction prompt when the similarity between the first action and the second action is less than a first preset threshold and the similarity between the first action and the second action is greater than a second preset threshold. The action correction prompt is used to prompt the user to adjust the first action to achieve the second action.

[0137] The switching module 902 is also used to switch from the first system to the second system when the similarity between the first action and the second action is not greater than a second preset threshold.

[0138] In some embodiments, the device further includes:

[0139] The receiving module is used to receive a detection command sent by the second electronic device, the detection command including the video identifier of the video segment currently being played by the second electronic device;

[0140] The second determining module is used to determine the set of actions corresponding to the video from the action library based on the video identifier;

[0141] The first determining module 901 is used to determine the second action from the action set based on the time point of the video segment in the video through the first system.

[0142] In some embodiments, the device further includes:

[0143] The timing module is used to start the playback timing in response to the disconnection of the communication connection between the first electronic device and the second electronic device;

[0144] The playback module 903 is also used to determine the currently playing video segment based on the playback timing in response to the re-establishment of the communication connection between the first electronic device and the second electronic device.

[0145] In this embodiment, a first action and a second action are determined by a first system. When the difference between the first action and the second action is large, the system automatically switches from the first system to the second system. The second system then provides action correction reminders to the user. Since the power consumption of the first system is less than that of the second system, the second system does not need to be run during periods when action correction reminders to the user are not required. This enriches the content of the detected motion data while saving power consumption of the first electronic device.

[0146] This application also provides a computer-readable medium storing at least one instruction, which is loaded and executed by the processor to implement the motion detection method shown in the above embodiments.

[0147] This application also provides a computer program product that stores at least one instruction, which is loaded and executed by the processor to implement the motion detection method shown in the above embodiments.

[0148] Those skilled in the art will recognize that the functions described in the embodiments of this application in one or more of the above examples can be implemented using hardware, software, firmware, or any combination thereof. When implemented using software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or code on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein communication media include any medium that facilitates the transfer of a computer program from one place to another. Storage media can be any available medium that can be accessed by a general-purpose or special-purpose computer.

[0149] The above description is merely an optional embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A motion detection method, applied to a first electronic device, the first electronic device being capable of running a first system and a second system, characterized in that, The method includes: The first system determines a first action and a second action. The first action is the user's action, and the second action is the action included in the video segment currently being played by the second electronic device. The second electronic device is an electronic device that has established a communication connection with the first electronic device. If the similarity between the first action and the second action is less than a first preset threshold, switch from the first system to the second system; The second system plays the video segment corresponding to the second action; The power consumption of the first system is less than that of the second system.

2. The method according to claim 1, characterized in that, Playing the video segment corresponding to the second action through the second system includes: The second system obtains the video to which the video segment corresponding to the second action belongs, and the video includes at least one video segment corresponding to the action. Determine the time point corresponding to the second action in the video; On the action details interface, the video segment of the video is played starting from the specified time point.

3. The method according to claim 1, characterized in that, The method further includes: Send a pause playback command to the second electronic device, the pause playback command being used to instruct the second electronic device to pause playback of the video segment to which the second action belongs; In response to the completion of playback of the video segment corresponding to the second action, a continue playback instruction is sent to the second electronic device, the continue playback instruction being used to instruct the second electronic device to continue playing the video to which the video segment corresponding to the second action belongs; Switch from the second system to the first system.

4. The method according to claim 3, characterized in that, Before sending the continue playback command to the second electronic device, the method further includes: Show the option to return to training; In response to the triggering operation of the return to training option, the step of sending the continue playback command to the second electronic device is performed.

5. The method according to claim 1, characterized in that, Before switching from the first system to the second system, the method further includes: If the similarity between the first action and the second action is less than a first preset threshold and the similarity between the first action and the second action is greater than a second preset threshold, an action correction prompt is output. The action correction prompt is used to prompt the user to adjust the first action to achieve the second action. If the similarity between the first action and the second action is not greater than a second preset threshold, the step of switching from the first system to the second system is executed.

6. The method according to claim 1, characterized in that, Before determining the first action and the second action through the first system, the method further includes: Receive a detection instruction sent by the second electronic device, the detection instruction including the video identifier of the video segment currently being played by the second electronic device; Based on the video identifier, determine the set of actions corresponding to the video from the action library; The process of determining the second action through the first system includes: The first system determines the second action from the action set based on the time point of the video segment in the video.

7. The method according to claim 1, characterized in that, The method further includes: In response to the disconnection of the communication connection between the first electronic device and the second electronic device, the playback timing is started; In response to the re-establishment of the communication connection between the first electronic device and the second electronic device, the currently playing video segment is determined based on the playback timing.

8. A motion detection device, applied to a first electronic device, the first electronic device being capable of operating a first system and a second system, characterized in that, The device includes: The determining module is used to determine a first action and a second action through the first system, wherein the first action is a user's action and the second action is an action included in the video segment currently being played by the second electronic device, and the second electronic device is an electronic device that has established a communication connection with the first electronic device. The switching module is used to switch from the first system to the second system when the similarity between the first action and the second action is less than a first preset threshold. The playback module is used to play the video segment corresponding to the second action through the second system; The power consumption of the first system is less than that of the second system.

9. An electronic device, characterized in that, The electronic device includes a processor and a memory; the memory stores at least one piece of program code, which is executed by the processor to implement the motion detection method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores at least one piece of program code, which is executed by a processor to implement the action detection method as described in any one of claims 1 to 7.

Images