Method for generating teaching video and electronic equipment

Abstract

The invention provides a method for generating a teaching video and electronic equipment, and the method comprises the steps: obtaining a first video which comprises a first audio; identifying a target object in the first video, N actions of the target object and joint coordinates corresponding to the N actions; determining motion trails of the N actions according to the N actions and the joint coordinates corresponding to the N actions; generating a first decomposed slow action set of the N actions according to the motion trails of the N actions and the first audio; determining a first virtual object; and generating a second video according to the first virtual object and the first decomposed slow action set of the N actions. In the embodiment of the invention, the electronic equipment decomposes the N actions of the target object into the decomposed slow action set according to the beat of the first audio, and the first decomposed slow action set is displayed by using the first virtual object, so that a large amount of time is not needed to make a teaching video, the learning immersion of a user can be improved, and the learning effect of the user can be enhanced; and the user experience is improved.

Description

Technical Field

[0001] The present application relates to the field of electronic devices, and more specifically, to a method for generating a teaching video and an electronic device. Background Art

[0002] As users gradually pay more attention to the quality of life and health, more and more users begin to practice dance, aerobics, martial arts and other projects. At present, users can learn dance, aerobics and martial arts in offline venues, but the cost of learning in offline venues is high, including both monetary costs such as tuition fees and the time cost of going to offline venues. Therefore, in order to save costs, users can also self-study at home through teaching videos. It is not difficult to understand that it takes a lot of time to make teaching videos. Therefore, there is a certain lag in teaching videos. There may be a situation where users want to learn a set of movements but there is no teaching video yet. In this case, users can only watch the performance video of the set of movements and manually pause it to imitate. Users cannot learn immersively, resulting in poor learning effects and reduced user experience. Therefore, how to quickly generate teaching videos has become a problem that needs to be solved urgently. Summary of the invention

[0003] The present application provides a method for generating a teaching video and an electronic device, which can identify the actions of a target object in a video and decompose the actions into a decomposed slow-motion set according to the beat of a first audio, and then use a first virtual object to display the decomposed slow-motion set, so that a teaching video can be automatically generated without spending a lot of time on making teaching videos. This can improve the user's learning immersion, enhance the user's learning effect, and improve the user experience.

[0004] In a first aspect, a method for generating a teaching video is provided, the method comprising: acquiring a first video, the first video comprising a first audio; identifying a target object in the first video, N actions of the target object, and joint coordinates corresponding to the N actions, N≥1; determining motion trajectories of the N actions according to the N actions and the joint coordinates corresponding to the N actions; generating a first decomposed slow-motion set of the N actions according to the motion trajectories of the N actions and the first audio; determining a first virtual object; and generating a second video according to the first virtual object and the first decomposed slow-motion set of the N actions.

[0005] In the embodiment of the present application, the electronic device can identify N actions of the target object in the first video and analyze the motion trajectories of the N actions, then decompose the N actions into a first decomposed slow-motion set according to the beat of the first audio, and then use the first virtual object to display the first decomposed slow-motion set. The electronic device in the embodiment of the present application can automatically generate teaching videos, without spending a lot of time to make teaching videos, which can improve the user's learning immersion, enhance the user's learning effect, and improve the user's experience.

[0006] In combination with the first aspect, in some implementations of the first aspect, the method also includes: generating first teaching guidance information based on a first decomposed slow-motion set of the N actions; generating a second video based on the first virtual object and the first decomposed slow-motion set of the N actions includes: generating a second video based on the first virtual object, the first decomposed slow-motion set of the N actions and the first teaching guidance information.

[0007] In an embodiment of the present application, the electronic device can also generate teaching guidance information, which can be text information and / or voice information, so that during the playback of the second video, the teaching guidance information can be displayed and / or played, which can better prompt the user how to learn the actions in the second video, thereby speeding up the user's learning efficiency and improving the user experience.

[0008] In combination with the first aspect, in some implementations of the first aspect, the first teaching guidance information includes text information and / or voice information.

[0009] In combination with the first aspect, in certain implementations of the first aspect, the first teaching guidance information includes the voice information, and the method further includes: determining the timbre when playing the voice information; generating the first teaching guidance information based on the first decomposed slow motion set of the N actions includes: generating the first teaching guidance information based on the first decomposed slow motion set of the N actions and the timbre.

[0010] In the embodiment of the present application, the electronic device can also determine the timbre of the teaching guidance information played, which can better meet the user's expectations, thereby accelerating the user's learning efficiency and improving the user's experience.

[0011] In combination with the first aspect, in certain implementations of the first aspect, the method further includes: obtaining a second audio; generating a second decomposed slow-motion set of the N actions based on the motion trajectories of the N actions and the second audio; and generating a third video based on the first virtual object and the second decomposed slow-motion set of the N actions.

[0012] In an embodiment of the present application, the electronic device can also obtain a second audio and generate a third video based on the second audio, so that teaching videos with different beats can be generated based on a set of actions of the target object, which can improve the efficiency of generating teaching videos and help improve the user experience.

[0013] In combination with the first aspect, in some implementations of the first aspect, the method further includes: playing the second video; obtaining the user's actions while playing the second video; determining a second virtual object; and using the second virtual object to display the user's actions.

[0014] In an embodiment of the present application, when playing the second video, the electronic device can also obtain the user's actions and generate a second virtual object to display the user's actions, so that the user can watch his or her own actions in real time, which helps to promptly discover problems with the actions and correct them, and can improve the user's learning efficiency and user experience.

[0015] In combination with the first aspect, in certain implementations of the first aspect, the method further includes: determining action correction information based on the user's action and the N actions; and outputting the action correction information when playing the second video.

[0016] In an embodiment of the present application, the electronic device can also generate action correction information, which can be text information and / or voice information, so that during the playback of the second video, the action correction information can be displayed and / or played, which can better correct the user's mistakes, speed up the user's learning efficiency, and enhance the user experience.

[0017] In combination with the first aspect, in certain implementations of the first aspect, the method further includes: after playing the second video, determining action evaluation information based on the user's action and the N actions; and outputting the action evaluation information.

[0018] In an embodiment of the present application, the electronic device can also generate action evaluation information based on the user's actions and the actions of the target object after playing the second video. The action evaluation information can be text information and / or voice information, so as to systematically summarize the mistakes of the user's actions, speed up the user's learning efficiency, and enhance the user's experience.

[0019] In combination with the first aspect, in certain implementations of the first aspect, before identifying the target object in the first video, the N actions of the target object, and the joint coordinates corresponding to the N actions, the method also includes: identifying the type of the first video; identifying the target object in the first video, the N actions of the target object, and the joint coordinates corresponding to the N actions includes: identifying the target object in the first video, the N actions of the target object, and the joint coordinates corresponding to the N actions according to the type of the first video.

[0020] In combination with the first aspect, in some implementations of the first aspect, the duration of the first video is shorter than the duration of the second video.

[0021] The second aspect is an electronic device of an embodiment of the present application, which includes modules / units for executing the above aspects or any possible design method of the above aspects; these modules / units can be implemented by hardware, or the corresponding software can be implemented by hardware.

[0022] The third aspect is a chip of an embodiment of the present application, which is coupled to a memory in an electronic device and is used to call a computer program stored in the memory and execute the above-mentioned aspects of the embodiment of the present application and any possible design of the above-mentioned aspects of the embodiment of the present application; in the embodiment of the present application, "coupling" refers to the direct or indirect combination of two components with each other.

[0023] The fourth aspect is an electronic device of an embodiment of the present application, which includes one or more processors; one or more memories; the one or more memories store one or more computer programs, and the one or more computer programs include instructions. When the instructions are executed by the one or more processors, the above aspects or any possible implementation of the above aspects are executed.

[0024] In a fifth aspect, a computer-readable storage medium is provided, which includes a computer program or instructions. When the computer program or instructions are run on a computer, the first aspect and any possible implementation method of the first aspect are executed.

[0025] In a sixth aspect, a computer program product is provided, which includes a computer program or instructions. When the computer program or instructions are run on a computer, the first aspect and any possible implementation method of the first aspect are executed.

[0026] In a seventh aspect, a computer program is provided, which, when executed on a computer, enables the method in the first aspect and any possible implementation thereof to be executed.

[0027] Among them, for the beneficial effects of the second to seventh aspects, please refer to the beneficial effects of the first aspect and will not be repeated. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

[0029] Figure 2 It is a software structure block diagram of the electronic device according to an embodiment of the present application.

[0030] Figure 3 It is a schematic flowchart of the method for generating teaching videos provided in an embodiment of the present application.

[0031] Figure 4 It is a schematic flowchart of the method for generating teaching videos provided in an embodiment of the present application.

[0032] Figure 5 It is a set of graphical user interfaces (GUI) provided in the embodiments of the present application.

[0033] Figure 6 It is a set of GUIs provided by the embodiments of the present application.

[0034] Figure 7 It is a schematic flowchart of the method for generating teaching videos provided in an embodiment of the present application.

[0035] Figure 8 It is a schematic flowchart of the method for generating teaching videos provided in an embodiment of the present application.

[0036] Fig. 9 It is a set of GUIs provided by the embodiments of the present application.

[0037] Fig.10 It is a set of GUIs provided by the embodiments of the present application.

[0038] Fig.11 It is a schematic diagram of the composition of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0039] The technical solutions in the embodiments of the present application will be described below in conjunction with the accompanying drawings.

[0040] The terms used in the following embodiments are only for the purpose of describing specific embodiments, and are not intended to be used as limitations on the present application. As used in the specification and the appended claims of the present application, the singular expressions "one", "a kind of", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear contrary indication in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one, two or more. The term "and / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist; for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship.

[0041] References to "one embodiment" or "some embodiments" etc. described in this specification mean that a particular feature, structure or characteristic described in conjunction with the embodiment is included in one or more embodiments of the present application. Thus, the phrases "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear at different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0042] The following describes an electronic device, a user interface for such an electronic device, and embodiments for using such an electronic device. In some embodiments, the electronic device may be a portable electronic device that also includes other functions such as a personal digital assistant and / or a music player function, such as a mobile phone, a tablet computer, a wearable electronic device with wireless communication function (such as a smart watch), etc. Exemplary embodiments of portable electronic devices include but are not limited to devices equipped with Or a portable electronic device with other operating systems. The portable electronic device may also be other portable electronic devices, such as a laptop computer, etc. It should also be understood that in some other embodiments, the electronic device may not be a portable electronic device, but a desktop computer.

[0043] For example, Figure 11 shows a schematic diagram of the structure of the electronic device 100. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0044] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0045] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0046] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0047] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0048] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0049] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0050] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0051] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0052] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0053] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0054] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-CDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0055] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0056] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0057] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0058] ISP is used to process the data fed back by camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 193.

[0059] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0060] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0061] Video codecs are used to compress or decompress digital videos. The electronic device 100 may support one or more video codecs. Thus, the electronic device 100 may play or record videos in a variety of coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0062] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0063] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0064] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0065] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0066] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

[0067] The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or listen to a hands-free call through the speaker 170A.

[0068] The receiver 170B, also called a "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or voice message, the voice can be received by placing the receiver 170B close to the human ear.

[0069] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to microphone 170C to input the sound signal into microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the sound source, realize directional recording function, etc.

[0070] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure based on the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the touch operation intensity according to the pressure sensor 180A. The electronic device 100 can also calculate the touch position based on the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example, when a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the alarm application icon, an instruction to create a new alarm is executed.

[0071] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to realize fingerprint unlocking, access application locks, fingerprint photography, fingerprint answering calls, etc. For example, when the mobile phone detects a user's touch operation on the lock screen interface, the mobile phone can collect the user's fingerprint information through the fingerprint sensor 180H, and match the collected fingerprint information with the fingerprint information preset in the mobile phone. If the match is successful, the mobile phone can enter the non-lock screen interface from the lock screen interface.

[0072] The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194.

[0073] Figure 2 1 is a software structure diagram of the electronic device 100 of the embodiment of the present application. The layered architecture divides the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, namely, the application layer, the application framework layer, the Android runtime (Android runtime) and the system library, and the kernel layer. The application layer can include a series of application packages.

[0074] like Figure 2 As shown, the application layer may include camera, settings, third-party applications, etc. Among them, the third-party applications may include gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.

[0075] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer may include some predefined functions.

[0076] like Figure 2 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0077] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc. The content provider is used to store and obtain data and make the data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0078] The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, etc., such as the indication information for prompting a virtual shutter key in the embodiment of the present application. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a text message notification icon can include a view for displaying text and a view for displaying pictures.

[0079] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including connecting, hanging up, etc.).

[0080] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0081] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0082] Android runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0083] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0084] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0085] The system library may include multiple functional modules, such as surface manager, media libraries, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0086] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0087] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0088] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0089] A 2D graphics engine is a drawing engine for 2D drawings.

[0090] In addition, the system library may also include status monitoring service modules, such as a physical status recognition module for analyzing and identifying user gestures; a sensor service module for monitoring sensor data uploaded by various sensors at the hardware layer to determine the physical status of the electronic device 100.

[0091] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0092] The hardware layer can include various types of sensors, such as Figure 1 The various types of sensors introduced in the present application include acceleration sensors, gyroscope sensors, touch sensors, etc.

[0093] As users gradually pay more attention to the quality of life and health, more and more users begin to practice dance, aerobics, martial arts and other projects. At present, users can learn dance, aerobics and martial arts in offline venues, but the cost of learning in offline venues is high, including both monetary costs such as tuition fees and the time cost of going to offline venues. Therefore, in order to save costs, users can also self-study at home through teaching videos. It is not difficult to understand that it takes a lot of time to make teaching videos. Therefore, there is a certain lag in teaching videos. There may be a situation where users want to learn a set of movements but there is no teaching video. In this case, users can only watch the performance video of the set of movements and manually pause to imitate. Users cannot learn immersively, resulting in poor learning effects for users and reducing the user experience. Based on this, the embodiment of the present application provides a method for generating teaching videos, which can automatically decompose the actions in the video and generate virtual objects to show slow motion. Users can quickly obtain teaching videos for learning, which helps users to learn immersively, improve the learning efficiency of users, and enhance the user experience.

[0094] Figure 3 A schematic flow chart of a method 300 for generating a teaching video provided in an embodiment of the present application is shown. Figure 3 As shown, the method 300 includes:

[0095] S301, obtaining a first video, wherein the first video includes a first audio.

[0096] The method for obtaining the first video is not limited in the embodiment of the present application, and several methods for obtaining the first video are exemplarily introduced below.

[0097] In a possible implementation manner, the electronic device obtains the first video in response to an operation of a user uploading the first video.

[0098] In a possible implementation, the electronic device acquires a first video in response to a user's operation of shooting a video.

[0099] For example, a user uses an electronic device to shoot a dance performance. In response to the user's operation of shooting the dance performance, the electronic device can determine the shot dance performance video as the first video.

[0100] In a possible implementation, the electronic device obtains the first video in response to a user selecting the first video.

[0101] For example, in response to a user selecting a first video in an album, the electronic device obtains the first video.

[0102] For another example, the electronic device obtains the first video in response to a user selecting the first video in a video application.

[0103] In a possible implementation manner, an electronic device receives a first video sent by another electronic device.

[0104] S302: Identify a target object in the first video.

[0105] After acquiring the first video, the electronic device can identify the target object in the first video.

[0106] It is understandable that the target object in the first video may be one or more than one target object.

[0107] For example, the first video is a group dance video including a main dancer and backup dancers, and the target object in the first video may be the main dancer.

[0108] For another example, the first video is a group dance video including a main dancer and backup dancers, and the target objects of the first video may be the main dancer and backup dancers.

[0109] It should be noted that, for the sake of ease of introduction, the following description will be given with the example that the number of target objects is 1.

[0110] Optionally, in some embodiments, before executing step S302, the electronic device may further identify the type of the first video.

[0111] Exemplarily, the electronic device may use the MoviNet video classification model to identify the type of the first video. For example, the type of the first video may be a street dance video, a taekwondo video, a folk dance video, or the like.

[0112] S303, identifying N actions of the target object and the joint coordinates corresponding to the N actions.

[0113] The electronic device can identify N actions of the target object in the first video, and obtain the joint coordinates of the target object in each frame of the first video based on the skeleton detection model, where N≥1 and is an integer.

[0114] For example, taking the first video as a dance video, in which the target object performs two actions, a toe butterfly step and a side kick, the electronic device can identify the toe butterfly step and the side kick performed by the target object, and then can also identify the joint coordinates of the target object in each frame of the first video when the target object performs the toe butterfly step and the side kick based on the bone detection module.

[0115] It can be understood that the joint coordinates of the target object in each frame of the first video can be used to determine the change trajectory of the joint coordinates of the target object when completing N actions.

[0116] For example, the target object completes the toe butterfly step action in frames #1-#60 in the first video. The electronic device can determine the joint coordinates of the target object in frames #1-#60 based on the skeleton detection model, and then determine the motion trajectory of the toe butterfly step action in the following steps.

[0117] S304, determining motion trajectories of the N actions according to the N actions and the joint coordinates corresponding to the N actions.

[0118] After the electronic device identifies N actions of the target object and the joint coordinates corresponding to the N actions, the motion trajectories of the N actions can be determined.

[0119] In some embodiments, the motion trajectories of the N actions may include the motion trajectory of each action.

[0120] In some embodiments, the motion trajectories of the N actions may include the motion trajectory of each action, and may also include the motion trajectories between adjacent actions.

[0121] For example, taking the first video as a dance video, in which the target object first performs a toe butterfly step and then a side kick in the first video, the electronic device can determine the motion trajectories of the toe butterfly step and the side kick, and can also determine the motion trajectory of the transition from the toe butterfly step to the side kick.

[0122] S305: Generate a first decomposed slow-motion set of N actions according to the motion trajectories of the N actions and the first audio.

[0123] The electronic device may determine the beat of the music based on the first audio, and then may generate a first decomposed slow-motion set of the N actions based on the beat of the music and the motion trajectories of the N actions.

[0124] For example, the electronic device can decompose the toe butterfly step into the following movements: crossing the feet - standing on the left foot, extending the right foot to the side - retracting the right foot until the feet are crossed - standing on the right foot, extending the left foot to the side - retracting the left foot until the feet are crossed.

[0125] In the embodiment of the present application, there is no limitation on the method by which an electronic device generates a first decomposed slow-motion set of N actions based on the motion trajectories of the N actions and the first audio. Several possible implementation methods are introduced as examples below.

[0126] In a possible implementation, the electronic device is pre-installed with a trained model, the input of the model is the motion trajectory and audio of the action, and the output is the decomposed slow motion. After the electronic device determines the motion trajectories of N actions, the motion trajectories of the N actions and the first audio can be input into the trained model, so as to obtain a first decomposed slow motion set of the N actions.

[0127] In one possible implementation method, the electronic device uploads the motion trajectory and the first audio of N actions to a server. The server is pre-installed with a trained model. After the server generates a first decomposed action set of N actions, the first decomposed slow motion of the N actions can be combined and sent to the electronic device.

[0128] S306: Determine a first virtual object.

[0129] The electronic device may determine the first virtual object in the following possible implementations:

[0130] In a possible implementation manner, the electronic device is pre-set with one or more virtual objects, and the electronic device can determine the first virtual object according to the pre-set one or more virtual objects.

[0131] For example, the electronic device is pre-set with four virtual objects, namely virtual object #1, virtual object #2, virtual object #3 and virtual object #4, where virtual object #1 and virtual object #2 are male, virtual object #3 and virtual object #4 are female, and the target object in the first video is male, then the electronic device can determine one from virtual object #1 and virtual object #2 as the first virtual object.

[0132] In one possible implementation, the electronic device is pre-installed with a face pinching system, and the electronic device can determine the first virtual object in response to the user's face pinching operation.

[0133] In a possible implementation, the electronic device determines the first virtual object according to the target object. The electronic device can generate the first virtual object using skinning technology according to the skeleton key points of the target object. It is understandable that when the electronic device determines the first virtual object according to the target object, the image of the first virtual object is the same as or similar to the image of the target object.

[0134] In some embodiments, the first virtual object generated by the electronic device includes a front side and a back side, so as to better display each action.

[0135] S307 , generating a second video according to the first virtual object and the first decomposed slow-motion set of N actions.

[0136] After the electronic device determines the first virtual object, it can use the first virtual object to display a first decomposed slow-motion set of N actions to generate a second video.

[0137] It can be understood that, since the first virtual object shows the decomposed slow motion of each of the N actions of the target object, the length of the generated second video can be greater than the length of the first video.

[0138] Since the first decomposed action set of N actions is determined according to the beat of the first audio, it is not difficult to understand that the performance of the first virtual object when displaying the first decomposed action set of N actions is different when the beat of the first audio is different.

[0139] For example, the tempo of the first audio is 60 beats per second, and the time for the first virtual object in the second video to show the decomposed action of the toe butterfly step can be 3 seconds.

[0140] For another example, the tempo of the first audio is 120 beats per second, and the time for the first virtual object in the second video to show the decomposed action of the toe butterfly step may be 2 seconds.

[0141] In the embodiment of the present application, the electronic device can identify N actions of the target object in the first video and analyze the motion trajectories of the N actions, then decompose the N actions into a first decomposed slow-motion set according to the beat of the first audio, and then use the first virtual object to display the first decomposed slow-motion set. The electronic device in the embodiment of the present application can automatically generate teaching videos, without spending a lot of time to make teaching videos, which can improve the user's learning immersion, enhance the user's learning effect, and improve the user's experience.

[0142] When the user watches the second video, he can learn by referring to the slow motion displayed by the first virtual object. However, considering that the user may not be impressed enough by just watching the motion of the first virtual object, the electronic device can also generate teaching guidance information when generating the second video. Figure 4 and Figure 5 Provide a detailed description.

[0143] Figure 4 A schematic flow chart of a method for generating a teaching video provided in an embodiment of the present application is shown, Figure 4 As shown, in step S307, before generating the second video according to the first virtual object and the first decomposed slow motion set of N actions, the method 300 further includes:

[0144] S308: Generate first teaching guidance information according to the first decomposed slow motion set of N actions.

[0145] In some embodiments, the first teaching guidance information may be text information.

[0146] In some embodiments, the first teaching guidance information may be voice information.

[0147] In some embodiments, the first teaching guidance information may be text information and voice information.

[0148] S307, generating a second video according to the first virtual object and the first decomposed slow motion set of N actions, including:

[0149] S3071, generating a second video according to the first virtual object, the first decomposed slow motion of the N actions and the first teaching guidance information.

[0150] The electronic device can generate a second video based on the first virtual object, the first decomposed slow motion of the N actions and the first teaching guidance information. The second video includes the first teaching guidance information. Due to the difference in the first teaching guidance information, the electronic device can have the following possible implementation methods when playing the second video.

[0151] In a possible implementation, the first teaching guidance information is text information, and the electronic device can display the text information when playing the second video.

[0152] For example, Figure 5 As shown in (a) of FIG. 5 , the electronic device displays an interface 501, which is an interface of the second video, and includes a first virtual object 502, which is performing a decomposed slow motion of a toe butterfly step. The electronic device can also display a first text message 503 in the interface 501, and the first text message 503 corresponds to the decomposed slow motion that the first virtual object 502 is performing.

[0153] In a possible implementation, the first teaching guidance information is voice information, and the electronic device can also play the voice information when playing the second video.

[0154] For example, Figure 5 As shown in (b) of FIG. 1 , the electronic device displays an interface 501, which is an interface of the second video, and includes a first virtual object 502, which is performing a decomposed slow motion of a toe butterfly step. The electronic device can also play a first voice message 504, which corresponds to the decomposed slow motion of the first virtual object 502.

[0155] In a possible implementation, the first teaching guidance information is voice information and text information, and the electronic device can also display the text information and play the voice information when playing the second video.

[0156] For example, Figure 5 As shown in (c) of FIG. 5 , the electronic device displays an interface 501, which is an interface of the second video, and includes a first virtual object 502, which is performing a decomposed slow motion of a toe butterfly step. The electronic device can also display a first text message 503 and play a first voice message 504 in the interface 501, and the first text message 503 and the first voice message 504 correspond to the decomposed slow motion being performed by the first virtual object 502.

[0157] In an embodiment of the present application, the electronic device can also generate teaching guidance information, which can be text information and / or voice information, so that during the playback of the second video, the teaching guidance information can be displayed and / or played, which can better prompt the user how to learn the actions in the second video, thereby speeding up the user's learning efficiency and improving the user experience.

[0158] Optionally, in some embodiments, the first teaching guidance information includes voice information, and when the electronic device generates the first teaching guidance information, it can also determine the timbre of the voice information when it is played.

[0159] The embodiment of the present application does not limit the method for the electronic device to determine the timbre when playing voice information, and several possible implementation methods are introduced as examples below.

[0160] In a possible implementation, the electronic device can determine the timbre when playing the voice information in response to the user's operation of selecting the timbre.

[0161] For example, Figure 6 As shown, before generating the second video, the electronic device may display an option box 601, which includes multiple timbre options (timbre option 602 for star #1, timbre option 603 for star #2, and timbre option 604 for the robot). In response to the user selecting timbre option 602 for star #1, the electronic device may determine that the timbre of star #1 is the timbre for playing the voice information.

[0162] In a possible implementation, the electronic device may determine the timbre when playing the voice information according to the target object.

[0163] For example, if the target object is male, the electronic device can play the voice information in a male's voice.

[0164] For another example, the target object is star #1, and the electronic device can identify the target object as star #1 based on face recognition technology, and then play the voice information in the tone of star #1.

[0165] In the embodiment of the present application, the electronic device can also determine the timbre of the teaching guidance information played, which can better meet the user's expectations, thereby accelerating the user's learning efficiency and improving the user's experience.

[0166] As described above, the first decomposed slow motion set of N actions is generated according to the beat of the first audio. When the user changes the new audio, the electronic device can generate a new decomposed slow motion. Figure 7 Make an introduction.

[0167] Figure 7A schematic flow chart of a method for generating a teaching video provided in an embodiment of the present application is shown, Figure 7 As shown, the method 300 also includes:

[0168] S309: Acquire the second audio.

[0169] Exemplarily, the electronic device may obtain the second audio in response to a user uploading operation of the second audio.

[0170] Exemplarily, the electronic device may receive the second audio sent by other electronic devices.

[0171] S310: Generate a second decomposed slow-motion set of N actions according to the motion trajectories of the N actions and the second audio.

[0172] S311 , generating a third video according to the first virtual object and the second decomposed slow-motion set of N actions.

[0173] It should be understood that for the description of step 310 and step 311, please refer to the above, and for the sake of brevity, they will not be repeated here.

[0174] It is understandable that, since the second decomposed slow-motion set of N actions is generated according to the beat of the second audio, the first virtual object may be different in the first decomposed slow-motion set of N actions and the second decomposed slow-motion set of N actions. In other words, since the first virtual object may be different in the first decomposed slow-motion set of N actions and the second decomposed slow-motion set of N actions, the duration of the third video and the second video may be different.

[0175] For example, the tempo of the first audio is 60 beats per second, and the duration of the second video may be 10 minutes.

[0176] For another example, the tempo of the second audio is 120 beats per second, and the duration of the third video may be 8 minutes.

[0177] In an embodiment of the present application, the electronic device can also obtain a second audio and generate a third video based on the second audio, so that teaching videos with different beats can be generated based on a set of actions of the target object, which can improve the efficiency of generating teaching videos and help improve the user experience.

[0178] Figure 8 A schematic flow chart of a method for generating a teaching video provided in an embodiment of the present application is shown, Figure 8 Said method 300 further comprises:

[0179] S312, play the second video.

[0180] After the electronic device generates the second video, it can play the second video.

[0181] S313, obtaining the user's action when playing the second video.

[0182] When the electronic device plays the second video, the user will refer to the decomposed slow motion in the second video for learning, so the electronic device can obtain the user's movements through sensors such as cameras.

[0183] S314: Determine a second virtual object.

[0184] S315: Use the second virtual object to display the user's action.

[0185] The electronic device can determine a second virtual object and use the second virtual object to display the user's actions, so that the user can check in real time whether his or her actions are standard.

[0186] The electronic device may determine the second virtual object in the following possible implementations:

[0187] In a possible implementation manner, the electronic device is pre-set with one or more virtual objects, and the electronic device can determine the second virtual object according to the pre-set one or more virtual objects.

[0188] For example, the electronic device is pre-set with four virtual objects, namely virtual object #1, virtual object #2, virtual object #3 and virtual object #4, where the gender of virtual object #1 and virtual object #2 is male, and the gender of virtual object #3 and virtual object #4 is female. When the user is a male, the electronic device can determine one of virtual object #1 and virtual object #2 as the second virtual object.

[0189] In a possible implementation, the electronic device determines the first virtual object according to the user. The electronic device can generate the second virtual object using skinning technology according to the skeleton key points of the user. It is understandable that when the electronic device determines the second virtual object according to the user, the image of the second virtual object is the same or similar to the image of the user.

[0190] In some embodiments, the second virtual object generated by the electronic device includes a front side and a back side, so as to better display each action.

[0191] In an embodiment of the present application, when playing the second video, the electronic device can also obtain the user's actions and generate a second virtual object to display the user's actions, so that the user can watch his or her own actions in real time, which helps to promptly discover problems with the actions and correct them, and can improve the user's learning efficiency and user experience.

[0192] In some embodiments, the method 300 further includes:

[0193] S316, determining action correction information according to the user's action and the N actions.

[0194] The electronic device may compare the motion of the user with the N motions of the target object, and thus may determine motion correction information according to the difference between the motion of the user and the N motions of the target object.

[0195] S317: outputting motion correction information when playing the second video.

[0196] After the electronic device determines the motion correction information, it can output the motion correction information when playing the second video so that the user can better adjust the motion.

[0197] In a possible implementation, the action correction information is text information, and the electronic device can display the text information when playing the second video.

[0198] For example, Fig. 9 As shown in (a) of FIG. 1 , the electronic device displays an interface 901, which is an interface of the second video. The interface 901 includes a first virtual object 902 and a second virtual object 903. The first virtual object 902 is showing an action of putting both hands in line with the shoulders, and the second virtual object 903 is showing the user's action. Since the user's action fails to put both hands in line with the shoulders, the electronic device may display a text message 904: "Please adjust both hands to be in line with the shoulders."

[0199] In a possible implementation, the action correction information is voice information, and the electronic device can also play the voice information when playing the second video.

[0200] For example, Fig. 9 As shown in (b) of FIG. 1 , the electronic device displays an interface 901, which is an interface of the second video. The interface 901 includes a first virtual object 902 and a second virtual object 903. The first virtual object 902 is showing an action of putting both hands in line with the shoulders, and the second virtual object 903 is showing the user's action. Since the user's action fails to put both hands in line with the shoulders, the electronic device can play a voice message 905: "Please adjust both hands to be in line with the shoulders."

[0201] In a possible implementation, the action correction information is voice information and text information, and the electronic device can also display the text information and play the voice information when playing the second video.

[0202] For example, Fig. 9As shown in (c) of FIG. 1 , the electronic device displays an interface 901, which is an interface of the second video. The interface 901 includes a first virtual object 902 and a second virtual object 903. The first virtual object 902 is showing an action of putting both hands in line with the shoulders, and the second virtual object 903 is showing the user's action. Since the user's action fails to put both hands in line with the shoulders, the electronic device can play a text message 904: "Please adjust both hands to be in line with the shoulders", and play a voice message 905: "Please adjust both hands to be in line with the shoulders".

[0203] In an embodiment of the present application, the electronic device can also generate action correction information, which can be text information and / or voice information, so that during the playback of the second video, the action correction information can be displayed and / or played, which can better correct the user's mistakes, speed up the user's learning efficiency, and enhance the user experience.

[0204] In some embodiments, the method 300 further includes:

[0205] S318: After playing the second video, determine action evaluation information according to the user's action and the N actions.

[0206] S319, output action evaluation information.

[0207] After playing the second video, the electronic device can determine action evaluation information according to the user's action and the N actions, and then output the action evaluation information.

[0208] The action evaluation information may include a score and / or a comment on the user's action. The action evaluation information may be text information or voice information.

[0209] In a possible implementation, the action evaluation information is text information, and the electronic device can display the text information after playing the second video.

[0210] For example, Fig.10 As shown in (a) in the figure, the electronic device displays text information 1001: "The action score is 90 points, mainly because the toe butterfly step is not standard."

[0211] In a possible implementation, the action evaluation information is voice information, and the electronic device can also play the voice information after playing the second video.

[0212] For example, Fig.10 As shown in (b), after playing the second video, the electronic device can play a voice message 1002: "The action score is 90 points, mainly because the toe butterfly step is not standard."

[0213] In a possible implementation, the action evaluation information is voice information and text information, and the electronic device can also display the text information and play the voice information after playing the second video.

[0214] For example, Fig.10 As shown in (c) , the electronic device displays text information 1001: "The action score is 90 points, mainly because the toe butterfly step is not standard", and plays voice information 1002: "The action score is 90 points, mainly because the toe butterfly step is not standard".

[0215] In an embodiment of the present application, the electronic device can also generate action evaluation information based on the user's actions and the actions of the target object after playing the second video. The action evaluation information can be text information and / or voice information, so as to systematically summarize the mistakes of the user's actions, speed up the user's learning efficiency, and enhance the user's experience.

[0216] The above mainly introduces a method for generating teaching videos provided by an embodiment of the present application from the perspective of an electronic device. It is understandable that, in order to realize the above functions, the electronic device includes a hardware structure and / or software module corresponding to each function. Those skilled in the art should easily realize that, in combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present application.

[0217] The embodiment of the present application can divide the processor in the electronic device into functional modules (or units) according to the above method example. For example, each functional module (or unit) can be divided corresponding to each function, or two or more functions can be integrated into one processing module (or unit). The above-mentioned integrated module (or unit) can be implemented in the form of hardware or in the form of software functional modules (or units). It should be noted that the division of modules (or units) in the embodiment of the present application is schematic, which is only a logical function division, and there may be other division methods in actual implementation.

[0218] In the case where each functional module (or unit) is divided according to each function, Fig.11 A schematic diagram of the composition of an electronic device 1100 provided in an embodiment of the present application is shown. Fig.11 As shown, the electronic device 1100 includes: an acquisition module 1110 and a processing module 1120 .

[0219] The acquisition module 1110 is used to acquire a first video, where the first video includes a first audio,

[0220] The processing module 1120 is used to identify the target object in the first video, N actions of the target object, and joint coordinates corresponding to the N actions, where N≥1.

[0221] The processing module 1120 is further configured to determine motion trajectories of the N actions according to the N actions and the joint coordinates corresponding to the N actions.

[0222] The processing module 1120 is further configured to generate a first decomposed slow-motion set of N actions according to the motion trajectories of the N actions and the first audio.

[0223] The processing module 1120 is further configured to determine a first virtual object.

[0224] The processing module 1120 is further configured to generate a second video according to the first virtual object and the first decomposed slow-motion set of N actions.

[0225] In some embodiments, the processing module 1120 is further configured to generate first teaching guidance information according to a first decomposed slow motion set of N actions;

[0226] The processing module 1120 is specifically configured to generate a second video according to the first virtual object, the first decomposed slow-motion set of N actions, and the first teaching guidance information.

[0227] In some embodiments, the first teaching guidance information includes text information and / or voice information.

[0228] In some embodiments, the first teaching guidance information includes the voice information, and the processing module 1120 is further used to determine the timbre when playing the voice information;

[0229] The processing module 1120 is specifically configured to generate first teaching guidance information according to the first decomposed slow motion set and timbre of the N actions.

[0230] In some embodiments, the acquisition module 1110 is further configured to acquire a second audio;

[0231] The processing module 1120 is further configured to generate a second decomposed slow-motion set of N actions according to the motion trajectories of the N actions and the second audio.

[0232] The processing module 1120 is further configured to generate a third video according to the first virtual object and the second decomposed slow-motion set of N actions.

[0233] In some embodiments, the processing module 1120 is further configured to play the second video;

[0234] The processing module 1120 is further used to obtain the user's action when playing the second video;

[0235] The processing module 1120 is further used to determine a second virtual object;

[0236] The processing module 1120 is further configured to display the user's actions using the second virtual object.

[0237] In some embodiments, the processing module 1120 is further used to determine action correction information according to the user's action and the N actions;

[0238] The processing module 1120 is further configured to output motion correction information when playing the second video.

[0239] In some embodiments, the processing module 1120 is further configured to determine action evaluation information according to the user's action and the N actions after playing the second video;

[0240] The processing module 1120 is further configured to output action evaluation information.

[0241] In some embodiments, the processing module 1120 is further used to identify the type of the first video;

[0242] The processing module 1120 is specifically configured to identify, according to the type of the first video, a target object in the first video, N actions of the target object, and joint coordinates corresponding to the N actions.

[0243] In some embodiments, the duration of the first video is less than the duration of the second video.

[0244] The embodiment of the present application provides a computer program product, when the computer program product is run on an electronic device, the electronic device executes the technical solution in the above embodiment. Its implementation principle and technical effect are similar to those of the above method-related embodiments, and will not be repeated here.

[0245] The embodiment of the present application provides a readable storage medium, the readable storage medium contains instructions, when the instructions are executed in an electronic device, the electronic device executes the technical solution of the above embodiment. The implementation principle and technical effect are similar, and will not be repeated here.

[0246] The embodiment of the present application provides a chip, the chip is used to execute instructions, when the chip is running, the technical solution in the above embodiment is executed. The implementation principle and technical effect are similar, and will not be repeated here.

[0247] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the embodiments of the present application.

[0248] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0249] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0250] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0251] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0252] If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0253] The above is only a specific implementation of the embodiment of the present application, but the protection scope of the embodiment of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or replacements within the technical scope disclosed in the embodiment of the present application, which should be included in the protection scope of the embodiment of the present application. Therefore, the protection scope of the embodiment of the present application should be based on the protection scope of the claims.

Claims

1. A method for generating a teaching video, characterized in that: The method comprises: Acquire a first video, where the first video includes a first audio; Identify a target object in the first video, N actions of the target object, and joint coordinates corresponding to the N actions, where N≥1; Determine the motion trajectories of the N actions according to the N actions and the joint coordinates corresponding to the N actions; Generate a first decomposed slow-motion set of the N actions according to the motion trajectories of the N actions and the first audio; determining a first virtual object; A second video is generated according to the first virtual object and a first decomposed slow-motion set of the N actions.

2. The method according to claim 1, characterized in that The method further comprises: Generate first teaching guidance information according to a first decomposed slow motion set of the N actions; The generating a second video according to the first virtual object and the first decomposed slow motion set of the N actions comprises: A second video is generated according to the first virtual object, the first decomposed slow-motion set of the N actions, and the first teaching guidance information.

3. The method according to claim 2, characterized in that The first teaching guidance information includes text information and / or voice information.

4. The method according to claim 3, characterized in that The first teaching guidance information includes the voice information, and the method further includes: Determining the timbre when playing the voice information; The generating first teaching guidance information according to the first decomposed slow motion set of the N actions includes: The first teaching guidance information is generated according to the first decomposed slow motion set of the N actions and the timbre.

5. The method according to any one of claims 1 to 4, characterized in that The method further comprises: Get the second audio; Generate a second decomposed slow-motion set of the N actions according to the motion trajectories of the N actions and the second audio; A third video is generated according to the first virtual object and a second decomposed slow-motion set of the N actions.

6. The method according to any one of claims 1 to 5, characterized in that The method further comprises: Play the second video; Acquiring a user's action when playing the second video; determining a second virtual object; The user's action is displayed using the second virtual object.

7. The method according to claim 6, characterized in that The method further comprises: Determining action correction information according to the user's action and the N actions; When playing the second video, the motion correction information is output.

8. The method according to claim 6 or 7, characterized in that: The method further comprises: After playing the second video, determining action evaluation information according to the user's action and the N actions; The action evaluation information is output.

9. The method according to any one of claims 1 to 8, characterized in that Before identifying the target object in the first video, N actions of the target object, and joint coordinates corresponding to the N actions, the method further includes: identifying a type of the first video; The identifying the target object in the first video, N actions of the target object, and joint coordinates corresponding to the N actions includes: According to the type of the first video, a target object in the first video, N actions of the target object, and joint coordinates corresponding to the N actions are identified.

10. The method according to any one of claims 1 to 9, characterized in that The duration of the first video is shorter than the duration of the second video.

11. An electronic device, characterized in that: The method comprises one or more processors; one or more memories; one or more screens; the one or more memories storing one or more computer programs, the one or more computer programs comprising instructions, and when the instructions are executed by the one or more processors, the method as claimed in any one of claims 1 to 10 is executed.

12. A chip, characterized in that: The chip includes a processor and a communication interface, wherein the communication interface is used to receive a signal and transmit the signal to the processor, and the processor processes the signal so that the method according to any one of claims 1 to 10 is executed.

13. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and when the computer instructions are executed on a computer, the method according to any one of claims 1 to 10 is executed.

Images