Method and device for providing sports instruction video

Abstract

A method and device for providing a sports instruction video are disclosed. The method receives the number of group actions twice or more and generates a video including group actions corresponding to the number based on reverse playback of a portion of an original video including a group action.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to and the benefit of Korean Patent Application No. 10-2021-0190358, filed on December 28, 2021, and Korean Patent Application No. 10-2022-0056881, filed on May 9, 2022, which are hereby incorporated by reference for all purposes as if fully set forth herein. Technical Field

[0003] The present disclosure relates to a method and a device for providing a sports instruction video. Background Art

[0004] Recently, work-life balance, which represents the balance between work and personal life, has attracted attention, and consumption for personal life such as sports after get off work, on weekends or in leisure time is increasing. As a work-life balance, users' desire to manage their own health is increasing, and in order to improve the quality of life with little time investment, more and more users are doing various sports such as swimming, fitness, personal training, golf, and Pilates.

[0005] As the number of users who exercise increases, the desire to exercise with a correct posture also increases, and therefore, images for providing exercise guidance are provided. The exercise guidance image is an image in which an instructor or coach performs aerobic movements, yoga movements, or fitness exercises, and the user can exercise according to the movements of the instructor shown in the exercise guidance video.

[0006] However, existing motion guidance images only guide motion in time units and do not selectively guide each user. Summary of the invention

[0007] The present disclosure provides a method and a device for providing a sports instruction video for each level of users.

[0008] The present invention provides a method and a device for providing a sports guidance video based on reverse playback.

[0009] The present disclosure provides a method for providing an exercise instruction video based on a user's actions, and a device thereof.

[0010] In a method for providing an exercise instruction video including repeated actions according to one aspect of the present invention, the method includes receiving the number of group actions two or more times; and generating a video including group actions corresponding to the number based on reverse playback of a portion of an interval in an original video including a group action.

[0011] In addition, the original video may include a first interval showing a first action; and a second interval showing a second action opposite to the first action.

[0012] In addition, the step of generating a video may include at least one of the following steps: a first step, in which the first interval is played in reverse after the first interval is played; and a second step, in which the second interval is played after the second interval is played in reverse.

[0013] Furthermore, at least one of the first step and the second step may be repeatedly performed in response to the number of times of the set of actions.

[0014] In addition, the sum of the repetition times of the first step and the second step may be less than the number of the group actions.

[0015] Furthermore, the sum of the number of repetitions of the first step and the second step may be less than once the number of the group of actions.

[0016] In addition, the method may further include a third step, in which the first interval and the second interval are played sequentially.

[0017] Furthermore, the original video may further include: a third interval showing a preparation action; and a fourth interval showing a completion action.

[0018] Additionally, the method may further include displaying the generated video.

[0019] Furthermore, the generated video can be displayed on a mirror display.

[0020] In an apparatus for providing an exercise instruction video including repeated movements according to one embodiment, the apparatus comprises: a memory storing an original video including a group movement performed once; and a processor reading the original video from the memory and generating a video including the group movement corresponding to the number of times based on reverse playback of a portion of the original video.

[0021] In addition, the original video may include a first interval showing a first action; and a second interval showing a second action opposite to the first action.

[0022] In addition, the processor may perform at least one of the following steps: a first step, in which the first interval is played in reverse after the first interval is played; and a second step, in which the second interval is played after the second interval is played in reverse.

[0023] Furthermore, the processor may repeatedly execute at least one of the first step and the second step in response to a number of times of the set of actions.

[0024] In addition, the processor may repeatedly execute at least one of the first step and the second step to be less than the number of times of the set of actions.

[0025] And, the apparatus may further include a display which displays the generated video. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 The figure schematically shows a sports machine management system according to an embodiment.

[0027] Figure 2 FIG. 4 is a block diagram showing a management server according to an embodiment.

[0028] Figure 3 FIG. 1 is a block diagram showing a sports machine according to an embodiment.

[0029] Figure 4 is a block diagram of a mirror display according to an embodiment.

[0030] Figure 5 The flowchart is a method for providing an exercise instruction video according to an embodiment.

[0031] Figure 6 A diagram showing an original video composed of a group action according to an embodiment.

[0032] Figure 7 A reference diagram for explaining a method for generating an exercise instruction video including a plurality of group movements according to an embodiment.

[0033] Figure 8 A reference diagram for explaining a method for generating an exercise instruction video including a plurality of group movements according to another embodiment.

[0034] Fig. 9 A reference diagram for explaining a method of providing a video including a plurality of group actions as a comparative example.

[0035] Fig.10 A diagram showing an original video including a plurality of group actions according to an embodiment.

[0036] Fig.11 A reference diagram is provided for explaining a method of providing an exercise guidance video by using one group interval among a plurality of group intervals according to an embodiment.

[0037] Fig.12 A reference diagram for explaining providing a motion guidance video by using a plurality of group intervals according to an embodiment.

[0038] Fig.13A diagram illustrating an original video including group actions of different types from each other according to an embodiment.

[0039] Fig.14 A reference diagram for explaining a method for generating an exercise instruction video including repeated exercises according to an embodiment.

[0040] Fig.15 A reference diagram for explaining a method for generating an exercise instruction video including repeated exercises according to another embodiment.

[0041] Fig.16 The flowchart is a method for providing a sports instruction video based on user actions according to an embodiment of the present invention.

[0042] Fig.17 A reference diagram for explaining a method of providing an exercise guidance video when a user's posture is ahead of a reference posture according to an embodiment.

[0043] Fig.18 A reference diagram for explaining a method of providing an exercise guidance video when a user's posture lags behind a reference posture according to an embodiment.

[0044] Fig.19 A reference diagram for explaining a method of providing an exercise guidance video when a user's posture lags behind a reference posture according to another embodiment.

[0045] Fig. 20 A reference diagram for explaining a method of displaying a role referring to a user according to an embodiment.

[0046] Fig.21 A reference diagram for explaining a method for expressing motion effects using a character according to an embodiment. DETAILED DESCRIPTION

[0047] The terms used in the present invention are selected as much as possible from the currently widely used general terms while considering the functions of the present invention, but this may be different according to the intention of those skilled in the art or precedents, the emergence of new technologies, etc. In addition, in certain cases, there are terms arbitrarily selected by the applicant, in which case, their meanings will be explained in detail in the specification of the corresponding invention. Therefore, the terms used in the present invention should be defined according to the meaning of the terms and the overall content of the present invention, rather than according to simple term names.

[0048] Terms such as first, second, etc. may be used to describe various components, but the components should not be limited by the terms. These terms are only used to distinguish one component from another.

[0049] Figure 1 FIG. 1 is a diagram schematically showing a sports machine management system 1 according to an embodiment. Figure 1The sports machine management system 1 may include a management server 10 connected to a network, a sports machine 20, a mirror display 30, a user terminal 40, and an administrator terminal 50. In addition, the sports machine management system 1 may also include a payment server and a content server associated with the management server 10, etc.

[0050] The network can be implemented by various types of wired / wireless networks, such as a local area network (LAN), a wide area network (WAN), a value added network (VAN), a personal area network (PAN), a mobile radio communication network, or a satellite communication network.

[0051] The management server 10 can be connected to the sports machine 20, the mirror display 30, the user terminal 40, and the administrator terminal 50 through the network to send and receive data, and according to the request of the administrator terminal 50, store the user's exercise schedule and sports item list, etc., store the user's exercise results of the information received from the user terminal 40 or the sports machine 20, etc., and provide the above-mentioned exercise structure to the administrator terminal 50 or the user terminal 40 according to the request of the administrator terminal 50 or the user terminal 40.

[0052] In addition, according to the request of the user terminal 40, the management server 10 can control the exercise machine 20 in the fitness center or the like or use the exercise results received from the exercise machine 20 to generate calorie information or the like corresponding to the exercise history and exercise results.

[0053] The management server 10 may be an operation server of an Internet site. In the management server 10, a dedicated application (App) and / or a network (Web) program connected to the sports machine 20, the mirror display 30, the user terminal 40, and the user terminal 50 may be operated, or a function supporting the dedicated application and / or the network program may be executed. In addition, the management server 10 may also execute a function supporting an interface necessary for building an application such as an application programming interface (Application Programming Interface) on the web / app, thereby driving an application for realizing a content platform for a digital information display.

[0054] The exercise machine 20 may include an exercise body that is implemented as a weight training machine or a treadmill, etc. and moves according to the movement of the user. In addition, the exercise machine 20 may provide exercise guidance to the user under the control of the management server 10 and send the user's exercise results to the management server 10. The exercise machine 20 may be set to various modes under the operation of the user or the control of the management server 10.

[0055] The user terminal 40 is a terminal registered with the management server 10 to receive sports management services. It is a terminal that accesses the management server 10, access terminals, and sports machines 20, etc. through a wired or wireless network to send and receive data. The user terminal 40 can be a smart phone, a personal computer (PC), a tablet PC, a laptop, a smart TV (TV), a mobile phone, a personal digital assistant (PDA), a laptop, a media player, a global positioning system (GPS) device, an e-book terminal, a digital broadcast terminal, a navigation, a digital camera, a wearable device, other mobile and non-mobile computing devices, and a smart bracelet, but the present disclosure is not limited to this. Here, the user terminal 40 can refer not only to a terminal owned by a user who receives sports management services, but also to any terminal that a registered user can access the management server 10 and log in.

[0056] The manager terminal 50 is a terminal registered in the management server 10 for providing sports management services, and is a terminal that can access the management server 10 through a wired or wireless network to send and receive data. The manager terminal 50 can be a smart phone, PC, tablet PC, notebook computer, smart TV, mobile phone, PDA, laptop computer, media player, GPS device, e-book terminal, digital broadcast terminal, navigation, digital camera, wearable device, other mobile and non-mobile computing devices, but the present disclosure is not limited thereto. Here, the manager terminal 50 refers not only to a terminal owned by a person registered as a manager in the management server 10, but also to any terminal that a registered manager can access the management server 10 and log in.

[0057] Figure 2 FIG. 1 is a block diagram showing a management server 10 according to an embodiment. Figure 2The management server 10 may include a first communication unit 110 that communicates with external terminals such as an access terminal, an exercise machine 20, a mirror display 30, a user terminal 40, and an administrator terminal 50 through a network; a database 120 that stores information about a user's exercise plan, a user's exercise history, a room list of a fitness center, and a mode of the exercise machine 20; a first user interface 130 that receives a command from a user such as an administrator who manages the management server 10; a first output unit 140 that displays or notifies the state of the fitness center; and a first processor 150 that performs the overall functions of the management server 10. The first processor 150 may generate a user's exercise plan or a use state of the fitness center according to a request of the administrator terminal 50, and set the mode of the exercise machine 20.

[0058] Although not shown in the drawings, the access terminal, the manager terminal 50 and the user terminal 40 may further include a communication unit, a storage unit, a user interface, a processor and the like.

[0059] Figure 3 2 is a block diagram showing an exercise machine 20 according to an embodiment. The exercise machine 20 according to an embodiment may be an aerobic exercise machine or an anaerobic exercise machine, for example, the exercise machine 20 may be an aerobic exercise machine such as a treadmill, a bicycle, an elliptical machine, and a stair exercise machine, or may be an anaerobic exercise machine such as a seated chest press trainer, a seated shoulder press trainer, an arm curl high pull trainer, a seated rowing back pull trainer, a assisted pull-up trainer, a leg curl trainer, a seated leg extension trainer, a reverse kick trainer, an inner thigh trainer, an outer thigh trainer, a total hip joint trainer, a back muscle extension trainer, an abdominal trainer, and the like.

[0060] The sports machine 20 may include a sports body 210 , a sensor 220 , a second communication unit 230 , a first memory 240 , a second user interface 250 , a second output unit 270 , and a second processor 280 .

[0061] The exercise body 210 is a physical exercise machine that moves according to the movement of the user. The exercise body 210 according to an embodiment can increase, decrease or maintain a load according to a set exercise level. The exercise body 210 can vary according to the type of the exercise machine 20.

[0062] The sensor 220 may sense the movement of components included in the moving body 210 and transmit the result thereof to the second processor 280. The sensor 220 may include a laser sensor, a motion sensor, a gyro sensor, and the like.

[0063] The second communication unit 230 can communicate with external machines, such as the management server 10, the access terminal, another sports machine 20, the user terminal 40, and the administrator terminal 50. The second communication unit 230 can communicate with the management server 10 through various wired and wireless networks, such as LAN, WAN, VAN, PAN, mobile communication network, or satellite communication network. In addition, the second communication unit 230 can communicate with the access terminal, the user terminal 40, and the administrator terminal 50 through a local area network such as a LAN, PAN, etc. Therefore, the sports machine 20 can be prevented from being controlled by an external machine other than the management server 10. However, the present disclosure is not limited to this. Depending on the situation, the second communication unit 230 can also communicate with the administrator terminal 50 over a long distance.

[0064] The memory 240 may store various information used by at least one component (e.g., the second processor 280 or the sensor 220) included in the exercise machine 20. The information may include, for example, input data or output data of software (e.g., a program) and commands related thereto. The memory 240 may include a volatile memory or a non-volatile memory. For example, the memory 240 may include an adjustment range of motion or a threshold range of motion predetermined according to user information.

[0065] The second user interface 250 may receive commands or data to be used in the exercise machine 20 from the outside of the exercise machine 20 (e.g., a user). The second user interface 250 may include, for example, a microphone, a mouse, a keyboard, an electronic tag, or a digital pen (e.g., a stylus). For example, the user may input user information through the second user interface 250. For example, the user information may include one or more of the user's name, age, gender, height, weight, and exercise history.

[0066] The second output unit 270 may provide output information. The output information according to an embodiment may be user information, user motion information, or information for guiding user motion. For example, the second output unit 270 may include a display for displaying the output information. In addition, the second output unit 270 may be physically or electrically connected to the moving body 210. For example, the display may be mounted on a frame structure of the moving body 210. However, the present disclosure is not limited thereto. Although the display is arranged to be spaced apart from the moving body 210 by including a communication unit, the display may be connected to the moving body 210 to receive a predetermined signal.

[0067] The second processor 280 may control the sports machine 20 as a whole, and may control the second communication unit 230 to enable communication with an external machine. The second processor 280 may, for example, execute software (e.g., a program) to control at least one other component (e.g., a hardware or software component) connected to the second processor 280, and may perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operation, the second processor 280 may load a command or data received from another component (e.g., the sensor 220 or the second communication unit 230) into a volatile memory in the memory 240, process the command or data stored in the volatile memory, and store the result data in a non-volatile memory in the memory 240.

[0068] Figure 4 : is a block diagram of a mirror display 30 according to an embodiment. The mirror display 30 is a device that can provide one or more of a mirror function and a display function according to the needs of the user. A film (not shown) with a polarizing function is also provided on the mirror display 30, which can be understood as including a known device that can perform the functions of a display and a mirror at the same time by reflecting specific light (e.g., light corresponding to a user's gesture) and transmitting specific light (e.g., light corresponding to an image output from the display).

[0069] The mirror display 30 may include a third communication unit 310 , a second memory 320 , a third user interface 330 , a display 340 , a mirror 350 , and a third processor 360 .

[0070] The third communication unit 310 can communicate with external machines, such as the management server 10, the user terminal 40, and the administrator terminal 50. The third communication unit 310 can communicate with the management server 10 through various wired and wireless networks, such as LAN, WAN, VAN, PAN, mobile communication network, or satellite communication network. In addition, the third communication unit 310 can communicate with the user terminal 40 and the administrator terminal 50 through a local area network such as a LAN, PAN, etc. Therefore, the mirror display 30 can be prevented from being controlled by an external machine other than the management server 10. However, the present disclosure is not limited thereto. Depending on the situation, the third communication unit 310 can also communicate with the administrator terminal 50 over a long distance.

[0071] The second memory 320 may store various information used by at least one component (e.g., the third processor 360) included in the mirror display 30. The information may include, for example, software (e.g., a program) and input data or output data of commands related thereto. The second memory 320 may include a volatile memory or a non-volatile memory. For example, the second memory 320 may pre-store an original video that can be used to generate a motion guidance video.

[0072] The third user interface 330 may receive various user commands. For example, the third user interface 330 may receive a user command for playing a sports instruction video that may be displayed by the mirror display 30. The user may input the sports item and the number of sets, etc., for which the sports instruction video is to be played through the third user interface 330.

[0073] The display 340 may display the exercise instruction video under the control of the third processor 360. The display 340 may be implemented with a liquid crystal display (LCD), an organic light emitting diode (OLED), etc., and may further include a touch screen to serve as the third user interface 330.

[0074] In addition, the mirror 350 may be provided on at least a partial area in the front surface of the display 340. The mirror 350 may include a film that reflects light incident from the outside and transmits light incident on the display 340, such as a polarizing film.

[0075] The third processor 360 may control the mirror display 30 as a whole, and may control the third communication unit 310 to be able to communicate with an external machine. The third processor 360 may, for example, execute software (e.g., a program) to control at least one other component (e.g., a hardware or software component) connected to the third processor 360, and may perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operation, the third processor 360 may load a command or data received from another component (e.g., the third communication unit 310 or the third user interface 330) into a volatile memory in the second memory 320, process the command or data stored in the volatile memory, and store the result data in a non-volatile second memory in the memory 320. For example, the third processor 360 may store an original video including a group action received from a server, etc., in the second memory 320.

[0076] The original video may be divided into a plurality of intervals. Specifically, the original video may be divided into a preparation interval R indicating a preparation action, an end interval E indicating an end action, and a group interval S in which the action may be repeated. For example, when the original video is a video including a squat exercise as an example of a group action, the original video may be divided into a preparation interval R indicating an action of preparing for the squat exercise, an end interval E indicating an action of ending the squat exercise, and a group interval S in which the squat exercise may be repeated, in other words, a group interval S indicating an action of squatting and standing up.

[0077] The group interval S may be divided into two sub-intervals based on an inflection point (e.g., a point at which the direction of the action is changed). When the group interval S is an interval indicating a squat action, based on the squat point of the squat action, the group interval S may be divided into a first interval indicating a squat action and a second interval indicating a stand-up action. When the first interval indicating a squat action is referred to as a forward direction interval F, the stand-up action is the reverse action of the squat action, and therefore, the second interval indicating the stand-up action may be referred to as a reverse direction interval B.

[0078] The third processor 360 may receive and store the original video divided into a plurality of intervals from the outside, such as a server. However, the present disclosure is not limited thereto. The third processor 360 may divide and store the received original video into a plurality of intervals as described above. Alternatively, when a request to play a motion guidance video is received through a user command or the like after storing the original video, the third processor 360 may generate a motion guidance video after dividing the original video into a plurality of intervals.

[0079] The mirror display 30 may further include a motion sensing sensor 370. The motion sensing sensor 370 is a device for obtaining the movement of the user, and may include a visual camera, a visual sensor, an acceleration sensor, a gyro sensor, a geomagnetic sensor, an infrared sensor, and the like.

[0080] The motion sensing sensor 370 can extract the area corresponding to the user's joint from the sensed data to obtain the coordinate data and speed data of the joint.

[0081] Despite Figure 4 The motion sensing sensor 370 is described as a component of the mirror display 30 in FIG. 1 , but is not limited thereto. The motion sensing sensor 370 may be a separate device. Alternatively, a camera of a user terminal may perform the function of the motion sensing sensor.

[0082] Figure 5 The flowchart is a method for providing an exercise instruction video according to an embodiment.

[0083] The third processor 360 may receive a play command of a sports instruction video including the number of group actions from the third communication unit 310 or the third user interface 330, etc. (S410). When the user enters a certain distance from the mirror display 30, the mirror display 30 may change from a standby mode to an operating mode. In addition, the mirror display 30 may request a sports item to be played from a user terminal carried by the user, etc. The user terminal may request to play the sports instruction video of the sports item by sending the pre-stored sports item and the number of group actions of the sports item to the mirror display 30. Alternatively, the user may input the sports item and the number of group actions through the third user interface of the mirror display 30, thereby inputting a play command of the sports instruction video.

[0084] The third processor 360 may generate a motion guidance video including a group action corresponding to the number of times based on the reverse playback of a portion of the original video (S420). The third processor 360 may generate a video corresponding to the group action by playing or reversely playing a portion of the original video. As the number of steps of playing or reversely playing a portion of the original video increases, the number of group actions included in the generated video may also increase. A specific method for generating a motion guidance video will be described later.

[0085] The third processor 360 may display the generated motion coaching video on the display 340 (S430). The third processor 360 may display the motion coaching video on the display 340 after completing the generation of the motion coaching video, or may display the motion coaching video on the display 340 while generating the motion coaching video. Generating and displaying the motion coaching video may be referred to as playing the motion coaching video.

[0086] Figure 6 FIG. 1 is a diagram showing an original video composed of a group action according to an embodiment. Figure 6 The original video 50 can be divided into a plurality of different intervals. The original video 50 can be divided into a preparation interval R indicating a preparation action, an end interval E indicating an end action, and a group interval S in which the motion action can be repeated.

[0087] Based on the inflection point of the action, that is, the point where the direction of the action is converted, the group interval S may be divided into a forward direction interval F and a reverse direction interval B. For example, the group interval S indicating the action of squatting down and standing up in the squat action may be divided into a forward direction interval F indicating the squatting action from the start point of the group interval S to the squatting point; and a reverse direction interval B indicating the standing up action from the squatting point to the end point of the group interval S. The action included in the forward direction interval F may be opposite to the action included in the reverse direction interval B. For example, the action included in the forward direction interval F may be a squatting action, and the action included in the reverse direction interval B may be a standing up action.

[0088] The time for playing the forward direction interval F and the time for playing the reverse direction interval B may be the same, but not limited thereto. For example, the time for playing the forward direction interval F and the time for playing the reverse direction interval B may be within a 10% error range.

[0089] The posture in the video at the start point of the group interval S and the posture in the video at the end point of the group interval S may be the same. However, the present disclosure is not limited thereto. For example, the posture in the video at the start point of the group interval S and the posture in the video at the end point of the group interval S may be within a 10% error range.

[0090] The original video 50 may be pre-stored in the second memory 320 of the mirror display 30 .

[0091] The third processor 360 can be used by Figure 6 An original video 50 of a group of movements is used to generate a movement guidance video 50a including a plurality of repeated movements, that is, a plurality of group movements.

[0092] Figure 7 A reference diagram for explaining a method of generating an exercise instruction video 50a including a plurality of group movements according to an embodiment.

[0093] When a play command of a motion guidance video including n group movements is received from the third user interface 330 or an external machine, the third processor 360 may read the original video 50 corresponding to the motion guidance video from the second memory 320. The third processor 360 may receive the original video 50 from an external machine, such as the management server 10 and the user terminal 40, so that the original video 50 may be temporarily stored in the second memory 320 and then used.

[0094] As in Figure 6 As described in , the original video 50 may include a plurality of intervals (e.g., preparation interval R, forward interval F, reverse interval B, and end interval E), and the plurality of intervals (e.g., preparation interval R, forward interval F, reverse interval B, and end interval E) may be divided by marks or the like. However, the present disclosure is not limited thereto. When the original video 50 is not divided into a plurality of intervals (e.g., preparation interval R, forward interval F, reverse interval B, and end interval E), as in Figure 6 As described in , the third processor 360 may use markers or the like to divide the original video 50 into a plurality of intervals.

[0095] The third processor 360 may generate a motion guidance video 50 a including n groups of actions based on reverse playback of a portion of the original video 50 .

[0096] like Figure 7As shown, the third processor 360 can play the preparation interval R in the original video 50.

[0097] When playing the group interval S, the third processor 360 may play a portion of the group interval S in reverse. Specifically, since the forward interval F includes the action of squatting, when the forward interval F is played in reverse, the action of standing up may be included. Therefore, when the forward interval F is played in reverse at the inflection point P2 after playing the forward interval F, the third processor 360 may generate the first group interval SE including the actions of squatting and standing up. When the third processor 360 performs the step of playing the forward interval F in reverse after playing the forward interval F for n-1 times, n-1 group intervals SE1, SE2, ... may be generated.

[0098] Furthermore, when the third processor 360 plays the forward direction interval F and the reverse direction interval B in sequence, the nth group interval SE may be generated. n Finally, the third processor 360 may complete the generation of the exercise guidance video 50a by playing the end interval E.

[0099] Figure 8 A reference diagram for explaining a method for generating an exercise instruction video including a plurality of group movements according to another embodiment.

[0100] When receiving a request to play an exercise instruction video including n group movements from the third user interface 330 or an external machine, the third processor 360 may generate an exercise instruction video including n group movements based on reverse playback of a portion of the original video 50 .

[0101] like Figure 8 As shown, the third processor 360 can play the preparation interval R in the original video 50.

[0102] The third processor 360 may generate the first group interval SE1 by playing the forward interval F and the reverse interval B.

[0103] Furthermore, the third processor 360 may generate a second group interval SE2 by playing the reverse direction interval B after playing the reverse direction interval B in reverse. For example, when the reverse direction interval B is a video including a standing up action, a video including a squatting action may be generated by playing the reverse direction interval B in reverse. The third processor 360 may generate n-1 group intervals SE2, ..., SE3 by executing the steps of playing the reverse direction interval B in reverse after playing the reverse direction interval B n-1 times, ..., SE4. n .

[0104] The third processor 360 can complete the generation of the exercise guidance video 50b by playing the completion interval E.

[0105] As described above, the motion instruction video 50a and 50b including multiple group movements can be generated based on the reverse playback of a portion of the original video 50 including one group movement, so the motion instruction video can be generated without interrupting the video. Since the original video indicating one group movement is used, a video can be provided in which the movement is not messed up even if the group movement is repeated. If the motion instruction video including multiple group movements is obtained by shooting, the person repeating the group movement, such as a coach, can have a coaching posture that changes as the group movement is repeated. However, since the number of group movements is increased by repeatedly playing and reversing a portion of the original video, messy movements can be fundamentally prevented.

[0106] In addition, since there is no need to produce and store the original video for each group action, the production cost of the original video can be reduced and the storage capacity of the original video can be reduced.

[0107] Multiple group actions can be implemented by repeatedly playing the group interval in the original video 50 indicating one group action.

[0108] Fig. 9 A reference diagram for explaining a method of providing a video including a plurality of group actions as a comparative example.

[0109] Reference Fig. 9 , the third processor 360 may play the group interval SE1 after playing the preparation interval R in the original video 50. The third processor 360 may repeatedly play the group interval S n times. In other words, when the third processor 360 repeatedly plays the group interval S=SE1 and then reaches the end point P3 of the group interval S=SE1, the third processor 360 may move to the start point P1 of the group interval S and play the group interval S=SE2 again.

[0110] Since repeated playback is performed by moving from the end point P3 of the group interval S to the start point P1 of the group interval S, a phenomenon of interrupted images may occur even in a short period of time. And when the posture in the video of the end point P3 of the group interval S does not match the posture in the video of the start point P1 of the group interval S, the discontinuity of the video may be further aggravated.

[0111] The original video 50 is generally an image obtained by shooting a person's movement process, so the posture at the end point P3 of the group interval S may not completely match the posture at the start point P1 of the group interval S. Therefore, it is expected that interruptions are inevitable in the exercise instruction video generated by repeated playback. Such interruptions can reduce the user's immersion in the exercise.

[0112] According to an embodiment, when the exercise instruction videos 50a and 50b including a plurality of group movements are generated by using the reverse playback of a portion of the original video 50, the start point of the group movement and the end point of the group movement are the same, so there is no interruption phenomenon. Therefore, the user can enhance the immersion in the movement while watching the image.

[0113] Figure 6 The original video 50 is an original video consisting of one group action. However, the present disclosure is not limited thereto. The original video may also be a video including two or more group actions. Generally speaking, a repeated motion may include a plurality of group actions. Therefore, the original video may be composed of a basic number of group actions, and the third processor 360 may generate a motion guidance video including group actions exceeding the basic number based on the reverse playback of a portion of the original video.

[0114] Fig.10 FIG. 6 is a diagram showing an original video 60 including a plurality of group actions according to an embodiment. Fig.10 As shown, the original video 60 may include a basic number of group actions of 2. For example, the group interval S of the original video 60 may include a first group interval S1 and a second group interval S2, wherein the first group interval S1 and the second group interval S2 include the same type of group actions.

[0115] When it is desired to generate an exercise instruction video including group movements exceeding a basic number of times, the third processor 360 may increase the number of group movements by repeatedly playing and reversely playing a portion of the group interval S.

[0116] Fig.11 A reference diagram is provided for explaining a method of providing an exercise guidance video by using one group interval among a plurality of group intervals according to an embodiment.

[0117] like Fig.11 As shown, for example, the third processor 360 can generate the first group interval SE1 by playing and reversely playing the forward interval F1 of the first group interval S1 in the group interval S. The third processor 360 can generate n-2 group intervals by executing the steps of playing and reversely playing the forward interval F1 of the first group interval S1 in the group interval S n-2 times.

[0118] Furthermore, the third processor 360 may play the first group interval S1 and the second group interval S2 of the original video 60 to generate the n-1th group interval SEn-1 and the nth group interval SE N .

[0119] exist Fig.11In the embodiment, although the group interval is increased by playing and reversing the forward interval F1 of the first group interval S1, the present disclosure is not limited thereto. The group interval may be increased by playing and reversing the reverse interval B1 of the first group interval S1. Alternatively, the number of group actions may be increased by playing and reversing the forward interval F2 or the reverse interval B2 of the second group interval S2.

[0120] Alternatively, the third processor 360 may also add a group action by playing and reversely playing a portion of the first group of intervals S1 and a portion of the second group of intervals S2.

[0121] Fig.12 A reference diagram for explaining providing a motion guidance video 60b by using a plurality of group intervals according to an embodiment. The third processor 360 may increase the group intervals by playing and reversing a portion of the first group interval S1 and a portion of the second group interval S2.

[0122] like Fig.12 As shown, the third processor 360 can generate the first group interval SE1 by playing the forward direction interval F1 and the reverse direction interval B1 of the first group interval S1 of the original video 60.

[0123] The third processor 360 generates a second group interval SE2 by playing and playing the forward interval F2 of the second group interval S2 in reverse, and the third processor 360 generates a second group interval SE2 by playing and playing the reverse interval B of the first group interval S1 in reverse. 1 The third processor 360 can generate the third group interval SE3 by repeatedly playing and reversely playing the forward direction interval F2 of the second group interval S2 and reversely playing and playing the reverse direction interval B of the first group interval S1. 1 To generate the intervals from the fourth group to the n-1th group.

[0124] The third processor 360 may generate the nth group interval SE by sequentially playing the forward direction interval F2 and the reverse direction interval B2 of the second group interval S2. n .

[0125] Since the exercise guidance videos 60a and 60b are generated by using the original video 60 including the group motion exceeding the basic number of times, the number of reverse playback times or the reverse playback interval can be diversified.

[0126] The original video includes one type of group action. However, the present disclosure is not limited to this. The original video may include a plurality of group actions of different types. For example, the original video may include a first type of group action that can repeat movement in the right direction, and a second type of group action that can repeat movement in the left direction. The third processor 360 can provide a motion guidance video by using reverse playback of a portion of the original video.

[0127] Fig.13 FIG. 7 is a diagram showing an original video 70 including group actions of different types according to an embodiment. Fig.13 The original video 70 may be divided into a plurality of intervals (eg, a preparation interval R, a group interval S, and an end interval E). The original video 70 may be divided into a preparation interval R indicating a preparation action, an end interval E indicating an end action, and a group interval S where the motion action may be repeated.

[0128] The group interval S may be divided into a plurality of intervals (eg, a first group interval AS and a second group interval BS) based on a point at which the type of the repetitive motion changes. 13 =P 21 It is divided into the first group interval AS and the second group interval BS. For example, the lunge exercise can be divided into the right lunge exercise with the right leg backward, which is the first group interval AS, and the left lunge exercise with the left leg backward, which is the second group interval BS.

[0129] The first group interval AS and the second group interval BS may be divided into forward direction intervals AF and BF and reverse direction intervals AB and BB, respectively, based on the point at which the direction of the action is switched. For example, each of the right lunge exercise and the left lunge exercise may be divided into a forward direction interval indicating the action of squatting down and a reverse direction interval indicating the action of standing up.

[0130] For example, the group interval S of the lunge exercise can be divided into a period from the starting point P1 of the group action to the point P2 where the right knee becomes 90 degrees and the upper body descends. 12 The forward interval AF of the first group interval AS of the action, indicating the point P where the right knee becomes 90 degrees and the upper body descends 12 Until the two knees are straight and the upper body is raised to point P 13＝ P 21 The first type of action of the interval AS of the opposite direction interval AB, represents the point P from which both knees are straightened and the upper body is raised 13＝ P 21 Until the left knee becomes 90 degrees and the upper body drops to point P 22 The forward interval BF of the second group interval BS of the action, and the point P indicating that the left knee becomes 90 degrees and the upper body descends 22Until point P where the knees are straight and the upper body is raised 23 The second type group interval BS of the action is the reverse direction interval BB.

[0131] The time to play the forward interval of each type of group interval and the time to play the reverse interval of the above type of group interval can be the same, but for example, the time to play the forward interval and the time to play the reverse interval can be within a 10% error range.

[0132] The posture in the video at the start point of each type of group interval and the posture in the video at the end point of the group interval of that type may be the same. However, the present disclosure is not limited to this. For example, the posture at the start point of each type of group interval and the posture at the end point of the group interval of that type may be within a 10% error range.

[0133] The third processor 360 can be used by Fig.13 The original video 70 is used to generate an exercise guidance video including multiple group movements.

[0134] Fig.14 2 is a reference diagram for explaining a method of generating an exercise instruction video 70a including repeated exercise movements according to an embodiment.

[0135] When n group movements are requested from the third user interface 330 or an external machine, the third processor 360 may generate a motion guidance video 70 a including n group movements based on reverse playback of a portion of the original video 70 .

[0136] like Fig.14 As shown, the third processor 360 can play the preparation interval R in the original video 70.

[0137] The third processor 360 can sequentially play the forward section AF of the first group section AS, the reverse section AB of the first group section AS, and the forward section BF of the second group section BS, and reversely play the forward section BF of the second group section BS, thereby generating the first group sections ASE1 and BSE1.

[0138] In the case where the original video includes a lunge movement, when the third processor 360 plays the forward direction interval AF of the first group interval AS and the reverse direction interval AB of the first group interval AS, a video of a right lunge movement can be generated. Furthermore, when the third processor 360 plays the forward direction interval BF of the second group interval BS in reverse after playing the forward direction interval BF of the second group interval BS, the third processor 360 can generate a video of a left lunge movement. In other words, the forward direction interval BF of the second group interval BS is a video of the upper body descending while the left knee is bent, and when the forward direction interval BF of the second group interval BS is played in reverse, it can become a video of the upper body rising while the left knee is straightened.

[0139] When the third processor 360 plays the reverse direction interval AB of the first group interval AS in reverse and plays the reverse direction interval AB of the first group interval AS and the forward direction interval BF of the second group interval BS in sequence, and then plays the forward direction interval BF of the second group interval BS in reverse, the second group intervals ASE2 and BSE2 can be generated.

[0140] When the third processor 360 executes the step of reversely playing the reverse direction interval AB of the first type group interval AS and sequentially playing the reverse direction interval AB of the first type group interval AS and then the forward direction interval BF of the second type group interval BS, the third processor 360 can generate n-2 group intervals.

[0141] Furthermore, the third processor 360 may generate the nth group interval ASE by playing the reverse direction interval AB of the first group interval AS in reverse and playing the reverse direction interval AB of the first group interval AS, the forward direction interval BF of the second group interval BS, and the reverse direction interval BB of the second group interval BS in sequence. n and BSE n Finally, the third processor 360 may complete playing the exercise instruction video 70a by playing the end interval E.

[0142] Although already Fig.14 The method of alternately playing the first group interval AS and the second group interval BS is described in, but the present disclosure is not limited thereto. The third processor 360 generates the first group interval by using the first group interval AS, and generates the second group interval n times by using the second group interval BS.

[0143] Fig.15 2 is a reference diagram for explaining a method of generating an exercise instruction video 70b including repeated exercise movements according to another embodiment.

[0144] When n group movements are requested from the third user interface 330 or an external machine, the third processor 360 may generate a motion guidance video 70 b including n group movements based on reverse playback of a portion of the original video 70 .

[0145] like Fig.15 As shown, the third processor 360 can play the preparation interval R in the original video 70.

[0146] The third processor 360 may generate n-1 first category group intervals AS1, ... by performing n-1 times of playing the forward direction interval AF of the first category group interval AS in reverse order after playing the forward direction interval AF of the first category group interval AS. Furthermore, the third processor 360 may generate the nth first category group interval AS by sequentially playing the forward direction interval AF of the first category group interval AS and the reverse direction interval AB of the first category group interval AS. n .

[0147] Furthermore, the third processor 360 may generate n-1 second group intervals BS1, ... by performing n-1 times of playing the forward interval BF of the second group interval BS in reverse order after playing the forward interval BF of the second group interval BS. Furthermore, the third processor 360 may generate the nth second group interval BS by sequentially playing the forward interval BF of the second group interval BS and the reverse interval BB of the second group interval BS. n .

[0148] Finally, the third processor 360 may complete playing the exercise instruction video 70 b by playing the end interval E.

[0149] exist Fig.15 The description of repeatedly generating each type of group interval n times is based on Figure 7 , but the present disclosure is not limited to this. Figure 8 The reverse playback can be applied to the reverse playback class group interval. Or, Figure 7 Reverse playback and Figure 8 Reverse playback can also be used in combination.

[0150] exist Fig.14 and Fig.15 , a method for providing a motion instruction video by using an original video including two different types of group movements is described, but the present disclosure is not limited thereto. A motion instruction video can also be provided by using an original video including three or more different types of group movements. In addition, a motion instruction video can be generated not only by using an original video including a group of different types of repeated movements, but also by using an original video including two or more basic groups of different types of repeated movements.

[0151] The generated exercise instruction video may be provided on the mirror display 30 or may be provided on another device.

[0152] The exercise instruction video according to an embodiment may be adjusted or terminated in response to the user's action.

[0153] Fig.16 1 is a flow chart illustrating a method for providing a sports instruction video based on user actions according to an embodiment. Fig.16 , the third processor 360 may display a sports instruction video on the display 340 (S610). When the user enters a certain distance from the mirror display 30, the mirror display 30 may change from the standby mode to the operation mode. In addition, the mirror display 30 may request the user terminal 40 carried by the user to play the sports item. The user terminal 40 may request to play the sports instruction video of the sports item by sending the pre-stored sports item and the number of group actions of the sports item to the mirror display 30.

[0154] Alternatively, the user may input a display command for the exercise instruction video by inputting the number of exercise items and group actions through the third user interface 330 of the mirror display 30 .

[0155] As described above, the third processor 360 may generate a motion guidance video including a plurality of group actions based on the reverse playback of a portion of the original video, and may display the generated motion guidance video on the display 340. However, the present disclosure is not limited thereto. In the second memory 320, a motion guidance video for each user or each group may be pre-stored. The third processor 360 may read a motion guidance video pre-stored according to a play request command corresponding to a user or group, and display it on the display 340.

[0156] The third processor 360 may recognize the user's gesture (S620). The motion sensing sensor 370 may sense the user's motion and transmit the sensed result to the third processor 360. The motion sensing sensor 370 is a device for obtaining the user's movement, which may be a visual camera, a visual sensor, an acceleration sensor, a gyro sensor, a geomagnetic sensor, an infrared sensor, etc. The third processor 360 may recognize the user's gesture by using the motion data received from the motion sensing sensor 370.

[0157] For example, when the motion data is image data including the user, the third processor 360 may extract feature points for identifying the gesture from the image data including the user. The feature points may be regions representing the human body. For example, the feature points may be shoulders, shoulder joints, upper arms, elbow joints, lower arms, wrist joints, hands, torsos, hip joints, upper legs, knee joints, lower legs, ankle joints, and feet. The third processor 360 may identify the user's gesture by analyzing feature points, connection angles (stereoscopic angles) between feature points, and distances (stereoscopic distances) between feature points.

[0158] For example, the third processor 360 may recognize a two-dimensional posture by using a deep learning method, a fast human pose estimation (Fast Human Pose Estimation; FPD) learning method, etc. on the motion data. Alternatively, the third processor 360 may recognize a three-dimensional posture by using a model-based method with a three-dimensional body model (3D Body Model) or a model-free method for estimation without a 3D model. However, the present disclosure is not limited thereto. It may also be applied to various known methods in human pose recognition technology.

[0159] The third processor 360 can identify the posture of the target (e.g., coach) included in the motion guidance video (hereinafter, referred to as "reference posture") in a manner similar to the method for identifying the user posture. However, the present disclosure is not limited to this. The third processor 360 can generate action modeling by estimating the reference posture from the original video, and pre-store the original video and the action modeling together. And, when the motion guidance video is displayed based on the original video, the third processor 360 can extract the reference posture while modifying the action modeling that matches the displayed motion guidance video. The action modeling can be performed by the third processor 360, but can also be performed by an external machine such as a server.

[0160] Alternatively, when the motion sensing sensor 370 is a visual camera that captures the user gesture and the target gesture displayed on the screen of the display 340, the third processor 360 may recognize the user gesture and the reference gesture by extracting the user gesture and the reference gesture from the sensed image data.

[0161] The third processor 360 may compare the user's posture with a reference posture corresponding to the user's posture included in the exercise instruction video (S630). The third processor 360 may calculate the similarity between the current user posture and the reference posture included in the exercise instruction video and corresponding to the user's posture at a specific time, for example.

[0162] The user gesture recognized at a specific time point may be different from the reference gesture displayed on the display 340. For example, when the user's motion speed is lower than the playback speed of the motion guidance video, the user's gesture may lag behind the reference gesture displayed on the display 340. In other words, a reference gesture corresponding to the user gesture included in the motion guidance video is pre-displayed. The third processor 360 may compare the recognized user gesture with the pre-displayed reference gesture corresponding to the user gesture.

[0163] Alternatively, when the user's motion speed is faster than the playback speed of the motion instruction video, the user's gesture may be ahead of the reference gesture displayed on the display 340. In other words, the reference gesture included in the motion instruction video corresponding to the user's gesture may not be displayed yet. Only when the reference gesture corresponding to the user's gesture is displayed on the display 340, the third processor 360 can compare the recognized user gesture with the reference gesture corresponding to the user gesture.

[0164] The higher the similarity, the higher the matching rate of the user posture with the reference posture. The third processor 360 may use the similarity based on the angle or distance of the feature points. The third processor 360 may calculate the similarity quantitatively by calculating the similarity of the angle of the feature points or each distance between the feature points, and adding the weight to each similarity. The similarity of all feature points may be calculated, but the similarity of some important feature points in the reference posture may also be calculated. Since various known methods are applied to the similarity calculation method, a detailed description thereof will be omitted.

[0165] When the similarity between the user gesture and the reference gesture is equal to or greater than the reference value (S640-Y), the third processor 360 may display a motion guide video on the display 340 in response to the motion speed of the user (S650).

[0166] The playback speed of the exercise instruction video may be determined based on the original video. Alternatively, the playback speed of the exercise instruction video may be adjusted according to a user's command, etc. However, since the above-mentioned playback speed is fixed and has nothing to do with the user's exercise speed, the playback speed of the exercise instruction video may be different from the user's playback speed.

[0167] When the user is elderly or in poor physical condition, or the user is a novice athlete, the user's exercise speed may be slower than the playback speed of the exercise guidance video. When the user exercises at the playback speed of the exercise guidance video, he may be injured or unable to exercise with the correct posture. Alternatively, the user's exercise speed decreases as the number of group movements increases, but the playback speed of the exercise guidance video is constant, so the user may be injured or unable to exercise with the correct posture.

[0168] According to an embodiment, the third processor 360 may adjust the playback speed of the exercise instruction video in response to the user's exercise speed.

[0169] When it is determined that the user's posture leads the reference interval than the reference posture corresponding to the user's posture, the third processor 360 determines that the user's movement speed is faster than the playback speed of the exercise guidance video. Here, the reference interval may be a sub-group action in the group action or a time interval corresponding to the group action. For example, in the case of a squat exercise, each of the forward direction interval and the reverse direction interval is a time interval corresponding to the sub-group action, and the sum of the forward direction interval and the reverse direction interval may be a time interval corresponding to the group action. The reference interval may be preset differently by a user or an administrator, etc. according to a sports item.

[0170] The third processor 360 may determine the currently recognized user posture based on the previously recognized user posture. For example, the third processor 360 may determine whether the currently recognized user posture is a posture of the forward direction interval or the reverse direction interval of the squat movement based on the previously recognized user posture. Similarly, the third processor 360 may determine the current reference posture based on the previous reference posture.

[0171] The third processor 360 may increase the playback speed of the exercise instruction video so that the displayed reference posture corresponds to the recognized user's posture. The playback speed may be adjusted in proportion to the user's movement speed and may be adjusted by gradually changing the magnitude. For example, the third processor 360 may adjust the playback speed of the exercise instruction video to any one of 1.1 times, 1.2 times, 1.5 times, and 2 times so that the displayed reference posture corresponds to the user's posture, that is, the reference posture displayed at a specific time point matches the user's posture.

[0172] When it is determined that the user's posture lags behind the displayed reference posture by a reference interval, the third processor 360 may determine that the user's movement speed is slower than the playback speed of the motion guidance video. Therefore, the third processor 360 may reduce the playback speed of the motion guidance video so that the displayed reference posture corresponds to the recognized user posture, that is, the reference posture displayed at a specific time matches the user's posture. The playback speed may be adjusted in proportion to the user's movement speed and may be adjusted by gradually changing the size. For example, the third processor 360 may adjust the playback speed of the motion guidance video to any one of 0.9 times, 0.8 times, and 0.5 times so that the reference posture corresponds to the user's posture.

[0173] When it is determined that the user's posture lags behind the reference posture by a reference interval, the third processor 360 may pause the playing of the exercise instruction video until the displayed reference posture corresponds to the user's posture. And, when the user's posture matches the reference posture displayed on the exercise instruction video, the third processor 360 may play the exercise instruction video again.

[0174] Although it is described that the third processor 360 determines the relationship between the user's motion speed and the playback speed based on the recognized user gesture and the reference gesture, the present disclosure is not limited thereto. The third processor 360 may determine the relationship between the user's motion speed and the playback speed based on the time when a specific user action is performed and the playback time when a reference action corresponding to the specific user action is displayed.

[0175] For example, the third processor 360 may analyze the user's movement (i.e., the user's action) from the recognized user's posture and divide the analyzed user's action into sub-group units. In addition, the third processor 360 may compare the time required for the user to perform the sub-group with the playback time required to play the sub-group interval of the exercise instruction video.

[0176] When the difference between the action time and the play time is within the reference time, the third processor 360 may determine that the user's motion speed is the same as the play speed. When the action time is longer than the play time by the reference time or more, the third processor 360 may determine that the user's motion speed is slower than the play speed. Alternatively, when the action time is shorter than the play time by the reference time or more, the third processor 360 may determine that the user's motion speed is faster than the play speed. Here, the reference time may be a time corresponding to the subgroup interval, and may be set differently by the user or administrator, etc., according to the sports item. In addition, as a method for calculating the user's motion speed, an existing motion speed calculation method may be applied.

[0177] When the similarity between the user gesture and the reference gesture corresponding to the user gesture within a predetermined time is less than a reference value, the third processor 360 may end the display of the exercise guidance video. The predetermined time may be a time corresponding to one group action. However, the present disclosure is not limited thereto. The predetermined time may be a time corresponding to two or three group actions.

[0178] When the result of the user's motion is not received from the motion sensing sensor 370 within a predetermined time, the third processor 360 may end the display of the exercise guidance video. When the result of the user's motion is not received from the motion sensing sensor 370, the third processor 360 may determine that the similarity between the user's posture and the reference posture is "0". When the motion sensing sensor 370 fails to sense the user's motion, this may mean that the user has left the sports venue.

[0179] When the user gesture other than the reference gesture continues for a predetermined time, the third processor 360 may end the display of the exercise instruction video, thereby preventing unnecessary playback of the exercise instruction video. Therefore, power consumption of the exercise machine or the mirror display 30 may be prevented.

[0180] While providing the exercise instruction video, the third processor 360 may provide information about the playback speed of the exercise instruction video and information about the similarity between the user's gesture and the reference gesture. The information may be provided as at least one of characters, graphics, text, and sound.

[0181] Figures 17 to 19 A reference diagram for explaining a method for providing an exercise instruction video according to an embodiment.

[0182] like Fig.17 As shown, the third processor 360 may display the exercise instruction video on the display 340. The user may exercise while watching the reference posture displayed in the exercise instruction video. The third processor 360 may compare the user posture with the reference posture corresponding to the user posture, calculate the similarity between the user posture and the reference posture, and then display the above result 720 on the display 340. The user may confirm the accuracy of his / her posture by confirming the similarity.

[0183] In addition, when it is determined that the user's posture is ahead of the reference posture corresponding to the user's posture by a reference interval, the third processor 360 may determine that the user's movement speed is faster than the speed at which the exercise guidance video is played. The third processor 360 may increase the playback speed of the exercise guidance video to make the displayed reference posture correspond to the user's posture.

[0184] And, if Fig.17 As shown, the third processor 360 may display a first indicator 730 indicating that the playback speed of the exercise guidance video has increased on the display 340. In addition, the third processor 360 may display a second indicator 740 on the display 340, which guides the user to slow down the exercise speed.

[0185] Alternatively, when it is determined that the user's posture lags behind the reference posture by a reference interval, the third processor 360 may determine that the user's motion speed is slower than the playback speed of the motion guidance video. Furthermore, the third processor 360 may reduce the playback speed of the motion guidance video so that the displayed reference posture corresponds to the user's posture.

[0186] And, if Fig.18 As shown, the third processor 360 may display a third indicator 830 on the display 340, which indicates that the playback speed of the exercise guidance video has been reduced. In addition, the third processor 360 may display a fourth indicator 840 on the display 340, which guides the user to increase the exercise speed.

[0187] Or, if Fig.19 As shown, when it is determined that the user's posture lags behind the reference posture corresponding to it by a reference interval, the third processor 360 may pause the playing of the exercise instruction video until the displayed reference posture corresponds to the user's posture. Fig.19 As shown, the third processor 360 may display a fifth indicator 930 on the display 340, indicating that the playback of the exercise instruction video has been paused. When the user's posture reaches the reference posture displayed on the display 340, the third processor 360 may start playing the exercise instruction video again.

[0188] When it is determined that the user's posture lags behind the corresponding reference posture by a reference interval, the third processor 360 may pause the playback of the motion guidance video. However, the present disclosure is not limited thereto. When it is determined that the user's posture lags behind the reference posture by a reference interval, the third processor 360 may pause the playback of the motion guidance video at a sub-group action end point or a group action end point in the motion guidance video.

[0189] The third processor 360 can store the user's exercise speed and refer to it when playing the next exercise guidance video. For example, when the user's exercise speed is faster than the playback speed every time, the third processor 360 can increase the playback speed of the exercise guidance video from the preset playback speed.

[0190] Although it has been described that the third processor 360 may provide an indicator for indicating the similarity between the user's gesture and the reference gesture corresponding thereto, the present disclosure is not limited thereto. The third processor 360 may also provide information on the effect according to the user's motion. The third processor 360 may display the motion effect by specifying the body shape of a character, such as an avatar, of the user.

[0191] Fig. 20 and Fig.21 1 is a reference diagram for explaining a method for providing a motion effect according to an embodiment. Fig. 20 As shown, the third processor 360 may display a character 1010 to instruct the user before playing the exercise instruction video.

[0192] Furthermore, the third processor 360 compares the user posture with a reference posture corresponding to the user posture when displaying the exercise instruction video, and calculates the similarity between the user posture and the reference posture. The third processor 360 may change the body shape of the character based on the calculated similarity result, and display the character 1010 with the changed body shape on the display 340. For example, the squat exercise has the effect of strengthening the lower body muscles and reducing fat, such as Fig.21 As shown, the third processor 360 may display, on the display 340 , a character 1010 in which lower body muscles are strengthened and fat is reduced.

[0193] It has been described that the mirror display 30 generates a sports guidance video, but the present disclosure is not limited thereto. The sports guidance video may be generated by a sports machine, or by a server that can communicate with the sports machine or the mirror display 30, and the sports machine or the mirror display 30 may display the generated sports guidance video. In addition, the sports guidance video may be generated by a general electronic device including a display, such as a smart phone, PC, tablet PC, notebook computer, smart TV, mobile phone, PDA, laptop computer, media player, digital broadcast terminal, navigation, wearable device, and other mobile and non-mobile computing devices, or may be generated by an electronic device that can communicate with a display device.

[0194] The method according to an embodiment of the present disclosure can be implemented in the form of program commands that can be executed by various computer means, and can be recorded on a computer-readable medium. The computer-readable medium may include program commands, data files, and data structures, etc., either alone or in combination. The program commands recorded on the medium may be specially designed and constructed for the present disclosure, or may be known and available to technicians in the field of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and tapes, optical media such as compact disc read only memory (CD-ROM) and digital video discs (DVD), magneto-optical media such as floptical disks (magneto-optical media), and hardware devices specially configured to store and execute program commands, such as read-only memory (ROM), random access memory (RAM), and flash memory, etc. Examples of program commands include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter, etc.

[0195] Some embodiments of the present disclosure may also be implemented in the form of a recording medium including a command executable by a computer, such as a program module executed by a computer. Computer-readable media may be any available medium accessible by a computer, and include all volatile and non-volatile media, detachable and non-detachable media. In addition, computer-readable media may include computer storage media and communication media. Computer storage media include all volatile and non-volatile media, detachable and non-detachable media implemented by any method or technology for storing information such as computer-readable instructions, data structures, program modules or other data. Communication media typically include computer-readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier, or other transmission mechanisms, and include any information transfer medium. In addition, some embodiments of the present disclosure may also be implemented as a computer program or computer program product (computer program product) including instructions executable by a computer, such as a computer program executed by a computer.

[0196] The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, a "non-transitory storage medium" is a tangible device and simply means that it does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between a case where data is semi-permanently stored in the storage medium and a case where data is temporarily stored. For example, a "non-transitory storage medium" may include a buffer that temporarily stores data.

[0197] According to one embodiment, the method according to various embodiments disclosed herein may be included and provided in a computer program product. The computer program product may be traded between a buyer and a seller as a commodity. The computer program product is distributed in the form of a machine-readable storage medium (e.g., CD-ROM), or distributed online (e.g., downloaded or uploaded) directly through an application store or between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (downloadable application) is at least temporarily stored or temporarily generated in a machine-readable storage medium, such as a manufacturer's server, an application store's server, or a memory of a relay server.

[0198] According to an embodiment, the exercise instruction video can adjust the number of group movements.

[0199] In the exercise instruction video according to an embodiment, group actions as repeated actions are provided without interrupting the video, thereby increasing the user's immersion in the exercise.

[0200] The exercise guidance video according to an embodiment is adjusted by the user's exercise speed and can be provided to the user more usefully.

[0201] Although certain exemplary embodiments and implementations have been described herein, other embodiments and modifications will be apparent from this description. Therefore, the inventive concept is not limited to these embodiments, but is limited to the broader scope of the appended claims, and various obvious modifications and equivalent arrangements will be apparent to those of ordinary skill in the art.

Claims

1. A method for providing an exercise instruction video including a set of movements as repeated movements, comprising: receiving a generation command related to an exercise instruction video including two or more group movements as the number of group movements, the number being an integer greater than or equal to 2; and Based on reverse playback of a portion of the original video including one group of movements, a sports instruction video including two or more group of movements is generated, The original video includes: a preparation interval showing a preparation action; a first interval showing a first action; a second interval showing a second action opposite to the first action; and an ending interval showing an ending action. Generating the exercise guidance video includes: Playing the preparation interval; Repeating at least one of the following steps for a number corresponding to the set of actions: a first step of playing the first interval in reverse after playing the first interval; and a second step of playing the second interval in reverse after playing the second interval; and The end interval is played.

2. The method according to claim 1, wherein: The sum of the repetition times of the first step and the second step is less than the number of the group actions.

3. The method according to claim 2, wherein: The sum of the repetition times of the first step and the second step is less than the number of the group actions by one.

4. The method according to claim 2, further comprising: The third step includes playing the first interval and the second interval in sequence.

5. The method according to claim 1, wherein: The original video further includes: A third interval showing a preparatory action; and The fourth interval shows the completion action.

6. The method according to claim 1, further comprising: The generated exercise instruction video is displayed.

7. The method according to claim 1, wherein: The generated motion guidance video is displayed on the mirror display.

8. A device for providing a sports instruction video including a set of movements as repeated movements, comprising: A memory in which an original video including a group action is stored; as well as a processor, which reads the original video from the memory and generates a motion instruction video including two or more group actions based on reverse playback of a portion of the original video, The original video includes: a preparation interval showing a preparation action; a first interval showing a first action; a second interval showing a second action opposite to the first action; and an ending interval showing an ending action. The processor is configured to generate a motion instruction video by: Playing the preparation interval; Repeating at least one of the following steps for a number corresponding to the set of actions: a first step of playing the first interval in reverse after playing the first interval; and a second step of playing the second interval in reverse after playing the second interval; and The end interval is played.

9. The device according to claim 8, wherein: The processor is configured to repeatedly perform at least one of the first step and the second step a number less than the set of actions.

10. The apparatus according to claim 8, further comprising: A display that displays the generated exercise instruction video.

11. A computer-readable recording medium having recorded therein a program for executing the method according to claim 1 in a computer.

Images