Dance practice system, dance practice method, and program

Abstract

This dance practice system (100) comprises a first input interface (11), a second input interface (12), a processor (13), and an output interface (14). The processor (13) generates guide image data that provides instructions to a user such that the movement of the user becomes similar to that of a performer. The processor (13) determines to which frame, among a plurality of frames of model image data, a specific frame acquired at a specific time point from among a plurality of frames of user image data corresponds. When the specific frame is delayed with respect to the determined frame, the processor (13) performs control so as to expedite the timing at which the guide image data is to be displayed on a display (31) further when the time difference between the determined frame and the specific frame is greater.

Description

[Technical field]

[0001] The present disclosure relates to a dance practice system for assisting a user in practicing dance. [Background technology]

[0002] For example, Patent Document 1 discloses an image generating device that presents an ideal dance image to a subject dancing as a virtual image of the subject himself / herself. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2021 / 039857 Summary of the Invention [Problem to be solved by the invention]

[0004] The image generating device disclosed in Patent Document 1 can present an ideal dance video to a user as a virtual video of the user himself / herself, but even if the user watches the video when practicing the dance, it does not mean that the user can dance exactly like the video. In other words, the image generating device disclosed in Patent Document 1 has a problem in that the user cannot expect to improve his / her dance proficiency when practicing the dance.

[0005] The present disclosure provides a dance practice system etc. that allows a user to easily improve their dance proficiency when practicing dance. [Means for solving the problem]

[0006] A dance practice system according to an embodiment of the present disclosure includes a first input interface, a second input interface, a signal processing circuit, and an output interface. The first input interface acquires user image data including a plurality of frames showing a user's movements based on image data captured by a camera. The second input interface acquires model image data including a plurality of frames showing a dance model of an actor. The signal processing circuit generates guide image data instructing the user to make the user's movements closer to the actor's movements. The output interface displays the user image data, the model image data, and the guide image data on a display. The signal processing circuit determines which of the plurality of frames of the model image data corresponds to a specific frame acquired at a predetermined time among the plurality of frames of the user image data. When the specific frame is delayed with respect to the determined frame among the plurality of frames of the model image data, the signal processing circuit controls the display to display the guide image data earlier as the time difference between the determined frame and the specific frame increases.

[0007] In a dance practice method according to one aspect of the present disclosure, user image data including a plurality of frames showing a user's movements based on image data captured and generated by a camera is acquired. In the dance practice method, model image data including a plurality of frames showing the movements of a performer who is a model for the dance is acquired. In the dance practice method, guide image data is generated to instruct the user to make the movements of the user closer to the movements of the performer. In the dance practice method, the user image data, the model image data, and the guide image data are displayed on a display. In the process of generating the guide image data, it is determined which of the plurality of frames of the model image data corresponds to a specific frame acquired at a predetermined time point among the plurality of frames of the user image data. In the process of generating the guide image data, if the specific frame is delayed with respect to the determined frame among the plurality of frames of the model image data, the larger the time difference between the determined frame and the specific frame, the earlier the timing of displaying the guide image data on the display is controlled.

[0008] A program according to one aspect of the present disclosure causes one or more processors to execute the dance practice method. Effect of the Invention

[0009] The dance practice system and the like disclosed herein has the advantage that a user can easily improve their dance proficiency when practicing dance. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a block diagram showing an example of an overall configuration including a dance practice system according to an embodiment. [Diagram 2] FIG. 2 is a schematic diagram showing an example of use of the dance practice system according to the embodiment. [Diagram 3] FIG. 3 is a schematic diagram illustrating an example of guide image data. [Figure 4]FIG. 4 is a flowchart illustrating an example of processing by the analysis unit according to the embodiment. [Diagram 5] FIG. 5 is a diagram illustrating the operation of the analysis unit according to the embodiment. [Figure 6] FIG. 6 is a flowchart illustrating an example of processing by the correction unit according to the embodiment. [Figure 7] FIG. 7 is a diagram illustrating the operation of the correction unit according to the embodiment. [Figure 8] FIG. 8 is a flowchart illustrating an example of processing by the generating unit according to the embodiment. [Figure 9] FIG. 9 is an explanatory diagram of a first specific example of a dance practice system according to an embodiment. [Figure 10] FIG. 10 is an explanatory diagram of a second specific example of the dance practice system according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, the embodiments will be described in detail with reference to the drawings. Note that the embodiments described below are all comprehensive or specific examples. The numerical values, shapes, materials, components, arrangement and connection forms of the components, steps, order of steps, etc. shown in the following embodiments are merely examples and are not intended to limit the present disclosure. In addition, among the components in the following embodiments, components that are not described in the independent claims will be described as optional components.

[0012] In addition, each drawing is a schematic diagram and is not necessarily a precise illustration. In addition, in each drawing, the same reference numerals are used for substantially the same configuration, and duplicated explanations may be omitted or simplified.

[0013] (Embodiment) [1. Configuration] [1-1. Overall composition] First, the overall configuration including the dance practice system according to the embodiment will be described with reference to FIG. 1. FIG. 1 is a block diagram showing an example of the overall configuration including the dance practice system according to the embodiment. The dance practice system 100 is a system for supporting a user U1 (see FIG. 2) to imitate the movements of a model performer of the dance when the user U1 practices the dance. Here, the dance refers to a series of movements performed to an accompaniment, for example. The dance also includes a non-music dance in which the body movement itself functions as the accompaniment. In the embodiment, the dance practice system 100 is mounted on a computer 3 such as a personal computer. In other words, in the embodiment, the dance practice system 100 includes the computer 3. In addition to the computer 3, the dance practice system 100 may further include at least one of a camera 2, a display 31, and a server 4, which will be described later.

[0014] Fig. 2 is a schematic diagram showing an example of use of the dance practice system 100 according to the embodiment. As shown in Fig. 2, the computer 3 displays model image data P1, user image data P2, and guide image data P3 on a display 31 provided separately from the computer 3. A camera 2 for capturing an image of a user U1 facing the display 31 is attached to an upper part of the bezel of the display 31.

[0015] The camera 2 has an image sensor such as a CCD (Charge Coupled Device) sensor or a CMOS (Complementary Metal Oxide Semiconductor) sensor, and captures the user U1 facing the display 31. The camera 2 generates pre-correction image data by capturing an image of the user U1, and outputs the generated pre-correction image data to a first input interface (hereinafter, referred to as I / F (Interface)) 11 of the dance practice system 100, which will be described later. The processor 13 of the dance practice system 100, which will be described later, corrects this pre-correction image data, thereby generating user image data P2. In the embodiment, the camera 2 is attached to the display 31 in advance, but it does not have to be attached in advance and may be added later.

[0016] The model image data P1 is image data showing a dance model of a performer's movement, and is moving image data including a plurality of frames. In the embodiment, the model image data P1 is moving image data of one performer performing the model movement. In the embodiment, the model image data P1 is video content created in advance that includes a state in which a performer performs the model movement. Here, in the embodiment, the model image data P1 is moving image data obtained by imaging, from the front of the performer, a state in which the performer performs a movement that is a left-right inversion of the model movement. For example, the movement of raising the right hand in the model movement is a movement of raising the left hand in the model image data P1 displayed on the display 31.

[0017] The user U1 practices dancing by looking at the model image data P1 displayed on the display 31 and imitating the movements of the performer (i.e., performing movements that are mirror images of the model movements). For example, if the performer in the model image data P1 displayed on the display 31 is raising his / her left hand, that is, if the performer is raising his / her right hand as seen from the user U1, the user U1 will imitate that movement and raise his / her right hand. Here, as described later, the user image data P2 is displayed on the display 31 by capturing an image of the user U1 facing the display 31 with the camera 2, and the captured pre-correction image data is inverted left and right. Therefore, the performer in the model image data P1 and the user U1 in the user image data P2 are displayed on the display 31 as if they are making the same movements. For example, if the user U1 raises his / her right hand imitating the performer displayed on the display 31 raising his / her right hand, the user U1 will also raise his / her right hand in the user image data P2 displayed on the display 31.

[0018] In the embodiment, the model image data P1 is distributed from a server 4 (described later) via a network N1 such as the Internet. In the embodiment, the processor 13 of the dance practice system 100 acquires the model image data P1 from the server 4 in advance and analyzes the acquired model image data P1. The processor 13 of the dance practice system 100 stores information including the acquired model image data P1 and the analysis result of the model image data P1 in the memory 15. In the embodiment, the dance practice system 100 displays the model image data P1 stored in the memory 15 on the display 31 when the user practices dance.

[0019] In addition, when video data is obtained by capturing an image of the performer performing the above-mentioned model movement from the front, the processor 13 of the dance practice system 100 may, upon acquiring the video data, execute a process to invert the acquired video data from left to right, and acquire the inverted video data as model image data P1.

[0020] Furthermore, in the embodiment, the model image data P1 is displayed on the display 31 at a frame rate of 30 fps (frames per second) or 60 fps. The frame rate may be a value other than 30 fps and 60 fps. Furthermore, in the embodiment, the model image data P1 is displayed on the display 31 at the lower right corner of the display 31, with a size smaller than the size of the user image data P2. Hereinafter, the area on the display 31 where the model image data P1 is displayed is also referred to as the "sub-screen 312."

[0021] The user image data P2 is image data showing the actions of the user U1 based on image data generated by capturing an image of the user U1 by the camera 2, and is moving image data consisting of a plurality of frames. In the embodiment, the user image data P2 is displayed on the display 31 at the same frame rate as the model image data P1.

[0022] In the embodiment, the user image data P2 is displayed on the display 31 as a mirror image of the user U1 facing the display 31. Specifically, the user image data P2 is generated by the processor 13 of the dance practice system 100 executing a process of inverting the left and right of the uncorrected image data input from the camera 2 to the first input I / F 11 of the dance practice system 100.

[0023] Furthermore, in the embodiment, the user image data P2 is displayed on the display 31 at the center of the display 31, with a size larger than the size of the sub-screen 312. Hereinafter, the area on the display 31 where the user image data P2 and the guide image data P3 are displayed is also referred to as the "main screen 311."

[0024] The guide image data P3 is image data that instructs the user U1 to make the user U1's movements closer to the movements of the performer, and is moving image data including a plurality of frames. The guide image data P3 includes arrows indicating the movements that the user U1 should make next, as shown in FIG. 2, for example. In the example shown in FIG. 2, the user U1 moves the right hand, right foot, left hand, and left foot, respectively, according to the arrows located near the right hand, right foot, left hand, and left foot, respectively, on the display 31. In this way, even if the user U1 does not remember the movements of the performer, by performing the movements while looking at the guide image data P3, the user U1 can grasp the movements that should be made next, and can make his / her movements closer to the movements that are the model for dance.

[0025] In the embodiment, the frame rate when the guide image data P3 is displayed on the display 31 is the same as the frame rate when the user image data P2 is displayed on the display 31. Also, like the user image data P2, the guide image data P3 is updated every frame and displayed on the display 31. Also, in the embodiment, the guide image data P3 is displayed on the display 31 in a form superimposed on the user image data P2 on the main screen 311. Note that the guide image data P3 does not have to be updated every frame, and may be updated, for example, every several frames.

[0026] FIG. 3 is a schematic diagram showing an example of guide image data P3. In FIG. 3, only the main screen 311 is shown among the main screen 311 and the sub-screen 312 displayed on the display 31. As shown in FIG. 3, the guide image data P3 is displayed on the main screen 311, superimposed on the user image data P2. In the example shown in FIG. 3, the guide image data P3 includes image data P31 corresponding to the left hand of the user U1 and image data P32 corresponding to the right hand of the user U1. The image data P31 includes a destination point P312 indicating the position to be reached next by the left hand of the user U1, and an arrow P311 indicating the direction and movement amount when the left hand of the user U1 moves from the current position to the destination point. In addition, the image data P32 includes a destination point P322 indicating the position to be reached next by the right hand of the user U1, and an arrow P321 indicating the direction and movement amount when the right hand of the user U1 moves from the current position to the destination point. That is, in the embodiment, the guide image data P3 includes, for each part of the user U1, a destination point indicating the position where the user U1 should reach next on the display 31, and an arrow indicating the direction and amount of movement from the current position of the user U1 to the destination point on the display 31. Note that the guide image data P3 may include destination points and arrows for the entire body of the user U1, instead of for each part of the user U1.

[0027] In the embodiment, the destination point and the arrow in the guide image data P3 are displayed on the display 31 in a darker color the greater the amount of movement when each part of the user U1 is moved from the current position to the destination point, and in a lighter color the smaller the amount of movement. Also, in the embodiment, the arrow in the guide image data P3 is displayed on the display 31 in a larger size the greater the amount of movement, and in a smaller size the smaller the amount of movement. The "arrow size" here includes the length of the arrow. In other words, the arrow in the guide image data P3 is displayed on the display 31 in a longer size the greater the amount of movement, and in a shorter size the smaller the amount of movement. In other words, the guide image data P3 changes at least one of the size and the shade according to the difference between the movement of the user U1 and the movement of the performer.

[0028] The user U1 can practice dancing by imitating the model movements of the dance while looking at the model image data P1 displayed on the display 31. The user U1 can then further look at the user image data P2 showing his / her own movements and the guide image data P3, which makes it easier for him / her to approximate his / her own movements to those of the performer, enabling him / her to practice dancing more efficiently.

[0029] [1-2. Configuration of dance practice system] Next, a specific description will be given of the configuration of the dance practice system 100. As shown in Fig. 1, the dance practice system 100 includes a first input I / F 11, a second input I / F 12, a processor 13, an output I / F 14, and a memory 15.

[0030] The first input I / F 11 is, for example, a wired communication interface, and is connected to the camera 2 using a cable such as a Universal Serial Bus (USB) cable. The first input I / F 11 acquires pre-corrected image data from the camera 2 by performing wired communication with the camera 2. Note that the first input I / F 11 may be a wireless communication interface. In this case, the first input I / F 11 acquires pre-corrected image data from the camera 2 by communicating with the camera 2 via a network such as a Local Area Network (LAN) based on a wireless communication standard such as Wi-Fi (registered trademark).

[0031] In the embodiment, the processor 13 generates user image data P2 by performing a process of left-right inverting the pre-corrected image data acquired by the first input I / F 11. In other words, the first input I / F 11 indirectly acquires the user image data P2 by acquiring the pre-corrected image data.

[0032] The second input I / F 12 is, for example, a wireless communication interface, and acquires model image data P1 from a server 4 that provides a video distribution service via a network N1 such as the Internet based on a wireless communication standard such as Wi-Fi (registered trademark). Examples of the video distribution service include YouTube (registered trademark), Instagram (registered trademark), TikTok (registered trademark), etc.

[0033] The second input I / F 12 may acquire model image data P1 stored in an information terminal such as a smartphone owned by the user U1, or may acquire model image data P1 stored in an external storage device such as a hard disk drive (HDD) owned by the user U1. When acquiring model image data P1 from an information terminal or an external storage device, the second input I / F 12 may acquire model image data P1 by performing wired communication between the information terminal or the external storage device using a cable such as a USB cable.

[0034] The processor 13 is, for example, a CPU (Central Processing Unit) and performs information processing such as processing to generate guide image data P3 based on user image data P2 acquired via the first input I / F 11 and model image data P1 acquired via the second input I / F 12. The above-mentioned information processing is realized by the processor 13 executing a computer program stored in the memory 15. The processor 13 is an example of a signal processing circuit of the dance practice system 100.

[0035] In the embodiment, the processor 13 functions as an analysis unit 131, a correction unit 132, a generation unit 133, a superimposition unit 134, and a synthesis unit 135 by the processor 13 executing a computer program stored in the memory 15.

[0036] The analysis unit 131 analyzes the model image data P1 acquired by the second input I / F 12. In the embodiment, the analysis of the model image data P1 by the analysis unit 131 is executed before the model image data P1 is displayed on the display 31. That is, in the embodiment, the display of the model image data P1 on the display 31 is executed after the analysis of the model image data P1 by the analysis unit 131 is completed. Hereinafter, specific processing by the analysis unit 131 will be described with reference to Figs. 4 and 5.

[0037] 4 is a flowchart showing an example of processing by the analysis unit 131 according to the embodiment. First, the analysis unit 131 divides the model image data P1 acquired by the second input I / F 12 into frames (S11). A frame number is assigned to each divided frame, with the frame at the start of the model image data P1 being the first frame. Hereinafter, assuming that the model image data P1 acquired in advance has N frames (N is a natural number), the nth frame (n is a natural number, 1≦n≦N) to be processed will be referred to as "frame n".

[0038] Next, analysis unit 131 calculates coordinate data L1(n) for each part of the performer by analyzing each part of the performer for each frame (S12). The "coordinate data" here is data that represents coordinates on the XY plane in the image data of the frame (i.e., coordinates in a two-dimensional orthogonal coordinate system). The coordinate data L1(n) for each part of the performer calculated by analysis unit 131 is stored in memory 15 for each frame (S13). That is, memory 15 stores coordinate data L1(1), L1(2), ..., L1(N).

[0039] In step S12, the analysis unit 131 calculates coordinate data L1(n) of each part of the performer using an appropriate algorithm for detecting skeletal coordinates of a human figure included in image data such as Kinect (registered trademark). In the embodiment, the analysis unit 131 calculates the coordinate data of each of the performer's head, neck, right shoulder, left shoulder, right hand, left hand, right foot, and left foot in each frame, and sets these coordinate data as coordinate data L1(n). Note that the above-listed parts of the performer are merely examples, and the analysis unit 131 may calculate coordinate data of other parts of the performer. Also, the number of types of parts of the performer analyzed by the analysis unit 131 may be more or less than the number of parts listed above.

[0040] Next, the analysis unit 131 calculates, for each frame, differential data D1(n) between the coordinate data L1(n) of each body part of the performer in the current frame and the coordinate data L1(n+1) of each body part of the performer in the following frame (S14). The differential data D1(n) is calculated by subtracting the coordinate data L1(n) from the coordinate data L1(n+1). The differential data D1(n) calculated by the analysis unit 131 is stored in the memory 15 for each frame (S15). That is, the memory 15 stores differential data D1(1), D1(2), ..., D1(N-1).

[0041] FIG. 5 is an explanatory diagram of the operation of the analysis unit 131 according to the embodiment. FIG. 5(a) shows "frame 1" of the model image data P1, and FIG. 5(b) shows coordinate data L1(1) of each part of the performer obtained by analyzing "frame 1" of the model image data P1. FIG. 5(c) shows "frame 2" of the model image data P1, and FIG. 5(d) shows coordinate data L1(2) of each part of the performer obtained by analyzing "frame 2" of the model image data P1. FIG. 5(e) shows "frame 3" of the model image data P1, and FIG. 5(f) shows coordinate data L1(3) of each part of the performer obtained by analyzing "frame 3" of the model image data P1. In each of (b), (d), and (f) of Figure 5, "Part" indicates the part of the performer, "XY coordinate" indicates the coordinate data of each part of the performer in the frame, and "XY difference" indicates the difference between the coordinate data of each part of the performer in the frame and the coordinate data of each part of the performer in the following frame. Note that in Figure 5, the performer is shown only by the skeleton. In subsequent drawings, the performer will also be shown by only the skeleton.

[0042] 5, for example, the difference data (a12, b12) of the performer's head in "frame 2" of the model image data P1 is the difference between the coordinate data (x12, y12) of the performer's head in "frame 2" of the model image data P1 and the coordinate data (x13, y13) of the performer's head in "frame 3" of the model image data P1. In other words, the difference data D1(2) is calculated by subtracting the coordinate data L1(2) of each part of the performer in "frame 2" of the model image data P1 from the coordinate data L1(3) of each part of the performer in "frame 3" of the model image data P1.

[0043] Furthermore, the analysis unit 131 stores the model image data P1 in the memory 15 (S16). Step S16 may be executed in parallel with steps S11 to S15, or may be executed before step S11.

[0044] The correction unit 132 calculates a guide correction value used when correcting the guide image data P3 in the generation unit 133, based on the user image data P2 acquired via the first input I / F 11 and the example image data P1 acquired via the second input I / F 12. Hereinafter, the specific processing by the correction unit 132 will be described with reference to FIG.

[0045] 6 is a flowchart showing an example of processing by the correction unit 132 according to the embodiment. First, the correction unit 132 calculates coordinate data of each part of the user U1 in a specific frame acquired at a predetermined time point from the user image data P2 acquired via the first input I / F 11 (S21). The coordinate data of each part of the user U1 calculated by the correction unit 132 is associated with the specific frame and stored in the memory 15.

[0046] Here, the specific frame may be, for example, the latest frame of the user image data P2, or any frame. It is preferable to use the latest frame of the user image data P2 as the specific frame, since it is possible to calculate a guide correction value according to the latest state of the user U1. In the following, the specific frame of the user image data P2 is described as "frame n". Therefore, the coordinate data L2(n) of each part of the user U1 in the specific frame is linked to the specific frame and stored in the memory 15.

[0047] In step S21, the correction unit 132, like the analysis unit 131, calculates coordinate data L2(n) of each part of the user U1 in the specific frame using an appropriate algorithm for detecting skeletal coordinates of a human figure included in image data such as Kinect (registered trademark). The parts of the user U1 that are the subject of calculation by the correction unit 132 are the same as the parts of the performer that are the subject of calculation by the analysis unit 131. Therefore, here, the correction unit 132 calculates the coordinate data of the head, neck, right shoulder, left shoulder, right hand, left hand, right foot, and left foot of the user U1 in the specific frame.

[0048] Next, the correction unit 132 analyzes which of the frames of the model image data P1 the specific frame corresponds to, and determines the corresponding frame corresponding to the specific frame (S22). The corresponding frame is a frame in which the movement of the performer is closest to the movement of the user U1 in the specific frame.

[0049] Specifically, the correction unit 132 calculates difference data D12(n+k) between the coordinate data L2(n) of each part of the user U1 in a specific frame (here, “frame n” of the user image data P2) and the coordinate data L1(n+k) (-α≦k≦α, k is an integer) of each part of the performer in each of 2×α+1 (α is a natural number) frames in the model image data P1 stored in the memory 15.

[0050] As a specific example, when α=2, the correction unit 132 calculates difference data D12(n-2), D12(n-1), ..., D12(n+2) between the coordinate data L2(n) of each part of the user U1 in "frame n" of the user image data P2 and the coordinate data L1(n-2), L1(n-1), ..., L1(n+2) of each part of the performer in each of "frame (n-2)," "frame (n-1)," ..., "frame (n+2)" in the model image data P1.

[0051] Then, the correction unit 132 determines the frame for which the calculated difference data D12(n+k) is the smallest as the corresponding frame for the specific frame. Here, the calculated difference data being the smallest corresponds to, for example, the integrated value of the difference data for each part being the smallest. The difference data for each part here is the length of the vector indicated by the difference data, or a value equivalent to the length. For example, if the vector indicated by the difference data for each part is (dx1, dy1), the value of the difference data is dx12+dy12.

[0052] Fig. 7 is an explanatory diagram of the operation of the correction unit 132 according to the embodiment. Fig. 7(a) shows a specific frame (here, "frame n") of the user image data P2, and Fig. 7(b) shows coordinate data L2(n) of each part of the user U1 obtained by analyzing the specific frame. Fig. 7(c), (e), (g), (i), and (k) respectively show "frame (n-2)" (k=-2), "frame (n-1)" (k=-1), "frame n" (k=0), "frame (n+1)" (k=1), and "frame (n+2)" (k=2) of the example image data P1.

[0053] In FIG. 7(b), "Part" indicates the part of the user U1, and "XY coordinates" indicates the coordinates of each part of the user U1 in the frame.

[0054] 7, the difference between the coordinate data L2(n) of each part of the user U1 in the specific frame and the coordinate data L1(n-1) of each part of the performer in "frame (n-1)" (k=-1) of the model image data P1 is the smallest. Therefore, the correction unit 132 determines "frame (n-1)" (k=-1) of the model image data P1 as the corresponding frame.

[0055] Returning to FIG. 6, the correction unit 132 calculates the guide correction value β1 (S23). The guide correction value β1 calculated by the correction unit 132 is stored in the memory 15. Specifically, the correction unit 132 calculates the guide correction value β1 based on the formula "β1=-k1". Here, "k1" is the value of "k" when the above-mentioned difference data D12(n+k) is minimum. In other words, "k1" is calculated by subtracting the number assigned to the frame corresponding to the acquisition time of the specific frame in the model image data P1 from the number assigned to the corresponding frame in the model image data P1.

[0056] Here, the guide correction value β1 indicates the time difference between the determined frame (corresponding frame) among a plurality of frames of the model image data P1 and a specific frame in the user image data P2. In other words, the guide correction value β1 indicates the degree to which the movement of the user U1 follows the movement of the performer in the model image data P1. For example, when the guide correction value β1 is zero, it indicates that the user U1 can move without lagging behind the movement of the performer in the model image data P1. On the other hand, when the guide correction value β1 is a positive value (that is, "k1 < 0"), it indicates that the movement of the user U1 lags behind the movement of the performer in the model image data P1. In this case, the larger the absolute value of the guide correction value β1, the more the movement of the user U1 lags behind the movement of the performer in the model image data P1. Also, when the guide correction value β1 is a negative value (that is, "k1 > 0"), it indicates that the movement of the user U1 precedes the movement of the performer in the model image data P1. In this case, the larger the absolute value of the guide correction value β1, the more the movement of the user U1 precedes the movement of the performer in the model image data P1.

[0057] Note that the correction unit 132 restricts the value of the guide correction value β1 so that the offset β described later satisfies "β = β0 + β1 ≧ 0". Here, "β0" represents the initial value of the offset β. For example, when "β0 + β1 ≧ 0", that is, "β0 ≧ k1", the guide correction value β1 becomes "β1 = k1". On the other hand, when "β0 + β1 < 0", that is, "β0 < k1", the guide correction value β1 becomes "β1 = -β0". Taking a specific example, when "β0 = 2" and "k1 > 2", the guide correction value β1 becomes "β1 = -β0 = -2".

[0058] The generation unit 133 generates the guide image data P3 based on the guide correction value β1 calculated by the correction unit 132. Hereinafter, the specific processing by the generation unit 133 will be described with reference to FIG. 8.

[0059] 8 is a flowchart showing an example of processing by the generating unit 133 according to the embodiment. First, the generating unit 133 calculates an offset β (S31). The offset β calculated by the generating unit 133 is stored in the memory 15. Here, the offset β is calculated by adding a guide correction value β1 calculated by analyzing a specific frame in the user image data P2 to an initial value β0 of the offset β, and the unit is the number of frames. In the embodiment, the initial value β0 of the offset β is 2 frames.

[0060] Next, the generating unit 133 generates the guide image data P3 based on the calculated offset β (S32). Specifically, the generating unit 133 determines the "frame (n+1)" (hereinafter referred to as the "previous frame") of the model image data P1 corresponding to the "frame (n+1)" that is the next frame of the "frame n" of the user image data P2 displayed on the display 31, and the "frame (n+1+β)" (hereinafter referred to as the "next frame") that is the frame of the model image data P1 that is the offset β later than the frame. Next, the generating unit 133 reads out the difference data D1(n+1), ... D1(n+β) corresponding to each of all frames from the previous frame to the subsequent frame (excluding the subsequent frame) from the memory 15. Then, the generating unit 133 generates the guide image data P3 based on the difference D obtained by adding all the read out difference data D1(n+1), ... D1(n+β). The difference D is expressed as "D = D1 (n + 1) + ... + D1 (n + β)".

[0061] In this case, the generating unit 133 generates an image of the arrival point in the guide image data P3 for each part of the user U1 based on the coordinate data L1(n+1+β) of each part of the performer in the subsequent frame, "frame (n+1+β)". The generating unit 133 also generates an image of an arrow in the guide image data P3 for each part of the user U1 based on the difference D. Thus, in the embodiment, the generating unit 133 generates the guide image data P3 by referring to a frame (subsequent frame) that is a time period later than a predetermined point in time according to the time difference (guide correction value β1) among the multiple frames of the model image data P1.

[0062] Then, the generating unit 133 outputs the generated guide image data P3 (S33). Here, the generating unit 133 outputs the generated guide image data P3 to the superimposing unit .

[0063] The superimposing unit 134 generates image data for each frame by superimposing the guide image data P3 generated by the generating unit 133 on the user image data P2 acquired via the first input I / F 11. The superimposing unit 134 outputs the superimposed image data to the synthesizing unit 135.

[0064] The synthesis unit 135 generates image data for each frame by synthesizing the image data superimposed by the superimposition unit 134 and the model image data P1 read from the memory 15. Here, the synthesis unit 135 synthesizes these data so that the image data superimposed by the superimposition unit 134 (i.e., the user image data P2 and the guide image data P3) are displayed on the main screen 311 of the display 31, and the model image data P1 is displayed on the sub-screen 312 of the display 31. The synthesis unit 135 outputs the synthesized image data to the output I / F 14.

[0065] The output I / F 14 displays the image data synthesized by the synthesis unit 135 on the display 31. As a result, the user image data P2 and the guide image data P3 are displayed on the main screen 311 of the display 31, and the model image data P1 is displayed on the sub-screen 312. In other words, the output I / F 14 displays the user image data P2, the model image data P1, and the guide image data P3 on the display 31.

[0066] The memory 15 is a storage device that stores various information necessary for the processor 13 to perform information processing, and computer programs executed by the processor 13. The memory 15 also stores user image data P2 acquired via the first input I / F 11, model image data P1 acquired via the second input I / F 12, coordinate data and difference data of each part of the performer calculated by the analysis unit 131, and guide image data P3 generated by the generation unit 133. The memory 15 is realized by, for example, a semiconductor memory.

[0067] [2. Specific Examples] A specific example of the dance practice system 100 according to the embodiment will be described below with reference to FIG. 9 and FIG. 10. FIG. 9 is an explanatory diagram of a first specific example of the dance practice system 100 according to the embodiment. FIG. 10 is an explanatory diagram of a second specific example of the dance practice system 100 according to the embodiment. In each of FIG. 9 and FIG. 10, the upper part shows "frame 1", "frame 2", "frame 3", "frame 4", "frame 5", and "frame 6" of the model image data P1 displayed on the sub-screen 312 of the display 31, with only the sub-screen 312 cut out and arranged horizontally. In each of FIG. 9 and FIG. 10, the lower part shows "frame 2" and "frame 3" of the user image data P2 displayed on the main screen 311 of the display 31, with only the main screen 311 cut out and arranged horizontally. In each of FIG. 9 and FIG. 10, "current frame" represents the frame displayed on the display 31, and "next frame" represents the frame displayed on the display 31 next to the current frame.

[0068] The first specific example shown in FIG. 9 shows a situation in which "frame 2", which is the current frame (specific frame) of the user image data P2, matches with "frame 2", which is the current frame of the model image data P1. In other words, in the first specific example, the movement of the user U1 can follow the movement of the performer without delay. Therefore, in the first specific example, the correction unit 132 of the processor 13 determines "frame 2" of the model image data P1 as the corresponding frame. Then, the correction unit 132 calculates "k1=0". "k1" is the value of "k" when the difference data D12(n+k) is the smallest. As a result, the correction unit 132 calculates the guide correction value β1 as "β1=-k1=0".

[0069] Next, the generating unit 133 of the processor 13 calculates the offset β as "β=β0+β1=2". Then, the generating unit 133 generates the guide image data P3 based on the calculated offset β. Here, the generating unit 133 determines "frame 3" of the model image data P1, which corresponds to "frame 3" that is the frame next to "frame 2" of the user image data P2 displayed on the display 31, as the previous frame. The generating unit 133 also determines "frame 5", which is the frame that is the offset β (here, "β=2") after the previous frame of the model image data P1, as the subsequent frame.

[0070] Next, the generation unit 133 reads out the difference data D1(3), D1(4) corresponding to each of all frames (excluding the subsequent frame) from the previous frame to the subsequent frame from the memory 15. Then, the generation unit 133 generates the guide image data P3 based on the difference D obtained by adding up all the read difference data D1(3), D1(4).

[0071] In the first specific example, when "frame 3" which is the next frame of the user image data P2 is displayed on the display 31, the guide image data P3 including image data P33 corresponding to the left hand of the user U1, image data P34 corresponding to the right hand of the user U1, and image data P35 corresponding to the right foot of the user U1 is displayed in a superimposed manner. In the first specific example, the arrows P331, P341, and P351 in the image data P33, P34, and P35 are generated with reference to the difference D. The difference D is calculated with reference to the difference data D1(3), D1(4) corresponding to all frames (excluding the subsequent frames) from "frame 3" of the model image data P1 which is the previous frame to "frame 5" of the model image data P1 which is the subsequent frame. Similarly, in the first specific example, the arrival points P332, P342, and P352 in the image data P33, P34, and P35 are generated with reference to "frame 5" of the model image data P1 which is the subsequent frame.

[0072] The user U1 moves his / her right hand, left hand, and right foot in accordance with the guide image data P3 while looking at the guide image data P3 shown in Fig. 9. This makes it easier for the user U1 to maintain a state in which the user U1's movements can keep up with the movements of the performer.

[0073] On the other hand, the second specific example shown in FIG. 10 shows a situation in which "frame 2", which is the current frame of the user image data P2, matches with "frame 1", which is the frame immediately preceding the current frame of the model image data P1. In other words, in the second specific example, the movement of the user U1 lags behind the movement of the performer by one frame. For this reason, in the second specific example, the correction unit 132 of the processor 13 determines "frame 1" of the model image data P1 as the corresponding frame. Then, the correction unit 132 calculates "k1=-1". "k1" is the value of "k" when the difference data D12(n+k) is the smallest. As a result, the correction unit 132 calculates the guide correction value β1 as "β1=-k1=1".

[0074] Next, the generating unit 133 of the processor 13 calculates the offset β as "β=β0+β1=3". Then, the generating unit 133 generates the guide image data P3 based on the calculated offset β. Here, the generating unit 133 determines "frame 3" of the model image data P1, which corresponds to "frame 3" that is the frame next to "frame 2" of the user image data P2 displayed on the display 31, as the previous frame. The generating unit 133 also determines "frame 6", which is the frame that is the offset β (here, "β=3") after the previous frame of the model image data P1, as the subsequent frame.

[0075] Next, the generation unit 133 reads out the difference data D1(3), D1(4), and D1(5) corresponding to all frames (excluding the subsequent frame) from the previous frame to the subsequent frame from the memory 15. Then, the generation unit 133 generates the guide image data P3 based on the difference D obtained by adding up all the read difference data D1(3), D1(4), and D1(5).

[0076] In the second specific example, when "frame 3" which is the next frame of the user image data P2 is displayed on the display 31, the guide image data P3 including image data P33 corresponding to the left hand of the user U1, image data P34 corresponding to the right hand of the user U1, and image data P35 corresponding to the right foot of the user U1 is displayed in a superimposed manner. In the second specific example, the arrows P331, P341, and P351 in the image data P33, P34, and P35 are generated with reference to the difference D. The difference D is calculated with reference to the difference data D1(3), D1(4), and D1(5) corresponding to all frames (excluding the subsequent frames) from "frame 3" of the model image data P1 which is the previous frame to "frame 6" of the model image data P1 which is the subsequent frame. Similarly, in the second specific example, the arrival points P332, P342, and P352 in the image data P33, P34, and P35 are generated with reference to "frame 6" of the model image data P1 which is the subsequent frame.

[0077] While looking at the guide image data P3 shown in Fig. 10, the user U1 moves his / her right hand, left hand, and right foot in accordance with the guide image data P3. This makes it easier for the user U1's movements to keep up with the movements of the performers, even if the movements of the user U1 currently lag behind those of the performers.

[0078] As described above, in the dance practice system 100 according to the embodiment, when a specific frame of the user image data P2 is delayed with respect to a determined frame (corresponding frame) among the multiple frames of the model image data P1, the processor 13 generates guide image data P3 by referring to the model image data P1 that is further ahead in time, as the time difference (guide correction value β1) between the determined frame and the specific frame becomes larger. In other words, in the dance practice system 100 according to the embodiment, the processor 13 controls the timing of displaying the guide image data P3 on the display 31 to be earlier, as the time difference becomes larger.

[0079] Therefore, in the dance practice system 100 according to the embodiment, even if the user U1's movements are delayed and cannot follow the movements of the performer, the user U1 can practice the dance while viewing the guide image data P3 optimized according to the delay. Therefore, the dance practice system 100 according to the embodiment has an advantage that the user U1 can easily imitate the movements of the performer when practicing the dance, and the user U1's proficiency in the dance can easily be improved.

[0080] In the embodiment, the reason why the generation unit 133 of the processor 13 determines "frame (n+1)", which is the frame next to "frame n", as the previous frame is as follows. That is, when the user image data P2 is displayed on the display 31, the guide image data P3 is displayed superimposed, and the guide image data P3 is generated by referring to the amount of change (amount of movement) from the previous frame to the next frame in the example image data P1. Here, if the previous frame is determined to be "frame n", a process of generating guide image data P3 corresponding to "frame n" must be executed before "frame n" of the user image data P2 is displayed on the display 31. Therefore, in this case, a delay occurs from the time when the user U1 is imaged by the camera 2 until "frame n" of the user image data P2 is displayed on the display 31.

[0081] On the other hand, in the embodiment, when "frame n" of the user image data P2 is displayed on the display 31, the guide image data P3 corresponding to "frame n" generated at the time when "frame (n-1)", which is the frame before "frame n", is displayed on the display 31, is superimposed and displayed. As a result, in the embodiment, it is possible to reduce the delay from the time when the user U1 is imaged by the camera 2 to the time when "frame n" of the user image data P2 is displayed on the display 31. Here, in order to generate guide image data P3 corresponding to the next frame, "frame (n+1)", while displaying "frame n" of the user image data P2 on the display 31, "frame (n+1)" is determined as the previous frame. Then, at the timing when "frame (n+1)" of the user image data P2 is displayed, the guide image data P3 corresponding to "frame (n+1)" can be displayed on the display 31.

[0082] Note that the previous frame may be determined to be "frame n" and the next frame to be "frame (n+β)". However, if the above-mentioned delay is taken into consideration, it is preferable to determine the previous frame to be "frame (n+1)" and the next frame to be "frame (n+β+1)".

[0083] [3. Other embodiments] Although the embodiments have been described above, the present disclosure is not limited to the above-described embodiments.

[0084] In the above embodiment, the model image data P1 may be streamed from the server 4. In this case, the processor 13 of the dance practice system 100 may analyze the model image data P1 and display the model image data P1 on the display 31 every time the processor 13 acquires the model image data P1 from the server 4. In this case, the analysis unit 131 of the processor 13 may calculate, for each frame, difference data D1(n) between the coordinate data L1(n) of each part of the performer in the frame and the coordinate data L1(n-1) of each part of the performer in the previous frame.

[0085] In the above embodiment, the user image data P2 may be displayed on the display 31 as a CG (Computer Graphics) model of the user U1 instead of the user U1. In this case, the processor 13 of the dance practice system 100 may analyze the image data captured and generated by the camera 2 to obtain data analyzing the posture of the user U1 in the image data (the coordinates of each part of the user U1), and generate the above CG model based on the obtained data.

[0086] In the above embodiment, the processor 13 may determine that the user U1 is now able to follow the movement of the performer when a predetermined condition is met, for example, the state in which the guide correction value β1 becomes zero continues for a predetermined time (predetermined frames) or more. In this case, the processor 13 may cause the display 31 to display guide image data P3 instructing the user U1 to make the movement of the user U1 closer to the movement of the performer, which is more detailed. In other words, when the time difference becomes equal to or less than a threshold (here, the guide correction value β1 becomes zero), the processor 13 may cause the display 31 to display the guide image data P3 based on the movement of the performer with a higher resolution via the output I / F 14.

[0087] For example, it is assumed that the processor 13 generates and outputs guide image data P3 instructing the movement of the right hand of the user U1 before the predetermined condition is satisfied. In this case, after the predetermined condition is satisfied, the processor 13 may generate and output guide image data P3 instructing not only the movement of the right hand of the user U1 but also the movement of the fingers of the right hand of the user U1.

[0088] In the above embodiment, the model image data P1 is image data showing the movements of one performer, but is not limited to this. For example, the model image data may be image data showing the movements of multiple performers. In this case, the processor 13 may extract one performer from the multiple performers using an appropriate image analysis algorithm, and set the image data showing the movements of the extracted one performer as the model image data P1.

[0089] In the above embodiment, the analysis of the model image data P1 by the analysis unit 131 is completed before the model image data P1 is displayed on the display 31, but this is not limited to the above. For example, the analysis of the model image data P1 by the analysis unit 131 may be performed in parallel with the process of displaying the model image data P1 on the display 31.

[0090] In the above embodiment, the destination point in the guide image data P3 is a star, but is not limited thereto and may be other shapes such as a circle or a shape imitating a human hand or foot. Also, the arrow in the guide image data P3 is not limited thereto and may be other shapes such as a triangle or a solid or broken line. Also, in the embodiment, the destination point and the arrow in the guide image data P3 change both the shading and the size according to the amount of movement, but only one of them may be changed. Also, the destination point and the arrow in the guide image data P3 may have a constant shading and size regardless of the amount of movement.

[0091] In the above embodiment, the position of the sub-screen 312 is not limited to the lower right corner of the display 31, but may be other places on the display 31. The shape of the sub-screen 312 is not limited to a rectangular shape, but may be other shapes. Furthermore, the size of the sub-screen 312 may be larger or smaller than the size shown in FIG. 2.

[0092] In the above embodiment, the dance practice system 100 is mounted on the computer 3, but is not limited thereto. For example, the dance practice system 100 may be realized by a server that communicates with each of the camera 2 and the display 31 via a network N1 such as the Internet. The server may be the same as the server 4 for video distribution in the embodiment, or may be different. For example, the dance practice system 100 may be realized by a general-purpose information terminal such as a smartphone or tablet terminal. In this case, the dance practice system 100 can be realized by the information terminal by installing an application for the dance practice system 100 in the information terminal. For example, the dance practice system 100 may be configured as a television receiver equipped with the computer 3 and the display 31.

[0093] In the above embodiment, the dance practice system 100 is realized by a single device, but may be realized by multiple devices. When the dance practice system 100 is realized by multiple devices, the functional components of the dance practice system 100 may be distributed to the multiple devices in any manner. For example, the dance practice system 100 may be realized by being distributed to multiple servers. Also, for example, the dance practice system 100 may be realized by being distributed to a server and a computer 3.

[0094] Furthermore, the method of communication between the devices in the above-described embodiments is not particularly limited. When two devices communicate with each other in the above-described embodiments, a relay device (not shown) may be interposed between the two devices.

[0095] The order of the processes described in the above embodiment is merely an example. The order of the processes may be changed, or the processes may be executed in parallel. A process executed by a specific processing unit may be executed by another processing unit. A part of the digital signal processing described in the above embodiment may be realized by analog signal processing.

[0096] In the above embodiment, each component may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.

[0097] Furthermore, each component may be realized by hardware. For example, each component may be a circuit (or an integrated circuit). These circuits may form a single circuit as a whole, or each may be a separate circuit. Furthermore, each of these circuits may be a general-purpose circuit, or a dedicated circuit.

[0098] In addition, the general or specific aspects of the present disclosure may be realized in a system, an apparatus, a method, an integrated circuit, a computer program, or a computer-readable recording medium such as a CD-ROM. In addition, the present disclosure may be realized in any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium. For example, the present disclosure may be implemented as a dance practice method executed by a computer, or may be realized as a program for causing a computer to execute such a dance practice method. In addition, the present disclosure may be realized as a computer-readable non-transitory recording medium on which such a program is recorded. In addition, the program here includes an application program for causing a general-purpose information terminal to function as the dance practice system of the above embodiment.

[0099] In addition, the present disclosure also includes forms obtained by applying various modifications to each embodiment that a person skilled in the art may conceive, or forms realized by arbitrarily combining the components and functions of each embodiment within the scope that does not deviate from the spirit of the present disclosure.

[0100] (summary) As described above, the dance practice system 100 according to the first embodiment includes the first input I / F 11, the second input I / F 12, the processor 13, and the output I / F 14. The processor 13 is an example of a signal processing circuit. The first input I / F 11 acquires user image data P2 including a plurality of frames showing the movements of the user U1 based on image data captured by the camera 2. The second input I / F 12 acquires model image data P1 including a plurality of frames showing the movements of a dance model performer. The processor 13 generates guide image data P3 that instructs the user U1 to make the movements of the user U1 closer to the movements of the performer. The output I / F 14 displays the user image data P2, the model image data P1, and the guide image data P3 on the display 31. The processor 13 determines which of the frames of the model image data P1 corresponds to a specific frame acquired at a predetermined time among the frames of the user image data P2. When a specific frame is delayed from a determined frame among a plurality of frames of model image data P1, the processor 13 controls the timing of displaying guide image data P3 on the display 31 to be advanced as the time difference between the determined frame and the specific frame increases.

[0101] This has the advantage that the user U1 can easily improve his / her dance proficiency when practicing the dance.

[0102] In addition, in the dance practice system 100 of the second aspect, in the first aspect, the processor 13 generates guide image data P3 by referring to a frame from among the multiple frames of the model image data P1 that is a time period that corresponds to a time difference after a predetermined point in time.

[0103] This has the advantage that the user U1 can easily improve his / her dance proficiency when practicing the dance.

[0104] In addition, in the dance practice system 100 of the third aspect, in the first or second aspect, the processor 13 displays model image data P1 on the display 31 via the output I / F 14 at the timing at which the user U1 is desired to perform an action, and displays guide image data P3 on the display 31 via the output I / F 14 at a timing earlier than that timing.

[0105] This has the advantage that by looking at the guide image data P3, the user U1 can more easily follow the movements of the performer with his or her own movements.

[0106] In addition, in the dance practice system 100 according to the fourth aspect, in any one of the first to third aspects, the guide image data P3 changes at least one of the size and the shading depending on the difference between the movement of the user U1 and the movement of the performer.

[0107] This has the advantage that the user U1 can easily visually grasp how much movement is required to perform the next action by looking at the guide image data P3.

[0108] In addition, in the dance practice system 100 of the fifth aspect, in any one of the first to fourth aspects, when the above-mentioned time difference is below a threshold value, the processor 13 displays guide image data P3 based on the performer's movements with increased resolution on the display 31 via the output I / F 14.

[0109] This has the advantage that if user U1 is able to follow the movements of the performer, he or she can be guided to imitate the movements of the performer more precisely, making it easier for the user U1 to further improve their dance proficiency.

[0110] In addition, in the dance practice system 100 of the sixth aspect, in any one of the first to fifth aspects, the guide image data P3 includes destination points P312 to P352 indicating the position that the user U1 should reach next on the display 31, and arrows P311 to P351 indicating the direction and amount of movement from the current position of the user U1 to the destination points P312 to P352 on the display 31.

[0111] This has the advantage that the user U1 can easily visually grasp how to perform the next action by looking at the guide image data P3.

[0112] In addition, in the dance practice method according to the seventh aspect, user image data P2 including a plurality of frames showing the movements of the user U1 based on image data captured and generated by the camera 2 is acquired, model image data P1 including a plurality of frames showing the movements of a performer who is a model for the dance is acquired, guide image data P3 instructing the user U1 to make the movements of the user U1 closer to the movements of the performer is generated (S32), and the user image data P2, model image data P1, and guide image data P3 are displayed on the display 31. In the process of generating the guide image data P3, it is determined which of the frames of the model image data P1 corresponds to a specific frame acquired at a predetermined time among the frames of the user image data P2 (S21, S22). Then, in the above process, if the specific frame is delayed with respect to the determined frame (corresponding frame) among the frames of the model image data P1, the larger the time difference between the determined frame and the specific frame, the earlier the timing of displaying the guide image data P3 on the display 31 is controlled (S23, S31, S32).

[0113] This has the advantage that the user U1 can easily improve his / her dance proficiency when practicing the dance.

[0114] Also, a program according to an eighth aspect causes one or more processors to execute the dance practice method according to the seventh aspect.

[0115] This has the advantage that the user U1 can easily improve his / her dance proficiency when practicing the dance. [Industrial Applicability]

[0116] The present disclosure is applicable to systems for assisting users in practicing dance, and the like. [Explanation of symbols]

[0117] 100 Dance Practice System 11 1st input I / F 12 2nd input I / F 13 Processor (signal processing circuit) 131 Analysis Department 132 Correction section 133 Generation part 134 Overlapped section 135 Synthesis Section 14 Output I / F 15 Memory 2 Camera 3. Computer 31 Display 311 Main screen 312 Subscreen 4 Server N1 Network P1 Example image data P2 User image data P3 Guide image data P31, P32, P33, P34, P35 Image data P311, P321, P331, P341, P351 Arrows P312, P322, P332, P342, P352 Achievement point U1 User

Claims

1. a first input interface configured to acquire user image data including a plurality of frames showing a user's actions based on image data captured by a camera; a second input interface for acquiring model image data including a plurality of frames showing a movement of a dance model performer; a signal processing circuit for generating guide image data for instructing the user to make the user's movements closer to the movements of the performer; an output interface for displaying the user image data, the model image data, and the guide image data on a display; The signal processing circuit includes: determining which of the frames of the model image data corresponds to a specific frame acquired at a predetermined time among the plurality of frames of the user image data; When the specific frame is delayed with respect to the determined frame among the plurality of frames of the model image data, the larger the time difference between the determined frame and the specific frame, the earlier the timing of displaying the guide image data on the display is controlled. Dance practice system.

2. The signal processing circuit includes: generating the guide image data by referring to a frame that is a time period corresponding to the time difference after the predetermined time point among the plurality of frames of the model image data; The dance practice system according to claim 1 .

3. The signal processing circuit includes: displaying the sample image data on the display via the output interface at a timing when the user is to perform an action; displaying the guide image data on the display via the output interface at a timing earlier than the timing; The dance practice system according to claim 1 or 2.

4. The guide image data is changed in at least one of size and shade depending on a difference between the user's movement and the performer's movement. The dance practice system according to claim 1 or 2.

5. When the time difference is equal to or less than a threshold value, the signal processing circuit displays the guide image data based on the movement of the performer with a higher resolution on the display via the output interface. The dance practice system according to claim 1 or 2.

6. The guide image data is a destination point indicating a location on the display where the user should next reach; and an arrow indicating a direction and amount of movement from the user's current position to the destination point on the display. The dance practice system according to claim 1 or 2.

7. acquiring user image data including a plurality of frames showing a user's actions based on image data captured by the camera; Acquire example image data including a plurality of frames showing the movements of a dance performer as an example; generating guide image data instructing the user to make the user's movements closer to the movements of the performer; Displaying the user image data, the example image data, and the guide image data on a display; In the process of generating the guide image data, determining which of the frames of the model image data corresponds to a specific frame acquired at a predetermined time among the plurality of frames of the user image data; When the specific frame is delayed with respect to the determined frame among the plurality of frames of the model image data, the larger the time difference between the determined frame and the specific frame, the earlier the timing of displaying the guide image data on the display is controlled. How to practice dance.

8. One or more processors, 8. A method for practicing dance according to claim 7, program.

Images