Video playback device and video playback program

Abstract

An object is to easily customize the playback state of a video to realize video playback. 【Solution means】The video playback apparatus includes a setting unit that sets parameters related to the playback state of a first video, and a playback control unit that controls the playback state of a second video in a display mode including a mode of simultaneously displaying the first video and a second video different from the first video based on the setting of the parameters.

Description

Technical Field

[0001] The present invention relates to a video playback device and a video playback program.

Background Art

[0002] In various sports, the motions performed in the sport are practiced. For example, in the case of dance, practice is carried out using the choreography of the dance performed by the instructor as a model.

[0003] For the practice of motions, from the aspect that requires memorization of the motion to be used as a model and practice of the motion by the individual, practice is carried out by trial and error while playing back a reference video in which the reference motion is photographed or a practice video in which the individual's motion is photographed on a media player.

[0004] When playing back a video on a media player in this way, functions for controlling the playback state such as tempo change for changing the playback speed of the video and repeat playback for repeatedly playing back the video are utilized.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] However, with the functions provided by the above media players and the like, it is difficult for the user to customize the playback state of the video according to the application such as for personal practice, and there is room for improvement.

[0007] One aspect is to provide a video playback device and a video playback program that can easily customize the playback state of the video and realize video playback.

Means for Solving the Problems

[0008] A video playback device related to one side includes a setting unit that sets parameters related to the playback state of a first video, and a playback control unit that controls the playback state of a second video in a display mode including a mode of simultaneously displaying the first video and a second video different from the first video based on the setting of the parameters.

Effect of the Invention

[0009] According to one embodiment, the playback state of a video can be easily customized to realize video playback.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Figure 24

[0011] Hereinafter, embodiments for implementing a video playback apparatus and a video playback program according to the present disclosure (hereinafter, referred to as "embodiments") will be described with reference to the accompanying drawings. Note that this embodiment merely shows one example or aspect, and the structure, operation, function, nature, characteristics, method, use, etc. according to the present disclosure are not limited by such an exemplification.

[0012] <Embodiment 1> <System Configuration> FIG. 1 is a diagram showing a configuration example of a video providing system. FIG. 1 shows a video providing system 1 that provides, as a reference video, the content that an instructor teaches in a lesson to students before the start of the lesson. For example, when applying the video providing system 1 to a dance school, a reference video in which the choreography of the dance that the instructor teaches in the lesson is filmed is provided to the students.

[0013] As shown in FIG. 1, the video providing system 1 may include a server device 10, instructor terminals 20A to 20M, and student terminals 30A to 30N. Hereinafter, when it is not necessary to distinguish the individual instructor terminals 20A to 20M, the instructor terminals 20A to 20M may be referred to as "instructor terminal 20". Similarly, when it is not necessary to distinguish the individual student terminals 30A to 30N, the student terminals 30A to 30N may be referred to as "student terminal 30".

[0014] The server device 10, the instructor terminal 20, and the student terminal 30 may be communicably connected via an arbitrary network NW. Note that the network NW may be realized by an arbitrary type of communication network such as the Internet or a LAN (Local Area Network), regardless of whether it is wired or wireless.

[0015] The server device 10 is an example of a computer that provides ICT (Information and Communication Technology) services related to a dance school. For example, the server device 10 may be realized by a supplier of the above-described ICT services, with a dance school, a dance studio, or other business operators that provide lessons as customers, and students who take the lessons as end users.

[0016] As one embodiment, the server device 10 can provide the above-described video providing function as a cloud service by executing PaaS (Platform as a Service)-type middleware or SaaS (Software as a Service)-type applications.

[0017] In such ICT services, as an example only, various functions such as a reservation function for accepting lesson reservations and a video providing function for providing the above-described reference video before the start of a lesson may be packaged.

[0018] The instructor terminal 20 is a terminal device used by an instructor belonging to a dance school or the like. Also, the student terminal 30 is a terminal device used by a student who participates in a lesson offered by a dance school or the like. Note that the instructor terminal 20 and the student terminal 30 are examples of video playback devices.

[0019] These instructor terminal 20 and student terminal 30 may be realized by any computer such as a personal computer, including smart devices such as smartphones, tablet terminals, and wearable terminals.

[0020] For example, applications for dancers that realize various functions such as a music editing function, a video playback function, and a photographing function may be installed on the instructor terminal 20 and the student terminal 30. Hereinafter, the application for dancers may be referred to as the "dancer-oriented APP" in some cases.

[0021] As one aspect, a reference video in which the content taught by the instructor in a lesson, for example, dance choreography, is photographed may be uploaded from the instructor terminal 20 to the server device 10. As a further aspect, the reference video uploaded from the instructor terminal 20 to the server device 10 may be downloaded from the server device 10 to the student terminal 30.

[0022] Hereinafter, as an example of a use case, an example will be given in which the instructor terminal 20 and the student terminal 30 are realized by a smart device such as a smartphone, and an explanation will be given.

[0023] Note that, here, an example in which the above ICT service is provided as a cloud service has been given, but it is not limited to this. For example, the above ICT service may be provided on-premises.

[0024] <Pickup> FIG. 2 is a diagram for explaining an example of the flow of a dance lesson. In FIG. 2, only an example of the menu performed on the day of the lesson is listed in chronological order. For example, in the example shown in FIG. 2, in a dance lesson, the menu is performed in the order of "stretch", "isolation", "introduction", "dance to the music", "pickup shooting", and "SNS post". Note that SNS is an abbreviation for "Social Networking Service".

[0025] Among these, "pickup" means that a student selected by the instructor from among the students receiving the lesson at the end of the lesson dances in front of everyone together with the instructor. The dance between the student picked up in this way and the instructor may be posted on SNS or the like after being photographed.

[0026] In this way, "pickup" becomes a pseudo-experience of standing on the same stage as a teacher whom the student admires or respects, and thus it is one of the motivations of the students taking the dance lesson.

[0027] <One aspect of the problem> However, it is normal for students with relatively high skills to be selected for pickup, and the possibility of students with relatively low skills being selected for pickup is low. If such students continue to not be selected for pickup even though they have a high motivation to be selected for pickup, their motivation to participate in the dance lesson will also decrease.

[0028] Figure 3 is a diagram showing an example of the business model of a dance school. In Figure 3, an example of the business model carried out by a conventional dance school is shown. As shown in Figure 3, the business model of a dance school may include, as stakeholders, a dance school, an instructor, and a student.

[0029] On one aspect, the reservation for lessons held by the dance school and the payment of the fees for the lessons attended by the student are made from the student to the dance school. On another aspect, the provision of a space for the instructor to conduct lessons for the student offline and the payment of the consideration for the lessons given by the instructor to the student are made from the dance school to the instructor. In this way, a business model is constructed in which an instructor belonging to the dance school conducts offline lessons for students recruited by the dance school in the studio provided by the dance school.

[0030] In the case of such a business model, from the perspective of the student side, the following matters 1) to 4) are factors contributing to the decrease in the motivation of the student to participate in dance lessons. 1) Since the content of the lesson is not known in advance, it is not known whether the content one wants to take is what one will receive until taking the lesson. 2) Even if it is the content one wants to take, it is difficult to memorize the choreography during the lesson. 3) Since it is embarrassing to be seen by the teacher and other students in the posture one cannot do, one has to take the class at the back. 4) As a result of the above 1) to the above 3), one is not selected for the pick-up either.

[0031] Due to the factors of the above 1) to the above 4), the student cannot fully enjoy the lesson, the satisfaction of the student becomes low, and the added value of the dance lesson also decreases.

[0032] <One aspect of the problem-solving approach> Therefore, in the video providing system 1 according to the present embodiment, before the start of a lesson, an instructor provides a student terminal 30 with a reference video in which the content to be taught in the lesson, for example, a dance choreography, is filmed, thereby realizing preview and advance learning of the lesson content that has not been studied yet.

[0033] FIG. 4 is a diagram showing one aspect of the problem-solving approach. As shown in FIG. 4, in the instructor terminal 20, the content to be taught by the instructor in the lesson, for example, a dance choreography, is filmed as a reference video (step S1). The reference video filmed in this way is uploaded from the instructor terminal 20 to the server device 10 (step S2).

[0034] Furthermore, the reference video uploaded from the instructor terminal 20 to the server device 10 is downloaded from the server device 10 to the student terminal 30 before the start of the lesson (step S3). Then, the student terminal 30 plays the reference video downloaded from the server device 10 (step S4).

[0035] In this way, by providing the reference video before the start of the lesson, it is possible to preview and advance learn the content of the lesson conducted during the actual performance.

[0036] <Another aspect of an independent problem> Here, when starting with the above reference video and playing and previewing a student video filmed by a student, in a conventional technology such as a media player, it is difficult for a user to customize the playback state of the video according to the application, such as for personal practice, and there is room for improvement.

[0037] For example, in the case of dance, if the parts that a person is weak at in the dance choreography differ from person to person, the number and range of the weak parts also differ. Furthermore, the playback speed of the video for checking the dance choreography also differs from person to person. Even if one tries to customize the settings of the playback function that the above media player has according to personal practice, the functions and settings desired in personal practice may be lacking in the above media player.

[0038] <One aspect of another solvable problem approach> Therefore, the APP for dancers according to this embodiment has, as part of the above video playback function, a playback control function that controls the playback state of the model video in the display mode in which the student video and the model video are simultaneously displayed based on the setting of parameters related to the playback state of the model video.

[0039] The "parameters related to the playback state" mentioned here may include, as an example, playback speed, playback position (playback time), loop, and other parameters that define the playback state.

[0040] FIG. 5 is a diagram showing one aspect of another problem-solving approach. In FIG. 5, as an example, there is shown a playback control screen 300 displayed on the display unit 32 of the student terminal 30, which is an example of a user interface that provides the above playback control function.

[0041] As shown in FIG. 5, the playback control screen 300 may include a video display area 310 where the video to be played is displayed, and a playback state setting area 320 that accepts the setting of parameters related to the playback state of the model video.

[0042] Among these, in the video display area 310, simultaneous playback of the student video and the model video can be performed. The "simultaneous playback" mentioned here may include "overlay display" in which two videos, the student video and the model video, are superimposed and displayed, and "two-screen display" in which two videos, the student video and the model video, are arranged side by side and displayed. By these display modes such as "overlay display" and "two-screen display", comparison of the two videos, the student video and the model video, becomes possible.

[0043] The playback state setting area 320 may include, as an example, a tempo change tab 321 for changing the playback speed of the video, a loop setting tab 322 for accepting the designation of loop among the playback times of the video, and a marker setting tab 323 for accepting the designation of the playback position of the video.

[0044] These tempo change tabs 321, loop setting tabs 322, and marker setting tabs 323 enable the calling of functions for changing the playback speed, loop function, and marker function.

[0045] For example, even when the number or range of parts that a person is not good at in dance choreography varies from person to person, by calling the marker function, each of the difficult parts can be played in preview, or by calling the loop function, the difficult range can be repeated and played. Also, even when the playback speed of the video for checking dance choreography varies from person to person, by calling the playback speed change function, it can be played at a playback speed that allows for checking of the difficult parts.

[0046] Therefore, according to the above video playback function, the playback state of the video can be easily customized to realize video playback. For this reason, by using the above video playback function for previewing or pre-studying the content of the lessons conducted in the actual performance, the learning efficiency such as pre-studying and previewing can be improved.

[0047] As an example, it is possible to support users who independently practice the lesson content before taking the lesson by using the above video playback function. Thereby, for example, in the case of a dance lesson, a chance can be provided to increase the possibility of being selected for the dance lesson pick-up.

[0048] For example, as shown in FIG. 4, the factors for the decrease in motivation of the above 1) to 4) shown in FIG. 3 can be overcome. 1A) By sharing the lesson content in advance, students can receive the content they want to receive at the time they want to receive it. 2A) It is possible to preview to a certain level by using the above video playback function, and at the same time, students can repeat and practice the parts they are not good at at their own pace. 3A) Since preview can be carried out as individual practice, so-called self-practice, there is no hesitation in making mistakes in choreography etc., and preview can be done without sacrificing enthusiasm. As a result, students can participate in the lesson with confidence without worrying about being seen by others, and the possibility of being selected for the pick-up increases. 4A) By having fun and improving dance skills, one will be motivated to continue taking dance lessons.

[0049] According to the above 1A) to 4A), the satisfaction of the students is enhanced, and the added value of the dance lessons is also improved, thereby realizing the user story mapping shown in FIG. 6.

[0050] FIG. 6 is a diagram showing an example of user story mapping. As shown in FIG. 6, conventionally, students with relatively low skills are likely to fall into a cycle of reserving lessons, attending lessons, watching the pick-up, and reserving the next lesson. By repeating such a cycle, only students with relatively high skills continue to be selected for the pick-up, and the expectation of other students being selected for the pick-up continues to be damaged. As a result, the motivation of students who are not easily selected for the pick-up to participate in dance lessons continues to decline.

[0051] On the other hand, according to the video providing function according to the present embodiment, a student can increase the possibility of being selected for the pick-up by reserving a lesson and previewing the lesson before attending the lesson, and can create a cycle of reserving the next lesson in a state of high motivation to participate in dance lessons. As a result, not only students with relatively high skills but also all students participating in the lessons can increase the expectation of being selected for the pick-up, and thus the motivation to participate in dance lessons can also be improved.

[0052] Here, the case where the above two functions of the video providing function and the video playback function are combined and used is illustrated. However, it is also possible that only one of the above video providing function and the video playback function is provided. For example, the above video playback function can also be applied to use cases other than preview learning and previewing of lessons. That is, it goes without saying that the reference video does not necessarily have to be a video in which the dance choreography by the instructor of the lesson school is photographed, and the above video playback function can be used to play any reference video publicly available on the Internet.

[0053] Also, here, as an example of the above model video and the above student video, a dance video in which a dance choreography is filmed is taken as an example, but it is not limited to this. For example, in addition to dance videos, motions of baseball, golf, and other sports may be filmed as model videos and student videos.

[0054] <Configuration of Each Device> Next, the configuration of each device included in the video providing system 1 according to the present embodiment will be described. FIG. 7 is a block diagram showing an example of the functional configuration of each device. In FIG. 7, blocks related to the functions of the server device 10, the instructor terminal 20, and the student terminal 30 are schematically shown. Note that in FIG. 7, only the functional parts related to the above ICT service and the above video playback function are shown in an extract, and it is also possible that functional parts other than those shown in the figure are provided in each device.

[0055] <Configuration of Instructor Terminal> First, an example of the functional configuration of the instructor terminal 20 according to the present embodiment will be described. As shown in FIG. 7, the instructor terminal 20 includes an input unit 21, a display unit 22, an imaging unit 23, a recording unit 24, an output control unit 25, and a request unit 26. Of course, it does not prevent the provision of functional parts other than the functional parts shown in FIG. 7, such as a communication control unit that provides a communication interface and a storage unit realized by a storage.

[0056] The input unit 21 has a function of receiving various instruction inputs. For example, the input unit 21 may be realized by an OS (Operating System) or an application operating on the instructor terminal 20, for example, a GUI (Graphical User Interface) provided by an APP for dancers.

[0057] The display unit 22 has a function of displaying various information. As one aspect, the display unit 22 may be realized by a liquid crystal display, an organic EL (Electro Luminescence) display, or the like.

[0058] These input unit 21 and display unit 22 can be integrated as a display input unit realized by a touch panel or the like.

[0059] The imaging unit 23 has an imaging function for imaging an image. The "image" referred to here may be either a still image or a moving image. For example, when the instructor terminal 20 is realized by a smart device, the imaging unit 23 can be realized by a camera unit such as a front camera arranged in the same direction as the screen surface of the display unit 22 or a rear camera arranged on the back of the screen of the display unit 22.

[0060] The recording unit 24 has a recording function for recording the image captured by the imaging unit 23. As one aspect, the recording unit 24 can record the content that the instructor guides in the lesson, for example, a sample video in which the dance choreography is filmed.

[0061] Such a recording function may be realized as one of the modules packaged in the APP for dancers. For example, the recording function is activated by receiving an operation of a video recording button that receives a recording request from the main menu screen provided by the APP for dancers.

[0062] When the recording function is activated in this way, it transitions to a music selection screen for selecting a music to be embedded in the sample video from the main menu screen. For example, the music selection screen may include music file(s) downloaded and purchased with the instructor's account as music options. In addition, music file(s) provided by the streaming service subscribed to with the instructor's account or music file(s) generated from the project file edited by the above music editing function may also be included. Then, when the music to be embedded in the sample video is selected via the input unit 21 on the music selection screen, it transitions from the music selection screen to the recording screen.

[0063] FIG. 8 is a schematic diagram showing an example of a method for recording a reference video. In FIG. 8, the state in which the recording screen 400 displayed on the display unit 22 of the instructor terminal 20 transitions according to the operation procedure is schematized from left to right. As shown in FIG. 8, the recording screen 400 may include a live video display area 410 and a setting window 420.

[0064] Among these, in the live video display area 410, a live video captured in real time by the imaging unit 23 is displayed. The setting window 420 is a window that accepts setting of the playback time at which recording starts among the playback times of the music to be embedded in the reference video. For example, the setting window 420 may be displayed overlapping the front of the live video display area 410.

[0065] The setting window 420 may include a slider bar (seek bar) 421, a slider 421A, a playback button 422, and a recording button 423. For example, the slider bar 421 corresponds to the range of the playback time of the music selected on the music selection screen, and the slider 421A indicates the playback position, that is, the playback time. This slider 421A can be moved by a drag operation or by playing the music by pressing the playback button 422.

[0066] When such a slider 421A is set at the position of the playback time at which recording is desired to start and the recording button 423 is pressed, a recording start button 430 is displayed on the recording screen 400. Note that the display of the recording start button 430 may be linked to the non-display of the setting window 420.

[0067] Here, when the recording start button 430 is operated, recording of the live video captured in real time by the imaging unit 23 is started. At this time, the recording of the live video can also start after performing a countdown display for a predetermined time, such as 3 seconds or 5 seconds. When recording is started in this way, the recording start button 430 switches to a recording stop button 440.

[0068] Then, until the recording ends due to the end of the playback time of the music or the recording is stopped by the recording stop button 440, the recording unit 24 continues the following recording process. For example, the recording unit 24 sets the time code (HH:MM:SS:FF) of the playback time of the music being played back to the video of the nth frame captured by the imaging unit 23. Then, the recording unit 24 records the video with the time code set. As a result, the time code of the music is embedded in each frame of the video included in the reference video.

[0069] After that, when the recording ends due to the end of the music playback or the recording is stopped by the recording stop button 440, the recording unit 24 saves the video captured during the period from the playback time corresponding to the start of the recording to the playback time corresponding to the end of the music playback or the recording stop as the reference video 40 to a storage (not shown) or the like.

[0070] The reference video recorded in this way may be uploaded from the instructor terminal 20 to the server device 10. At this time, the reference video uploaded to the server device 10 is registered in the reference video DB 12 in a state where the identification information of the instructor who is the creator and the identification information of the lesson are associated.

[0071] The output control unit 25 has a function of controlling the output related to various types of information. The "output" mentioned here may include display output and audio output. As one aspect, the output control unit 25 can cause the display unit 22 to display a student video viewing screen including a GUI component that accepts an instruction input for requesting viewing of a student video uploaded from the student terminal 30 to the server device 10 and an input of a comment on the student video. For example, the viewing of the student video may be realized by accessing a link in which the server device 10 embeds the student video and a media player for playing the student video. In addition, the viewing of the student video may be realized by causing a video playback function included in the APP for dancers to play the student video downloaded from the server device 10. Also, the input of a comment on the student video may be realized by a GUI element such as a text box.

[0072] The request unit 26 has a function of transmitting a request to the server device 10. As one aspect, when the request unit 26 accepts an input of a comment on a student video via the student video viewing screen, it can request the server device 10 to register the accepted comment. The comment for which registration is requested from the instructor terminal 20 to the server device 10 in this way is registered in the comment DB 14 described later in a state associated with the identification information of the instructor as the reply source and the identification information of the student as the reply destination.

[0073] <Configuration of the server device> Next, a functional configuration example of the server device 10 according to the present embodiment will be described. As shown in FIG. 7, the server device 10 includes a program DB (DataBase) 11, a model video DB 12, a student video DB 13, a comment DB 14, a first providing unit 15, and a second providing unit 26. Of course, it does not prevent the server device 10 from including functional units other than the functional units shown in FIG. 7, for example, a communication control unit that provides a communication interface and a storage unit realized by a storage.

[0074] The program DB 11 is a database that stores lesson programs. The "lesson program" mentioned here is a program in which the schedules of multiple lessons are determined. As one aspect, the program DB 11 may be data in which identification information of lessons to be conducted in each time zone is associated with each time zone.

[0075] The model video DB 12 is a database that stores a collection of model videos. As one aspect, meta-information such as identification information of the instructor who is the creator and identification information of the lesson may be associated with the model videos stored in the model video DB 12.

[0076] The student video DB 13 is a database that stores a collection of student videos. As one aspect, meta-information such as account information of the student who is the creator, identification information of the lessons the student participates in, and identification information of the instructor in charge of the lessons may be associated with the student videos stored in the student video DB 13.

[0077] The comment DB 14 is a database that stores a collection of comments. As one aspect, meta-information such as identification information of the instructor who is the reply source and identification information of the student who is the reply destination may be associated with the comments stored in the comment DB 14.

[0078] The first providing unit 15 has a function of providing ICT services to the student terminal 30. As shown in FIG. 7, the first providing unit 15 includes a reservation unit 15A, a video providing unit 15B, and a calculation unit 15C.

[0079] The reservation section 15A has a reservation function for accepting reservations for lessons. As one aspect, when the reservation section 15A receives a request to view a lesson program from the student terminal 30, it reads out the lesson program for the date and time zone specified by the request from the program DB 11. Then, the reservation section 15A provides the student terminal 30 with a lesson selection screen for accepting an instruction input to request viewing of a model video for each lesson included in the lesson program and an instruction input for a lesson requesting taking the lesson.

[0080] Figure 9 is a diagram showing an example of the lesson selection screen 500. As shown in Figure 9, the lesson selection screen includes day-of-the-week selection buttons 511 to 517 and a lesson display column 520. These day-of-the-week selection buttons 511 to 517 correspond to each day of the week from Monday to Sunday. Here, as an example only, an example where the day of the week is displayed is given, but other calendar information such as the year, month, and day may be displayed together with the day of the week. In the lesson display column 520, lessons held on the day of the week corresponding to the selected day-of-the-week selection button among the day-of-the-week selection buttons 511 to 517 are arranged. For example, in the example shown in Figure 9, in the lesson display column 520, among the lessons held on Wednesday corresponding to the day-of-the-week selection button 514, lesson information 530 starting at 13:00 and lesson information 540 starting at 15:00 are shown in an excerpt.

[0081] Among these, the lesson information 530 includes a display area 531 for the reference video and a display area 532 for the detailed lesson information. Further, the display area 531 for the reference video includes a play button 531A and a download button 531B. The playback and download of the reference video using the operations of these play button 531A and download button 531B may be restricted or prohibited before the reservation of the lesson. For example, the playback and download of the reference video may be completely prohibited until the lesson is reserved, or only the playback of some sections of the reference video may be permitted. The sections where playback is permitted in this way may be specified from the instructor terminal 20, or specific developments of the music played in the reference video, for example, sections belonging to the refrain, may be automatically set. However, the restriction or prohibition of playback and download before the reservation of the lesson is only an example, and the playback and download of the entire section of the reference video may be permitted before the reservation of the lesson.

[0082] After the reservation of the lesson, if the operation of the play button 531A is received, the reference video can be played by the media player incorporated in the lesson information 531. Also, when the operation of the download button 531B is received, the reference video is provided to the student terminal 30 by the video providing unit 15B described later. As a result, the reference video is downloaded to the student terminal 30, and the use of the above video playback function becomes possible.

[0083] Also, in the display area 532 for the detailed lesson information, detailed information such as the time zone when the lesson is held, the name of the instructor in charge, the genre of the lesson, and the lesson name is displayed, and a reservation reception button 532A for receiving the reservation of the lesson is arranged. For example, when the operation of the reservation reception button 532A is received, the reservation unit 15A registers the account information assigned to the student who is the user of the student terminal 30, for example, the identification information of the student, in the participation frame of the lesson. Note that, regarding the lesson information 540, there is no difference in function even if the target lesson is different.

[0084] The video providing unit 15B has a function of providing a model video. As an example only, when the video providing unit 15B receives a request to download a model video, for example, an operation of a download button included in the lesson selection screen 500 shown in FIG. 9, it provides the student terminal 30 with the model video of the lesson specified by the request among the model videos stored in the model video DB 12.

[0085] The calculation unit 15C has a function of calculating evaluation indexes of the dance between the model video and the student video. As an example of such an evaluation index, the synchronization rate of the dance is cited. The higher the synchronization rate is, the more it indicates that the movement of the instructor in the model video and the movement of the student in the student video match. Here, the "movement" may refer to, for example, the time-series change of the posture corresponding to the choreography of the dance. In one aspect, when the calculation unit 15C receives a request to calculate the synchronization rate from the student terminal 30, it reads out the model video of the lesson specified by the request among the model videos stored in the model video DB 12, and reads out the student video of the lesson specified by the request among the student videos stored in the student video DB 13. Then, the calculation unit 15C calculates the synchronization rate of the dance of the student video with respect to the model video. For example, the synchronization rate may be calculated from the degree of coincidence of the angles of specific joints, such as the angles of the arm, elbow, wrist, foot, knee, ankle, etc., by comparing the frames of the model video and the frames of the student video. For calculating such a synchronization rate, a framework of a machine learning model that realizes object detection for detecting the position of the bounding box of an object in the image and classifying the object for each frame of the model video and the frames of the student video, skeleton detection for detecting the position of each joint from the image of the bounding box corresponding to the object to which the label of "person" is assigned as a result of the object detection and classification, and scoring for calculating the synchronization rate from the degree of coincidence of the joint angles can be used. The synchronization rate calculated in this way is output to the student terminal 30 as a response.

[0086] The second providing unit 16 has a function of providing ICT services to the instructor terminal 20. As one aspect, when a student video is uploaded from the student terminal 30, the second providing unit 16 provides a student video viewing screen including GUI components that accept an instruction input to request viewing of the student video and an input of a comment on the student video to the instructor terminal 20 used by an instructor in charge of a lesson corresponding to the student video.

[0087] <Configuration of Student Terminal> Next, a functional configuration example of the student terminal 30 according to the present embodiment will be described. As shown in FIG. 7, the student terminal 30 includes an input unit 31, a display unit 32, an imaging unit 33, a student video DB 34, a recording unit 35, a request unit 36, an UL (UpLoad) unit 37, a setting unit 38, and an output control unit 39. Of course, it does not prevent the provision of functional units other than the functional units shown in FIG. 7, such as a communication control unit that provides a communication interface and a storage unit realized by a storage.

[0088] The input unit 31 has a function of accepting various instruction inputs. For example, the input unit 31 may be realized by a GUI provided by an OS or an application operating on the student terminal 30, such as an APP for dancers.

[0089] The display unit 32 has a function of displaying various information. As one aspect, the display unit 32 may be realized by a liquid crystal display, an organic EL display, or the like.

[0090] The input unit 31 and the display unit 32 may be integrated as a display input unit realized by a touch panel or the like.

[0091] The imaging unit 33 has an imaging function for capturing images. The "image" referred to here may be either a still image or a moving image. For example, when the student terminal 30 is realized by a smart device, the imaging unit 33 can be realized by a camera unit such as a front camera arranged in the same direction as the screen surface of the display unit 32 or a rear camera arranged on the back of the screen of the display unit 32.

[0092] The student video DB 34 is a database that stores a collection of student videos. As one aspect, meta-information such as the account information of the student who is the creator, the identification information of the lesson in which the student participates, and the identification information of the instructor in charge of the lesson may be associated with the student videos stored in the student video DB 34.

[0093] The recording unit 35 has a recording function for recording the images captured by the imaging unit 33. As one aspect, the recording unit 35 can record a student video in which a student's dance is captured while playing a video using a video player function.

[0094] Such a video player function may be realized as one of the modules packaged in the APP for dancers, by way of example only. For example, the video player function is activated by receiving an operation of a video player button for playing a video from the main menu screen provided by the APP for dancers.

[0095] When the video player function is activated in this way, it transitions to a video selection screen for selecting the video to be played from the main menu screen. For example, a list of videos may be displayed on the video selection screen, and the list of videos may include a demonstration video as an option. Then, when the demonstration video is selected via the input unit 31 on the video selection screen, it transitions from the video selection screen to a recording screen. Note that it may also be possible to play only the music of the demonstration video during the recording of the student video by transitioning to a music selection screen for selecting the music to be embedded as the BGM (BackGround music) of the student video from the main menu screen.

[0096] FIG. 10 is a schematic diagram showing an example of a method for recording a student video. In FIG. 10, the state in which the recording screen 600 displayed on the display unit 32 of the student terminal 30 transitions according to the operation procedure is schematized from left to right. As shown in FIG. 10, the recording screen 600 may include a video display area 610 and a setting window 620.

[0097] Among these, in the video display area 610, a live video captured in real time by the imaging unit 33 is displayed. Although details will be described later with reference to FIG. 14, in the video display area 610, the live video or the reference video may be displayed in an arbitrary display mode among the first to fourth modes described later, or the live video and the reference video may be displayed simultaneously. The setting window 620 is a window that accepts setting of the playback time at which recording starts among the playback times of the reference video. For example, the setting window 620 may be displayed overlapping the front of the video display area 610.

[0098] This setting window 620 may include a slider bar (seek bar) 621, a slider 621A, a playback button 622, and a recording button 623. For example, the slider bar 621 corresponds to the range of the playback time of the reference video selected on the video selection screen, and the slider 621A indicates the playback position, that is, the playback time. This slider 621A can be moved by a drag operation or by playing the reference video by pressing the playback button 622.

[0099] When such a slider 621A is set at the position of the playback time at which recording is desired to start and the recording button 623 is pressed, a recording start button 630 is displayed on the recording screen 600. Note that the display of the recording start button 630 may be linked to the non-display of the setting window 620.

[0100] Here, when the recording start button 630 is operated, recording of the live video captured in real time by the imaging unit 33 is started. At this time, the recording of the live video can also be started after performing a countdown display for a predetermined time, such as 3 seconds or 5 seconds. When the recording is started in this way, the recording start button 630 switches to the recording stop button 640.

[0101] Then, until the recording ends due to the end of the playback time of the reference video or the recording is stopped by the recording stop button 640, the recording unit 35 continues the following recording process. For example, the recording unit 35 sets the time code (HH:MM:SS:FF) of the playback time of the reference video being played back to the video of the nth frame captured by the imaging unit 33. Then, the recording unit 35 records the video with the time code set. As a result, the time code of the reference video, and thus the time code of the music embedded in the reference video, is embedded in each frame of the video included in the student video. Thereby, since the playback times of the reference video and the student video can be identified by the time code of the same music and the reference video and the student video can be played back simultaneously, it is possible to synchronize the reference video and the student video with the time code.

[0102] After that, when the recording ends due to the end of the playback of the reference video or the recording is stopped by the recording stop button 640, the recording unit 35 saves the student video 60 captured in the section from the playback time corresponding to the start of recording to the playback time corresponding to the end of the music playback or the recording stop to the student video DB 34. At this time, meta information such as the account information of the student who is the creator, the identification information of the lesson corresponding to the reference video played back by the above video player function at the time of recording the student video, and the identification information of the instructor in charge of the lesson may be associated with the student video.

[0103] Here, while the instructor terminal 20 has a video recording function of recording a live video by the imaging unit 23 while playing a music piece, an example has been given where the student terminal 30 has a function of recording a live video by the imaging unit 33 while playing a video such as a reference video by the video player function, but the present invention is not limited thereto. For example, the instructor terminal 20 may have a function of recording a live video by the imaging unit 33 while playing a video by the above-described video player function, or alternatively, the student terminal 30 may have the above-described video recording function.

[0104] The request unit 36 has a function of transmitting a request to the server device 10. As one aspect, when the request unit 36 receives a browsing instruction of the synchronization rate via the input unit 31, the request unit 36 transmits a browsing request of the synchronization rate including the identification information of the student video and the identification information of the reference video specified by the browsing instruction to the server device 10. As a response to such a browsing request, the calculation result of the synchronization rate by the calculation unit 15C of the server device 10 may be displayed on the display unit 32.

[0105] The UL unit 37 has a function of uploading data to the server device 10. As one mode, when the UL unit 37 receives an instruction to upload a student video to the server device 10 via the input unit 31, the UL unit 37 uploads the student video together with its meta information to the server device 10. Such meta information may include the identification information of the student video, the identification information of the lesson corresponding to the reference video played by the above-described video player function at the time of recording the student video, and the identification information of the instructor in charge of the lesson. The student video uploaded in this way is saved to the student video DB 13.

[0106] The setting unit 38 has a function of setting parameters related to the playback state of the video. As one mode, when parameters related to the playback state of the reference video are specified via the playback control screen 300, the setting unit 38 sets the parameters to the playback control unit 39B described later.

[0107] The output control unit 39 has a function of controlling the output related to various types of information. The "output" mentioned here may include display output and audio output. As shown in FIG. 7, the output control unit 39 includes a GUI control unit 39A and a playback control unit 39B.

[0108] The GUI control unit 39A has a function of executing display control of the GUI screen displayed on the display unit 32. As one aspect, when the GUI control unit 39A receives a playback instruction for the model video, a playback instruction for the student video, or a playback instruction for the model video and the student video via the input unit 31, it causes the playback control screen 300 shown in FIG. 11 to be displayed on the display unit 32.

[0109] FIG. 11 is a schematic diagram (1) showing a transition example of the playback control screen 300. In FIG. 11, the state in which the playback control screen 300 displayed on the display unit 32 of the student terminal 30 transitions according to the operation procedure is schematized from left to right. As shown in FIG. 11, the playback control screen 300 may include, in addition to the video display area 310 and the playback state setting area 320 described above with reference to FIG. 3, a thumbnail bar display area 330 and a controller display area 340.

[0110] In the thumbnail bar display area 330, a thumbnail bar 331 is displayed on which thumbnail images of the model video are arranged in chronological order of playback time in the horizontal direction, for example, the left - right direction or the row direction, as a preview of the model video. By sliding the slider 331A on such a thumbnail bar 331, it is possible to specify the playback position of the model video while visually recognizing the playback content in the model video corresponding to the playback position.

[0111] The controller display area 340 may include a first rewind button 341, a second rewind button 342, a play / pause button 343, a second fast - forward button 344, and a second fast - forward button 345.

[0112] The first rewind button 341 and the second rewind button 342 are both buttons for rewinding the playback position of a video, but their rewind durations are different. For example, in the example shown in FIG. 11, the rewind duration for one tap of the first rewind button 341 is set to 5 seconds, and the rewind duration for one tap of the second rewind button 342 is set to 0.3 seconds. When the first rewind button 341 is tapped, a 5-second rewind of the playback position is executed, while when the second rewind button 342 is tapped, a 0.3-second rewind of the playback position is executed. The rewind durations of these first rewind button 341 and second rewind button 342 are merely examples, and user settings for any period can be executed.

[0113] The play / pause button 343 is a button for instructing the playback or pause of a video. For example, during the playback of a video, the play / pause button 343 is displayed as an icon corresponding to pause, while during the pause of a video, the play / pause button 343 is displayed as an icon corresponding to play.

[0114] The second fast forward button 344 and the first fast forward button 345 are both buttons for fast forwarding the playback position of a video, but their fast forward durations are different. For example, in the example shown in FIG. 11, the fast forward duration for one tap of the first fast forward button 345 is set to 5 seconds, and the fast forward duration for one tap of the second fast forward button 344 is set to 0.3 seconds. When the first fast forward button 345 is tapped, a 5-second fast forward of the playback position is executed, while when the second fast forward button 344 is tapped, a 0.3-second fast forward of the playback position is executed. The fast forward durations of these first fast forward button 345 and second fast forward button 344 are merely examples, and user settings for any period can be executed.

[0115] Thus, the reason for separating and arranging the rewind and fast-forward GUI components into two types is that the user requirements also fall into two categories. That is, when the user wants to perform a rough rewind or fast-forward, for example, when calling a specific scene around the playback position during playback, the first rewind button 341 and the first fast-forward button 345 are used. On the other hand, when the user wants to perform a fine rewind or fast-forward, for example, when observing a dance frame by frame while paused, the second rewind button 342 and the second fast-forward button 344 are used.

[0116] On one side, in the playback control screen 300, the marker function can be called through operations on the marker setting tab 323. For example, when the marker setting tab 323 is tapped, the display of the playback state setting area 320 changes from the tab display of the tempo change tab 321, loop setting tab 322, and marker setting tab 323 to the button display for marker setting. That is, in the playback state setting area 320, marker buttons 321A to 321D, a return button 321E, and a trash can button 321F are displayed.

[0117] These marker buttons 321A to 321D are all buttons for instructing playback from the playback position where a marker is set. Here, in FIG. 11, as an example only, an example is shown where a marker is set on the marker button 321C under the situation where no marker is set on all the marker buttons 321A to 321D. For example, by moving the slider 331A left and right on the thumbnail bar 331, the playback position where the user wants to set a marker is specified. Then, after specifying the playback position and tapping the marker button 321C, the marker of the marker button 321C is set at the playback position corresponding to the position of the slider 331A. From the aspect of distinguishing the marker button 321C with a set marker from the marker buttons 321A, 321B, and 321D with no set marker, the marker button 321C is changed to a different display form, for example, a different display color (hatched display in FIG. 11).

[0118] Note that the return button 321E is a button that returns the display of the playback state setting area 320 to the tab display of the tempo change tab 321, loop setting tab 322, and marker setting tab 323. Also, the trash can button 321F is a button that deletes the marker setting. For example, when a marker button with a set marker is tapped after the trash can button 321F is tapped, the marker set for the marker button is deleted.

[0119] As another aspect, on the playback control screen 300, the loop function can be called through an operation on the loop setting tab 322. FIG. 12 is a schematic diagram (2) showing a transition example of the playback control screen 300. Also shown in FIG. 12 is how the playback control screen 300 displayed on the display unit 32 of the student terminal 30 transitions according to the operation procedure, schematized from left to right.

[0120] As shown in FIG. 12, when the loop setting tab 322 is tapped, the display of the playback state setting area 320 transitions from the tab display of the tempo change tab 321, loop setting tab 322, and marker setting tab 323 to the button display for loop setting. That is, in the playback state setting area 320, a start position designation button 322A, a loop switch 322B, an end position designation button 322C, a return button 322D, and a trash can button 322E are displayed.

[0121] The start position designation button 322A is a button for designating the playback position to start loop playback. The end position designation button 322C is a button for designating the playback position to end loop playback. The loop switch 322B is a button for switching the ON or OFF of loop playback.

[0122] For example, by moving the slider 331A left and right on the thumbnail bar 331, the playback position at which the user wants to set the start or end of loop playback is specified. In the example shown in FIG. 12, when the start position specifying button 322A is tapped, the start position pointer for loop playback is set at the playback position specified on the thumbnail bar 331, that is, the position of the mark “A”. Further, when the end position specifying button 322C is tapped, the end position pointer for loop playback is set at the playback position specified on the thumbnail bar 331, that is, the position of the mark “B”. After the start position pointer and the end position pointer are set, when the loop switch 322B is tapped, loop playback is set to the ON state. In this case, loop playback is started in the section between the start position pointer and the end position pointer, that is, the hatched section on the thumbnail bar 331 shown in FIG. 12. From the aspect of notifying that loop playback has been switched to the ON state in this way, when loop playback is in the ON state, the loop switch 322B can be highlighted.

[0123] Note that the back button 322D is a button for returning the display of the playback state setting area 320 to the tab display of the tempo change tab 321, the loop setting tab 322, and the marker setting tab 323. Also, the trash can button 322E is a button for deleting the setting of loop playback. For example, when the loop switch 322B for which loop playback has been set is tapped after the trash can button 322E is tapped, the loop playback set for the loop switch 322B is deleted.

[0124] As a further aspect, in the playback control screen 300, the tempo change function can be called through an operation on the tempo change tab 321. FIG. 13 is a schematic diagram (3) showing a transition example of the playback control screen 300. Also in FIG. 13, the state in which the playback control screen 300 displayed on the display unit 32 of the student terminal 30 transitions according to the operation procedure is schematized from left to right.

[0125] As shown in FIG. 13, when the tempo change tab 321 is tapped, the display in the playback state setting area 320 changes from the tab displays of the tempo change tab 321, loop setting tab 322, and marker setting tab 323 to the display of GUI components for tempo change. That is, in the playback state setting area 320, a slider bar 321A, a slider 321B, an initialization button 321C, and a back button 321E are displayed.

[0126] For example, by moving the slider 331A left and right on the slider bar 321A corresponding to the range from a minimum of 0.20 times to a maximum of 2.00 times, the speed that the user wants to play is specified. Also, when the initialization button 321C is tapped, the playback speed is initialized to 1.00 times. Further, when the back button 322D is tapped, the display in the playback state setting area 320 returns to the tab displays of the tempo change tab 321, loop setting tab 322, and marker setting tab 323. Here, an example where the magnification of the playback speed is specified has been given, but the playback speed may be specified in BPM (Beats Per Minute).

[0127] As a further aspect, on the playback control screen 300, a video can be displayed in the video display area 310 by switching between a plurality of display modes. As an example of such display modes, a first mode for displaying a reference video, a second mode for displaying the reference video and the student video in an overlay manner, a third mode for displaying the reference video and the student video side by side, and a fourth mode for displaying the student video may be included.

[0128] FIG. 14 is a schematic diagram showing an example of the display mode of a video. In FIG. 14, display examples of videos corresponding to the first mode, second mode, third mode, and fourth mode are shown in order from the upper left to the upper right, lower left, and lower right.

[0129] In these first to fourth modes, it is possible to freely switch from any mode to any mode. Here, an example is shown where the original video is played in a state where it is inverted in the horizontal direction, for example, the left - right direction, in all modes.

[0130] FIG. 15 is a diagram showing an example of a model video. FIG. 16 is a diagram showing an example of a student video. Hereinafter, when a video with a horizontally reversed image is being played in the video display area 310, from the aspect of clearly indicating that it is in the process of being reversed, the text "mirror" will be displayed in reverse characters at the upper right position of the video display area 310. As shown in FIGS. 15 and 16, when the flip button 311 is tapped, the model video 40 and the student video 60 displayed in the video display area 310 are reversed symmetrically left and right. Hereinafter, from the aspect of distinguishing the labels of the original model video and the model video with left and right reversed, the model video with left and right reversed may be referred to as the "reversed model image" in some cases. For the same reason, the student video with left and right reversed may be referred to as the "reversed student image" in some cases. As a result, the reversed model video 40A or the reversed student video 60A is displayed in the video display area 310. The advantage of reversing the original model video and the original student video in this way is that it can prevent the student from learning the dance choreography in the original state and then performing a mirror-image choreography with the left and right reversed. When the flip button 311 is tapped again, the reversed model video 40A and the reversed student video 60A are restored to the original model video 40 and the original student video 60. By operating the flip button 311 in this way, the display of the original model video 40 and the original student video 60, and the display of the reversed model video 40A and the reversed student video 60A can be freely switched.

[0131] Returning to the description of FIG. 14, in the first mode, only the inverted demonstration video 40A is displayed in the video display area 310. In the second mode, an overlay display is performed in which the inverted demonstration video 40A and the inverted student video 60A are displayed in the video display area 310 with the inverted demonstration video 40A superimposed on the front of the inverted student video 60A. In the third mode, a two-screen display is performed in which two videos, the inverted demonstration image 40A and the inverted student video 60A, are arranged side by side in the horizontal or vertical direction and displayed in the video display area 310. In the fourth mode, only the inverted student video 60A is displayed in the video display area 310. Here, an example in which two videos, the inverted demonstration image 40A and the inverted student video 60A, are arranged side by side in the horizontal or vertical direction is given, but the arrangement of the two videos is not limited to this, and the inverted demonstration image 40A and the inverted student video 60A may be arranged side by side in an oblique direction.

[0132] Here, in the second mode, as an example only, the inverted demonstration video 40A is displayed with the opacity default set to 50%, but it is also possible to allow the user to set the opacity of the inverted demonstration video 40A.

[0133] FIG. 17 is a diagram showing an example of user setting of opacity. FIG. 17 shows three examples where the opacity setting of the reverse sample video 40A is 0%, where the opacity setting of the reverse sample video 40A is 50%, and where the opacity setting of the reverse sample video 40A is 100%. As shown in FIG. 17, a slider bar 312 for setting the opacity of the reverse sample video 40A may be provided in the video display area 310. A numerical range of opacity from a minimum of 0% to a maximum of 100% is assigned to this slider bar 312. By moving the slider 312A to an arbitrary position on such a slider bar 312, an arbitrary opacity can be set for the user. For example, when the opacity of the reverse sample video 40A is set to 0%, only the reverse student image 60 is displayed in the video display area 310, while when the opacity of the reverse sample video 40A is set to 100%, only the reverse sample video 40 is displayed in the video display area 310. Not limited to these minimum and maximum opacities, an arbitrary opacity can be set for the user. Thereby, an overlay display matching the visual recognition characteristics of the student can be realized.

[0134] Furthermore, in each of the first to fourth modes, the positions and sizes of the inverted model image 40A and the inverted student video 60A can be changed. FIG. 18 is a diagram showing an example of size change. FIG. 18 shows an example in which the position of the inverted student video 60A among the inverted model image 40A and the inverted student video 60A displayed in the third mode shown in FIG. 14 is moved to the right direction, and the size of the inverted student video 60A is reduced. Thus, the position and size can be arbitrarily changed according to user settings. For example, the display size can be reduced by accepting a pinch-in operation on the inverted model image 40A or the inverted student video 60A, or the display size can be enlarged by accepting a pinch-out operation. Also, by accepting a drag operation on the inverted model image 40A or the inverted student video 60A, the display position of the inverted model image 40A or the inverted student video 60A can be moved, and the movement of the display position can be terminated by a drop operation. Although FIG. 18 shows an example in which the position and size are changed, the inverted model image 40A and the inverted student video 60A can also be rotated.

[0135] Students can freely transition between these first to fourth modes to customize the playback state of the video according to the application when learning dance choreography. FIG. 19 is a diagram showing an example of the relationship between the dance practice procedure and functions. As shown in FIG. 19, changing the playback speed, loop playback, and flipping (inverting) of the video can be effectively utilized in all steps of practicing dance choreography. Also, 1) In the stage of memorizing the flow of choreography, the effectiveness of the first mode, that is, "playback of the model video", is high. Also, 2) In the stage of memorizing the angle of choreography, the effectiveness of the second mode, that is, "overlay playback", is high. Furthermore, 3) In the stage of memorizing the timing of choreography, the effectiveness of the third mode, that is, "parallel playback", is high. Also, 4) In the stage of checking whether one can dance alone, the effectiveness of the fourth mode, that is, "playback of the student video", is high.

[0136] FIG. 20 is a diagram showing a use case for confirming choreography timing. FIG. 20 shows an example in which the mirrored choreography video 40A and the mirrored student video 60A are arranged side by side and displayed in the video display area 310. For example, in the example shown in FIG. 20, by comparing the mirrored choreography video 40A and the mirrored student video 60A, it is possible to confirm that the poses are misaligned between the instructor and the student. That is, there is a misalignment between the directions of the instructor's right wrist 41 and right elbow 42 and the directions of the student's right wrist 61 and right elbow 62, and there is also a misalignment between the directions of the instructor's right hip 43 and right knee 44 and the directions of the student's right hip 63 and right knee 64. Such a pose misalignment may be output as a calculation result of the synchronization rate by the calculation unit 15C. A student who has confirmed such a pose misalignment can investigate that the cause of the pose misalignment is that the choreography timing of the student is off by one tempo from the choreography timing of the instructor.

[0137] Returning to the description of FIG. 7, the playback control unit 39B has a function of executing playback control of the video displayed in the video display area 310. As one aspect, the playback control unit 39B plays back a video corresponding to the display mode of the video display area 310 according to the setting of the playback state parameters set by the setting unit 38, for example, the setting of the magnification of the playback speed, the setting of the loop playback section, and the marker setting. At this time, when the second mode or the third mode is selected as the display mode of the video display area 310, the playback control unit 39B plays back the choreography video and the student video according to the time code of the choreography video. Note that when the second mode or the third mode is selected, the same parameters are used for the playback of the choreography video and the student video.

[0138] <Flow of processing> Next, the processing flow of the video providing system according to the present embodiment will be described. Here, the (1) recording process executed by the instructor terminal 20, the (2) reservation process executed by the server device 10 and the student terminal 30, and the (3) video playback process executed by the student terminal 30 will be described in this order.

[0139] (1) Recording process Figure 21 is a flowchart showing the procedure of the recording process. This process can be started, as an example only, when an operation of a video recording button that receives a recording request from the main menu screen provided by the APP for dancers is received.

[0140] As shown in Figure 21, the recording unit 24 receives a designation of a piece of music to be embedded in the demonstration video that the instructor will shoot from now on (step S101). Subsequently, the recording unit 24 receives a setting of the playback time at which to start recording among the playback times of the piece of music designated in step S101 (step S102). Then, the recording unit 24 receives an operation to start recording (step S103).

[0141] Thereafter, the recording unit 24 executes loop process 1 that repeats the following step S104 and the following step S105 until the recording ends due to the end of the playback time of the piece of music designated in step S101 or until the recording ends due to the recording being stopped.

[0142] That is, the recording unit 24 sets the time code (HH:MM:SS:FF) of the playback time of the piece of music being played back in the video of the nth frame captured by the imaging unit 23 (step S104). Then, the recording unit 24 records the video in which the time code is set in step S104 (step S105).

[0143] By repeating such loop process 1, a demonstration video in which the time code of the piece of music designated by the instructor is embedded in each frame of the video captured by the imaging unit 23 is recorded.

[0144] Thereafter, the recording unit 24 uploads the video file of the demonstration video recorded by repeating the above loop process 1 to the server device 10 (step S106) and ends the process.

[0145] In this way, the sample video uploaded by the server device 10 in step S106 is stored in the sample video DB12 of the server device 10. Of course, the sample video may also be stored in a storage or the like of the instructor terminal 20.

[0146] (2) Reservation process FIG. 22 is a sequence diagram showing the procedure of the reservation process. As shown in FIG. 22, the reservation unit 15A of the server device 10 receives a request to view a lesson program from the student terminal 30 (step S301). Subsequently, the reservation unit 15A of the server device 10 reads out the lesson program for the date and time zone specified by the request from the program DB11 (step S302).

[0147] Then, the reservation unit 15A of the server device 10 provides the student terminal 30 with a lesson selection screen for receiving an instruction input to request viewing of a sample video for each lesson included in the lesson program and an instruction input for a lesson requesting reception of the lesson (step S303).

[0148] On the other hand, when a reservation reception button assigned to any one of the lessons included in the lesson selection screen is selected by the request unit 36 of the student terminal 30 (step S304), a request to request reservation registration for the lesson to which the reservation reception button is assigned is sent to the server device 10 (step S305).

[0149] Then, the reservation unit 15A registers account information, for example, student identification information, assigned to the student who is the user of the student terminal 30 in the participation frame of the lesson (step S306), and notifies the student terminal 30 of the reservation completion (step S307).

[0150] When the reception of the lesson reservation is completed in this way, functions such as playback and download of the sample video are permitted on the student terminal 30.

[0151] After the reservation acceptance is completed, the student terminal 30 accepts an operation of a demonstration video playback button from among the lessons included in the lesson selection screen provided in step S303 (step S308). Then, the request unit of the student terminal 30 transmits a request for requesting a download of the demonstration video for which the operation of the playback button has been accepted to the server device 10 (step S309).

[0152] When a download of the demonstration video is requested in this way, the video providing unit 15B of the server device 10 reads out the demonstration video of the lesson specified by the request from among the demonstration videos stored in the demonstration video DB 12 and provides it to the student terminal 30 (steps S310 and S311).

[0153] Then, the playback control unit 39B of the student terminal 30 executes video playback processing using the demonstration video provided in step S307 (step S312), and ends the processing.

[0154] The processing from step S308 to step S312 can be repeated any number of times until the display on the display unit 32 of the student terminal 30 changes from the lesson selection screen to another screen. Note that the demonstration video downloaded in step S311 can be played back using the dancer-oriented APP even after the screen changes from the lesson selection screen to another screen.

[0155] (3) Video Playback Processing FIG. 23 is a flowchart showing the procedure of video playback processing. This processing may be continuously executed even when a video is being played back. Note that each step described in this flowchart is applicable regardless of whether the display mode of the video display area 310 is any of the first to fourth modes.

[0156] As shown in FIG. 23, the playback control unit 39B causes the video of the frame in which the time code corresponding to the playback position is set to be displayed in the video display area 310 and causes the audio of the frame in which the time code is set to be output from an audio output unit (not shown) (step S501).

[0157] Subsequently, when the playback speed is changed via the tempo change tab 321 (step S502 Yes), the setting unit 38 changes the parameter of the playback speed by the playback control unit 39B to the playback speed corresponding to the position of the slider 323B on the slider bar 323A (step S503).

[0158] When a marker is specified via the marker setting tab 323 (step S504 Yes), the playback control unit 39B shifts the playback position to the time code at which the marker is set (step S505).

[0159] When a fast forward or rewind operation is performed (step S504 No and step S506 Yes), the playback control unit 39B executes fast forward or rewind for the duration of the fast forward or rewind period (step S507).

[0160] When neither marker designation nor fast forward or rewind operation is performed (step S504 No and step S506 No), the playback control unit 39B shifts to the next time code by adding the time width corresponding to the frame rate to the time code corresponding to the playback position (step S508).

[0161] Thereafter, when loop playback is in the ON state (step S509 Yes), the playback control unit 39B determines whether the playback position has exceeded the end position of the loop-set section (step S510).

[0162] At this time, when the playback position exceeds the end position of the loop-set section (step S510 Yes), the playback control unit 39B sets the playback position to the start position of the loop setting (step S511), and returns to the process of step S501.

[0163] Note that when loop playback is in the OFF state (step S509 No), or when the playback position does not exceed the end position of the loop-set section (step S510 No), the process proceeds to step S501 without executing the process of step S511.

[0164] <Summary> As described above, the video providing system 1 according to the present embodiment provides a student terminal 30 with a reference video in which, for example, the choreography of a dance, which is the content to be taught by an instructor in a lesson, is photographed before the start of the lesson. Therefore, according to the video providing system 1 according to the present embodiment, it is possible to support a user who autonomously practices the lesson content before taking the lesson.

[0165] In addition, the student terminal 30 according to the present embodiment controls the playback state of the reference video in the display mode in which the student video and the reference video are displayed simultaneously based on the setting of parameters related to the playback state of the reference video. Therefore, according to the student terminal 30 according to the present embodiment, it is possible to easily customize the playback state of the video and realize video playback.

[0166] <Exertion of creative ability> The matters described in the above embodiment, such as the number of instructor terminals 20 and student terminals 30, specific examples of various screens, etc., are merely examples and can be changed. Also, the flowcharts described in the embodiment can have the processing order changed within a non - contradictory range.

[0167] <System> Regarding the processing procedures, control procedures, specific names, and information including various data and parameters shown in the above documents and drawings, they can be arbitrarily changed unless otherwise specified. For example, one or more of the functional units of the first providing unit 15A and the second providing unit 16 included in the server device 10 may be configured by separate devices.

[0168] Also, each component of each illustrated device is a functional concept, and does not necessarily have to be physically configured as shown. That is, the specific form of the distribution and integration of each device is not limited to that shown. In other words, all or part of it can be functionally or physically distributed and integrated in arbitrary units according to various loads, usage situations, etc. Note that each configuration may be a physical configuration.

[0169] Furthermore, all or any part of each processing function performed by each device can be realized by a CPU (Central Processing Unit) and a program analyzed and executed by the CPU, or can be realized as hardware by wired logic.

[0170] <Hardware> Next, a hardware configuration example of the computer described in the above embodiment will be described. FIG. 24 is a diagram showing a hardware configuration example. As shown in FIG. 24, the student terminal 30 includes a communication device 30a, a storage device 30b, a memory 30c, and a processor 30d. Note that each part shown in FIG. 24 may be mutually connected by a bus or the like. Although FIG. 24 shows a hardware configuration example of the student terminal 30, the server device 10 and the instructor terminal 20 may also be realized by a similar hardware configuration.

[0171] The communication device 30a is a network interface card or the like. The storage device 30b is a storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive). For example, the storage device 30b stores a program for operating the functions shown in FIG. 7, a DB, and the like.

[0172] The processor 30d reads a program for executing the same processing as the processing unit shown in FIG. 7 from the storage device 30b or the like and expands it in the memory 30c, thereby operating a process for executing the functions described in FIG. 7.

[0173] Such a process realizes the same functions as the processing unit included in the student terminal 30. For example, the processor 30d reads a program having the same functions as the recording unit 35, the request unit 36, the UL unit 37, the setting unit 38, the output control unit 39, and the like from the storage device 30b or the like. Then, the processor 30d executes a process for executing the same processing as the recording unit 35, the request unit 36, the UL unit 37, the setting unit 38, the output control unit 39, and the like.

[0174] In this way, the student terminal 30 operates as an information processing device that executes the video playback method by reading and executing a program. Further, the student terminal 30 can also read the program from the recording medium by the medium reading device and realize the same functions as those in the above-described embodiments by executing the read program.

[0175] Note that the program in this other embodiment is not limited to being executed by the student terminal 30. For example, the present invention can be similarly applied when another computer or server executes the program, or when they cooperate to execute the program. As an example, the above-described video playback function may be provided by executing the above program by the instructor terminal 20. As another example, by executing the above program by the server device 10, a video providing service corresponding to the above video playback function may be provided from the server device 10 to the instructor terminal 20 and the student terminal 30.

[0176] The above program can be distributed via a network such as the Internet. Further, the above program can be recorded on an arbitrary recording medium and executed by being read from the recording medium by a computer. For example, the recording medium can be realized by a hard disk, a flexible disk (FD), a CD-ROM, a MO (Magneto-Optical disk), a DVD (Digital Versatile Disc), or the like.

Explanation of Reference Numerals

[0177] 1 Video providing system 10 Server device 11 Program DB 12 Model video DB 13 Student video DB 14 Comment DB 15 First providing unit 15A Reservation unit 15B Video providing unit 15C calculation unit 16 Second providing unit 20 Instructor terminal 21 Input unit 22 Display unit 23 Imaging unit 24 Recording unit 25 Output control unit 26 Request unit 30 Student terminal 31 Input unit 32 Display unit 33 Imaging unit 34 Student video DB 35 Recording unit 36 Request unit 37 UL unit 38 Setting unit 39 Output control unit 39A GUI control unit 39B Playback control unit

Claims

1. a setting unit that sets parameters related to a playback state of the first moving image; a playback control unit that controls a playback state of the second moving image in a display mode including a mode in which the first moving image and a second moving image different from the first moving image are simultaneously displayed based on settings of the parameters; having A video playback device, characterized in that the playback times of the first video and the second video are identified by a time code of a same piece of music.

2. 2. The video playback device according to claim 1, wherein the second video is a recording.

3. 2. The video playback device according to claim 1, wherein the second video is a live video captured in real time.

4. 2. The video playback device according to claim 1, wherein the first video or the second video is displayed in a horizontally inverted state.

5. The video playback device according to claim 1, characterized in that the display mode is switched between a first mode in which the first video is displayed, a second mode in which the first video and the second video are displayed in an overlay, a third mode in which the first video and the second video are displayed side by side, and a fourth mode in which the second video is displayed.

6. 2. The moving image reproducing device according to claim 1, further comprising an imaging section for capturing moving images.

7. 7. The moving image reproducing device according to claim 6, further comprising a recording section for recording a second moving image captured by the imaging section.

8. the setting unit sets a marker that designates a playback position on a playback time of the first moving image; 2 . The video playback device according to claim 1 , wherein the playback control unit plays back the first video and the second video from a playback position where the marker is set within a playback time of the first video.

9. the setting unit sets a section for designating a loop on a playback time of the first moving image; The video playback device according to claim 1 , wherein the playback control unit repeats playback of the first video and the second video, with the section of the playback time of the first video for which the loop is specified as the playback range.

10. 2. The video playback device according to claim 1, wherein the playback control unit executes fast forwarding or rewinding of a first period, or fast forwarding or rewinding of a second period that is shorter than the first period.

11. 11. The video playback device according to claim 10, wherein the first period and the second period are set by a user.

12. 12. The video playback device according to claim 1, wherein the first video is a model video in which dance choreography has been filmed.

13. a setting unit that sets parameters related to a playback state of the first moving image; a playback control unit that controls a playback state of the second moving image in a display mode including a mode in which the first moving image and a second moving image different from the first moving image are simultaneously displayed based on settings of the parameters; having The video playback device according to claim 1, wherein the second video is a live video captured in real time.

14. Setting parameters relating to a playback state of the first video; controlling a playback state of the second moving image in a display mode including a mode in which the first moving image and a second moving image different from the first moving image are simultaneously displayed based on the setting of the parameter; The process is executed by a computer, A video playback program, characterized in that the playback times of the first video and the second video are identified by a time code of a same piece of music.

15. Setting parameters relating to a playback state of the first video; controlling a playback state of the second moving image in a display mode including a mode in which the first moving image and a second moving image different from the first moving image are simultaneously displayed based on the setting of the parameter; The process is executed by a computer, The video playback program, wherein the second video is a live video captured in real time.

Images