Information processing apparatus, moving image distribution method, and moving image distribution program

Abstract

To provide an information processing device, a moving image distribution method and a moving image distribution program which change a display mode of a moving image on a portable terminal without using a sound of the moving image.SOLUTION: A server performs a moving image of interest determination process for determining, as a moving image of interest, a dance moving image having the largest movement of a dancer among a plurality of dance moving images simultaneously displayed on the screen of the portable terminal, and distributes the moving image of interest to the portable terminal so as to be displayed larger than the other dance moving images. The moving image of interest determination process extracts an image indicating the dancer from the moving image at a predetermined time interval, and determines a moving image having the largest difference in the extracted subject among a plurality of moving images, as the moving image of interest.SELECTED DRAWING: Figure 18

Description

[Technical field]

[0001] The present invention relates to an information processing device, a video distribution method, and a video distribution program. [Background technology]

[0002] 2. Description of the Related Art In recent years, online services such as websites (web pages, web services), online games, and application software (hereinafter referred to as "apps") that are distributed to information processing devices such as mobile terminals via computer networks have become widespread.

[0003] One of the online services is a video posting site where users can post videos that they have taken and other users can watch those videos. Users can also post performance videos, such as singing videos, on this video posting site. In addition, online services such as a competition between performance videos of different posters are also expected.

[0004] Here, Patent Document 1 discloses a karaoke device that, when displaying each karaoke singing video that constitutes a collaboration karaoke singing video, judges whether the volume of the singing voice in each karaoke singing video is equal to or greater than a predetermined reference value, and identifiably displays the karaoke singing video in which the judged singing voice volume is equal to or greater than the predetermined reference value. As a result, this karaoke device displays the karaoke singing video of a user who is singing at a volume equal to or greater than the reference value in a large size, and displays the karaoke singing video and karaoke singing video of a user who is not singing in a small size. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2014-092592 A Summary of the Invention [Problem to be solved by the invention]

[0006] However, the karaoke device disclosed in Patent Document 1 identifies karaoke singing videos based on the volume of the singing voice, and therefore cannot handle performance videos such as dance performances in which the user may not make any sound.

[0007] The present invention has been made in consideration of the above circumstances, and aims to provide an information processing device, a video distribution method, and a video distribution program that are capable of changing the display mode of multiple videos without using the sound of the videos. [Means for solving the problem]

[0008] In order to solve the above problems, an information processing device, a video distribution method, and a video distribution program according to the present invention employ the following means.

[0009] In order to solve the above problem, an "information processing device" which is one aspect of the present invention is an information processing device which distributes videos posted by users to a terminal device, and which comprises a distribution means which distributes a plurality of the videos so that they are displayed simultaneously on the screen of the terminal device, and a determination means which determines that the video among the plurality of videos which has the greatest subject movement is the featured video, and the distribution means distributes the videos to the terminal device so that the featured video is displayed larger than the other videos.

[0010] In order to solve the above problems, a "video distribution method" according to one embodiment of the present invention is a video distribution method for distributing videos posted by users to a terminal device, the method comprising: a first step of distributing a plurality of the videos so that they are simultaneously displayed on a screen of the terminal device; and a second step of determining, among the plurality of videos, the video having the greatest subject movement as a featured video, and the second step of distributing the videos to the terminal device so that the featured video is displayed larger than the other videos.

[0011] In order to solve the above problems, a "video distribution program" which is one aspect of the present invention causes a computer provided in an information processing device which distributes videos posted by users to a terminal device to function as a distribution means which distributes multiple videos so that they are displayed simultaneously on the screen of the terminal device, and a determination means which determines, among the multiple videos, the video with the largest subject movement to be the video of interest, and the distribution means distributes the videos to the terminal device so that the video of interest is displayed larger than the other videos.

[0012] The above-mentioned "information processing device" may be subject to various technical limitations, as exemplified below. In addition, technical limitations of the same purport may be applied to the processing steps executed by the "video distribution method" or the functions of the "video distribution program."

[0013] The determination means extracts images showing the subject from the moving images at a predetermined time interval, and determines, among the multiple moving images, the moving image with the largest difference in the extracted subject to be the moving image of interest.

[0014] The subject is a person, and the determining means determines the difference between the subject based on the movements of the limbs of the subject.

[0015] The distribution means distributes the video to the terminal device so that sound of the video of interest is output and sound of the other videos is not output.

[0016] When the movement of the subject in the attention video becomes smaller than the movement of the subject in the other video for a predetermined time or longer, the determination means determines that the other video is the attention video. Effect of the Invention

[0017] According to the present invention, it is possible to advantageously change the display mode of a plurality of moving images without using the sounds of the moving images. [Brief description of the drawings]

[0018] [Figure 1]1 is a configuration diagram of a karaoke system according to a first embodiment of the present invention. [Diagram 2] 1 is a block diagram showing an electrical configuration of a server according to a first embodiment of the present invention. [Diagram 3] 1 is a block diagram showing the electrical configuration of a mobile terminal according to a first embodiment of the present invention. [Figure 4] FIG. 2 is a diagram showing a screen display of a mobile terminal when shooting a singing video according to the first embodiment of the present invention. [Diagram 5] FIG. 2 is a diagram showing a screen display of a mobile terminal when viewing a singing video according to the first embodiment of the present invention. [Figure 6] FIG. 2 is a diagram showing the screen display of a mobile terminal of a viewing user in a singing battle according to the first embodiment of the present invention. [Figure 7] FIG. 2 is a schematic diagram showing divided regions of a musical piece used in a singing battle according to the first embodiment of the present invention. [Figure 8] FIG. 11 is a diagram showing another example of the screen display of a mobile terminal of a viewing user in a singing battle according to the first embodiment of the present invention. [Figure 9] FIG. 11 is a diagram showing a screen display when selecting a coin throwing effect image according to the first embodiment of the present invention. [Figure 10] FIG. 1 is a diagram showing a singing video on which a coin tip effect image is superimposed according to the first embodiment of the present invention. [Figure 11] FIG. 2 is a functional block diagram relating to a singing competition function according to the first embodiment of the present invention. [Figure 12] 4 is a flowchart showing the flow of a singing battle process according to the first embodiment of the present invention. [Figure 13] 1 is a flowchart showing the flow of a voting process according to the first embodiment of the present invention. [Figure 14] FIG. 11 is a diagram showing a screen display on a mobile terminal of a viewing user in a dance competition according to the second embodiment of the present invention. [Figure 15] FIG. 13 is a diagram showing an enlarged display of a featured video in a dance competition according to a second embodiment of the present invention. [Figure 16]13 is a schematic diagram for explaining an attention moving image determination process according to a second embodiment of the present invention. [Figure 17] FIG. 13 is a functional block diagram relating to a dance competition function according to a second embodiment of the present invention. [Figure 18] 13 is a flowchart showing a flow of attention moving image expansion processing according to the second embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an information processing device, a video distribution method, and a video distribution program according to an embodiment of the present invention will be described with reference to the drawings.

[0020] [1. First embodiment] A first embodiment of the present invention will be described below. In this embodiment, a performer records his / her own performance as a video using a mobile terminal, transmits the video to a server, and uploads the video to a video sharing site. The video uploaded to the video sharing site (posted video) can be viewed via a mobile terminal. In this embodiment, the performance is referred to as singing, the performer is referred to as a singing user, and the video uploaded to the video sharing site is referred to as a singing video. Also, a user who views a singing video uploaded to the video sharing site is referred to as a viewing user.

[0021] [1-1. Karaoke system configuration] 1 is a schematic diagram of a karaoke system 1 according to this embodiment. The karaoke system 1 includes a communication line 2, a plurality of mobile terminals 3 (mobile terminals 3A1, 3A2, 3B), and a server 4.

[0022] The communication line 2 forms a computer network, and is, for example, a wide area communication line provided by an electric utility company.

[0023] The mobile terminal 3 is, for example, an information processing terminal such as a smartphone, a tablet terminal, or a notebook computer, and is used by a user to utilize online services. The mobile terminal 3 includes a touch panel display 3a for displaying images, a speaker 3b for outputting sound, a microphone 3c for inputting sound, a camera 3d for photographing a subject, and an earphone terminal 3e for connecting earphones (not shown). Note that photographing here refers to a state in which the camera 3d is functioning and the subject is displayed on the touch panel display 3a regardless of whether recording is performed or not. The touch panel display 3a includes, for example, an LCD (Liquid Crystal Display) and a touch sensor. The LCD displays various images, and the touch sensor accepts various input operations performed using a pointing body such as a finger, a stylus, or a pen. In the following description, the touch panel display 3a is also referred to as a screen 3a.

[0024] The server 4 is an information processing device that provides online services to the mobile terminal 3 via the communication line 2. In the example of FIG. 1, a singing user uploads his / her singing video (singing video data) to a video posting site by transmitting the singing video from the mobile terminal 3A to the server 4. Then, a viewing user accesses the video posting site using the mobile terminal 3B and views the singing video. The singing user can also view the singing video that he / she uploaded by accessing the video posting site using the mobile terminal 3A. Also, the user of the mobile terminal 3B can become a singing user and upload a singing video to the video posting site.

[0025] [1-2. Server configuration] FIG. 2 is a block diagram showing the electrical configuration of the server 4 according to the present embodiment.

[0026] The server 4 according to this embodiment includes a CPU (Central Processing Unit) 20 which is a main control unit that controls the operation of the entire server 4, a ROM in which various programs and various data are stored in advance, The computer includes a Read Only Memory (RAM) 22, a Random Access Memory (RAM) 24 used as a work area when the CPU 20 executes various programs, and a Hard Disk Drive (HDD) 26 as storage means for storing various programs and various data.

[0027] The HDD 26 stores singing video data transmitted from the mobile terminal 3A, i.e., singing video data uploaded to a video posting site, song data indicating songs that the singing user can sing, etc. The storage means is not limited to the HDD 26, and may be, for example, another storage medium such as a semiconductor memory such as a flash memory.

[0028] Furthermore, the server 4 is equipped with an operation input unit 28 composed of a keyboard, a mouse, etc. and which accepts input of various operations, a monitor 30 such as a liquid crystal display device for displaying various images, and an external interface 32 which is connected to other information processing devices such as a mobile terminal 3 via the communication line 2 and which transmits and receives various data to and from the other information processing devices.

[0029] The CPU 20, ROM 22, RAM 24, HDD 26, operation input unit 28, monitor 30, and external interface 32 are electrically connected to one another via a system bus 34. Therefore, the CPU 20 can access the ROM 22, RAM 24, and HDD 26, grasp the operation state of the operation input unit 28, display images on the monitor 30, and transmit and receive various data to and from other information processing devices, etc. via the external interface 32.

[0030] [1-3. Electrical configuration of mobile terminal] FIG. 3 is a functional block diagram showing the electrical configuration of the mobile terminal 3. As shown in FIG.

[0031] The mobile terminal 3 includes a main control unit 40, a main memory unit 42, an auxiliary memory unit 44, a communication unit 46, and an operation button 48 in addition to the components shown in FIG.

[0032] The main control unit 40 is, for example, a CPU, a microprocessor, a DSP (Digital Signal Processor), or the like, and controls the overall operation of the mobile terminal 3.

[0033] The main storage unit 42 is configured with, for example, a RAM or a DRAM (Dynamic Random Access Memory), and is used as a work area when the main control unit 40 executes processes based on various programs.

[0034] The auxiliary storage unit 44 is, for example, a non-volatile memory such as a flash memory, and stores various data such as images, as well as programs used in the processing of the main control unit 40. The programs stored in the auxiliary storage unit 44 are, for example, an OS (Operating System) for implementing the basic functions of the mobile terminal 3, drivers for controlling various hardware, and programs for implementing e-mail, web browsing, and various other functions. The auxiliary storage unit 44 also stores applications for shooting and posting singing videos and for viewing video posting sites. (hereinafter referred to as the "video posting and viewing app") is pre-stored.

[0035] The communication unit 46 is, for example, a network interface controller (NIC), and has a function of connecting to the communication line 2. Note that the communication unit 46 may have, instead of or together with the NIC, a function of connecting to a wireless local area network (LAN), a function of connecting to a wireless wide area network (WAN), and a function of enabling short-distance wireless communication such as Bluetooth (registered trademark), infrared communication, and the like.

[0036] The operation buttons 48 are provided on the side surface of the mobile terminal 3, and include a power button for starting and stopping the mobile terminal 3, a volume adjustment button for the sound output by the speaker 3b, and the like.

[0037] The main control unit 40, the main memory unit 42, the auxiliary memory unit 44, the communication unit 46, the operation buttons 48, the touch panel display 3a, the speaker 3b, the microphone 3c, the camera 3d, and the earphone terminal 3e are electrically connected to one another via a system bus 49. Therefore, the main control unit 40 can access the main memory unit 42 and the auxiliary memory unit 44, display images on the touch panel display 3a, grasp the operation state of the touch panel display 3a and the operation buttons 48 by the user, input sound to the microphone 3c, output sound from the speaker 3b or an earphone connected to the earphone terminal 3e, control the camera 3d, and access various communication networks and other information processing devices via the communication unit 46.

[0038] [1-4. Filming of singing videos by singing users] A case where a singing user shoots a singing video using the mobile terminal 3A will be described.

[0039] When a singing user shoots a singing video, the singing user launches a video posting and viewing application on the mobile terminal 3A. When the video posting and viewing application is launched, the mobile terminal 3A accesses the server 4 that stores a plurality of pieces of music data. The singing user then arbitrarily selects a piece of music to sing from the video posting and viewing application, and downloads the music data from the server 4 to the mobile terminal 3A. The singing user then plays the music at a timing of his or her choice using the video posting and viewing application, and sings. The video posting and viewing application starts playing the music, and starts shooting the video with the camera 3d. That is, the singing video is a video shot by the mobile terminal 3A while the music is being played from the mobile terminal 3A.

[0040] Note that song data is also associated with lyric data, and when song data is downloaded from the server 4 to the mobile terminal 3A, the associated lyric data is also downloaded to the mobile terminal 3A. Note that in the following description, song data is considered to include lyric data.

[0041] FIG. 4 is an example of a display state (hereinafter referred to as "screen display") on the screen 3a of the mobile terminal 3A when a singing video is being filmed.

[0042] 4, the screen 3a is divided into a lyrics display area 50A and a captured image display area 50B. The lyrics display area 50A includes a lyrics image 52 showing the lyrics of the song sung by the user, a pitch image 54 showing the pitch of the song, and a progress bar 56 showing the progress of the shooting.

[0043] The lyric image 52 and the pitch image 54 are updated according to the progress of the music. In the present embodiment, as an example, the lyric image 52 and the pitch image 54 are updated every few phrases and displayed in the lyric display area 50A. Note that the update timing of the lyric image 52 and the pitch image 54 may be the same or different.

[0044] As an example, the lyrics image 52 displays lyrics in multiple rows (two rows in the example of FIG. 4), and the color of the lyrics in the upper row changes from the left end to the right end in accordance with the progress of the music so that the singing user can understand the lyrics that should currently be sung. When the color change of the lyrics in the upper row reaches the right end, the lyrics in the lower row rises and is displayed in the upper row, and new lyrics are displayed in the lower row, and the color of the lyrics in the upper row changes again from the left end to the right end in accordance with the progress of the music.

[0045] As an example, the pitch image 54 is displayed with multiple pitch bars 54A in a staircase pattern in the left-right direction according to the strength of the pitch. Then, in order to allow the singing user to grasp the pitch of the lyrics that should be sung at present, the color of the pitch bars 54A changes from the left end to the right end as the song progresses, and the pointer 54B moves from the left end to the right end. When the color of the pitch bars 54A changes and the pointer 54B reaches the right end, the pitch image 54 indicating the next pitch is updated and displayed.

[0046] As an example, the length of the progress bar 56 from the left end to the right end indicates the length of the entire song. When playback of the song starts, a pointer 56A indicating the playback position of the song moves from the left end to the right end, and when the pointer 56A reaches the right end, the song ends. Note that the progress bar 56 that the pointer 56A has passed through is displayed thicker than the position before the progress.

[0047] Recording of a singing video starts a predetermined time (e.g., 10 seconds) after the singing user selects a song and clicks a recording start button (not shown) displayed on the screen 3a. The start and end of video recording may coincide with the start and end of the song, but this is not limited thereto. Video recording may start a predetermined time (e.g., 5 seconds) before the start of the song, or end a predetermined time (e.g., 5 seconds) after the end of the song.

[0048] The singing user connects earphones to the earphone terminal 3e, listens to the music being played using the earphones, and sings along with the music. The mobile terminal 3A photographs the singing user with the camera 3d and records the singing user's singing with the microphone 3c. In other words, the microphone 3c does not capture the sound of the music being played. The mobile terminal 3A then records the singing user's singing voice captured by the microphone 3c, and creates singing data.

[0049] The singing data may be obtained by extracting the frequency band of the human voice through a filtering process, which removes noises caused by the surrounding environment of the singing user from the singing data, thereby making the recorded singing voice of the singing user clearer.

[0050] Then, the video posting and viewing application combines the music data and singing data with the recording data to generate singing video data that can be transmitted to the server 4. Note that, as an example, the user can select one of the following two types of timing for transmitting the singing video data to the server 4, i.e., the timing for uploading the singing video data to the video posting site.

[0051] One is live distribution, in which a singing user uploads singing video data to a video sharing site in real time while singing. In live distribution, a viewing user watches the singing user sing in real time. The other is non-live distribution, in which a singing user uploads singing video data to a video sharing site at a timing of their choice after singing of a song is completed.

[0052] When performing live distribution, the singing user sets up the live distribution before recording the singing video, and uploads the singing video data to the video posting site when the video recording starts. In the case of live distribution, the singing video data may be uploaded to the video posting site without being stored in the mobile terminal 3A.

[0053] In addition, as settings for live streaming, a singing user can set either a first live streaming setting that allows viewing users to view the singing video in live streaming, or a second live streaming setting that allows viewing users to view the singing video even after the live streaming. That is, in the first live streaming setting, when the live streaming ends, the singing video data is deleted from the server 4, and the viewing users cannot view the live-streamed singing video after the live streaming ends. On the other hand, in the second live streaming setting, the server 4 continues to store the singing video data even after the live streaming ends, so that the viewing users can view the singing video as non-live streaming even after the live streaming ends.

[0054] In addition, when performing non-live distribution, the singing video data is temporarily stored in the mobile terminal 3A, and the singing user operates the video posting and viewing application to upload the singing video to the video posting site at any time.

[0055] [1-5. Viewing of singing videos by viewers] A case where a viewing user views a singing video using the mobile terminal 3B will be described.

[0056] When the viewing user wishes to view a singing video, the viewing user launches a video posting and viewing application on the mobile terminal 3B. When the video posting and viewing application is launched, the mobile terminal 3B accesses a server 4 that stores multiple singing video data, i.e., a video posting site. The viewing user then selects the singing video that he or she wishes to view via the video posting and viewing application and displays it on the screen 3a. Note that the method by which the server 4 distributes the singing video to the mobile terminal 3B is, for example, streaming distribution.

[0057] FIG. 5 is an example of a screen display of the mobile terminal 3B when watching a singing video, showing a screen display when live distribution is being performed.

[0058] The screen 3a displays a singing video and also has a singing user display area 50C, a lyrics display area 50D, and a comment input display area 50E. The singing user display area 50C, the lyrics display area 50D, and the comment input display area 50E may be displayed superimposed on the singing video.

[0059] The singing user display area 50C displays the username of the singing user who posted the singing video, an indication of whether or not the video is being distributed live, and the name of the song being sung.

[0060] The lyrics of the singing video are displayed in the lyrics display area 50D. As an example, the lyrics displayed are multiple phrases at a time, and the color of the lyrics changes from the left end to the right end as the music progresses. As an example, the lyrics display area 50D may display lyrics in multiple rows. In this case, when the color change of the lyrics in the upper row reaches the right end, the lyrics in the lower row rises and is displayed in the upper row, and new lyrics are displayed in the lower row, and the color of the lyrics in the upper row changes again from the left end to the right end as the music progresses.

[0061] In the comment input display area 50E, a comment input field is displayed, and comments from viewing users who are viewing the singing video are displayed together with their user names. As an example, each time a comment is input from a viewing user, the comment is additionally displayed at the top of the comment input display area 50E, and comments that were previously displayed are moved down. When the comments cannot be displayed in the comment input display area 50E, a scroll bar (not shown) is displayed on the right side of the comment display area, and comments that were not displayed on the screen 3a until then are displayed by the viewing user operating the scroll bar.

[0062] Furthermore, on the screen 3a, operation icons 58A to 58D are displayed which allow the viewing user to carry out various operations.

[0063] The operation icon 58A is an icon that is clicked when the viewing user sympathizes with the singing video that the viewing user is viewing, and the total number of clicks of the operation icon 58A for the singing video is displayed above the operation icon 58A.

[0064] The operation icon 58B is an icon that is clicked when the viewing user challenges a singing user who is live streaming the singing video displayed on the screen 3a to a battle (hereinafter referred to as a "singing battle"). In a singing battle, multiple singing videos (first singing video, second singing video) by different singing users are simultaneously displayed on the screen 3a of the viewing user's mobile terminal 3B, and the singing videos take turns singing the same song. In other words, the viewing user who clicks the operation icon 58B becomes a singing user who will participate in a singing battle.

[0065] The operation icon 58C is an icon that is clicked when the viewing user performs various settings for the video posting / viewing application.

[0066] The operation icon 58D is an icon that is clicked by the viewing user when a decorative image is to be superimposed on the singing video displayed on the screen 3a. Note that the decorative images according to this embodiment are priced according to their type, and can be purchased by the viewing user for a fee. The viewing user then superimposes the decorative image on the singing video that he or she is viewing by clicking the operation icon 58D. The singing user of the singing video on which the decorative image is superimposed receives money according to the superimposed decorative image from the operator of the video posting site. In other words, the superimposition (display instruction) of a decorative image on a singing video by the viewing user corresponds to a so-called tipping to the singing user.

[0067] [1-6. Overview of the competitive singing function] The video posting and viewing application according to this embodiment has a battle function in which multiple users, who are performers, compete with each other to see who can show the best performance video of their own. The battle function according to this embodiment is a kind of so-called karaoke battle, and is a singing battle function that simultaneously displays multiple singing videos (first singing video 60A, second singing video 60B) by different singing users on the screen 3a of the mobile terminal 3B of the viewing user, as exemplified in FIG. 6. The singing battle function is executed by the server 4.

[0068] Fig. 6 shows a screen display of the mobile terminal 3B of the viewing user in a singing battle. The "VS" display shown in Fig. 6 is displayed at the start of the singing battle, and is stopped a predetermined time after the singing battle starts (e.g., 3 seconds). The screen display of the singing user's mobile terminal 3A may be the same as that shown in Fig. 6, or may show other singing users who will be competing in the singing battle in a reduced size (see Fig. 8 described later) compared to the screen display shown in Fig. 4.

[0069] In order for a singing competition to take place, a singing user (hereinafter referred to as the "first singing user") makes a request (hereinafter referred to as a "match request") to another singing user (hereinafter referred to as the "second singing user") to simultaneously distribute a singing video, and the second singing user must agree to the match request.

[0070] More specifically, the first singing user starts a video posting and viewing application on his / her mobile terminal 3A1, and transmits a request for a battle to a second singing user who is live streaming a singing video using the video posting and viewing application. The first singing user transmits the request for a battle by clicking the operation icon 58B. The first singing user selects the song to be sung in the battle. The selected song Information indicating the song (hereinafter referred to as the "battle song") (such as the title and singer name) is transmitted to the second singing user together with the battle request.

[0071] The match request transmitted from the mobile terminal 3A1 is transmitted to the mobile terminal 3A2 of the second singing user via the server 4. An image corresponding to the received match request is displayed on the screen 3a of the mobile terminal 3A2, and if the second singing user accepts the match request, he or she clicks on a predetermined image displayed on the screen 3a.

[0072] Then, when the second singing user accepts the battle request from the first singing user, the server 4 starts the battle singing by distributing the first singing video 60A by the first singing user and the second singing video 60B by the second singing user so that they are simultaneously displayed on the screen 3a of the mobile terminal 3B. This allows the viewing user to watch the battle singing (real-time battle) between the first singing user and the second singing user in real time. In the following description, the first singing video 60A and the second singing video 60B distributed in the battle singing are collectively referred to as battle singing videos.

[0073] In this way, the singing competition function accepts a singing video competition request from the first singing user to the second singing user, and when the second singing user accepts the competition request, delivers the first singing video 60A and the second singing video 60B so that they are simultaneously displayed on the screen 3a of the mobile terminal 3B. Therefore, the singing competition function enables singing users to compete with each other by their own singing videos, and enables a viewing user to simultaneously view the competing singing videos.

[0074] It is also assumed that the second singing user may accept the battle request but not accept the battle song. For such a case, the battle singing function may have a function of transmitting information indicating the change in the battle song and the battle song selected by the second singing user from the mobile terminal 3A2 of the second singing user to the mobile terminal 3A1 of the first singing user, and requesting the first singing user's approval.

[0075] [1-6-1. Alternating singing in singing contests] In the singing battle function according to the present embodiment, a first singing user and a second singing user alternately sing the same piece of music (hereinafter referred to as "alternate singing").

[0076] Alternate singing may take the form of, for example, a first singing user finishing singing a song, and then a second singing user singing the same song in its entirety; however, the singing battle function according to this embodiment virtually divides a song into a number of regions as shown in FIG. 7, and sets the order of singing users who will sing for each divided region 68 (hereinafter referred to as "alternate performance setting"). As a result, the first singing user and the second singing user will alternately sing the same song according to the alternating performance setting, so that the viewing user can clearly recognize the difference in singing ability between the first singing user and the second singing user, and can enjoy the singing battle even more. In the following description, the order of singing users who will sing will be referred to as the alternating singing order.

[0077] In addition, the singing battle function, for example, highlights the part of the lyrics that the singing user sings, thereby allowing the singing user to recognize the divided area 68 that he or she sings. The highlighting is performed by changing the color or thickness of the lyrics, or the like.

[0078] 7, the divided areas 608 are set so that the first singing user and the second singing user sing alternately, and the divided areas 68 are also set so that the first singing user and the second singing user sing together. The divided areas 68 are set in advance based on, for example, a phrase, a chorus, or a bar of a song, and the time length of each divided area 68 does not necessarily have to be the same.

[0079] The alternating singing order is determined when a singing battle is decided. For example, the order is set so that the first singing user who requested the battle sings first, and the second singing user sings afterwards. The divided area 68 in which the first singing user and the second singing user sing together may be set in advance for each song.

[0080] The alternating singing order set based on the divided areas may be changed dynamically. For example, a singing user with a relatively higher total score obtained by a voting function described later may sing in a larger number of divided areas 68. More specifically, the total scores of each singing user (singing video) are compared at each predetermined timing of the song, and the singing user with a relatively higher total score sings the subsequent divided areas 68 in succession. In this case, the maximum number of divided areas 68 that can be sung in succession is predetermined.

[0081] As a result, a singing user with a relatively high total score will sing in a larger number of divided areas 68, whereas a singing user with a relatively low total score will sing in a smaller number of divided areas 68. Therefore, a singing user with a relatively high total score can better appeal to the viewing users with regard to their singing ability, and more attract the viewing users.

[0082] [1-6-2. Screen display and audio output during alternating singing] As described above, Fig. 6 shows a display screen of the mobile terminal 3B of the viewing user in the singing competition, in which the first singing video 60A and the second singing video 60B are both displayed in the same image size. For the singing video in progress, a display ("NOW PLAYING" in Fig. 6) is displayed so that the viewing user can recognize it.

[0083] Here, a singing video and its audio when singing is not currently being performed are not of interest to a viewing user and may distract the attention of a viewing user who is viewing singing that is currently being performed.

[0084] Therefore, the singing competition function according to the present embodiment delivers singing videos to the mobile terminal 3B so that the sound of the singing video in which singing is being performed is output and the sound of the singing video in which singing is not being performed is not output. Also, the server 4 delivers singing videos to the mobile terminal 3B so that the singing video in which singing is being performed is displayed larger on the screen 3a of the mobile terminal 3B than the singing video in which singing is not being performed. This allows the viewing user to watch the singing competition videos without being distracted by the singing video in which singing is not being performed.

[0085] Fig. 8 is an example of a screen display of the mobile terminal 3B in a singing battle. In the example of Fig. 8, the first singing video 60A is being sung and the second singing video 60B is not being sung, so the first singing video 60A is enlarged (full screen display) while the second singing video 60B is reduced (window display). The image size and display position on the screen 3a when the singing videos are reduced may be determined in advance, or the viewing user may be able to change the image size and screen position to any desired size.

[0086] In addition, the singing battle function according to this embodiment distributes singing videos to the mobile terminal 3B so that the first singing video 60A and the second singing video 60B are output as audio, or the first singing video 60A and the second singing video 60B are displayed on the screen, based on the alternating singing order described above.

[0087] That is, in the divided area 68 where the first singing user sings, the sound of the first singing video 60A is output and the first singing video 60A is displayed in an enlarged manner, while the sound of the second singing video 60B is not output and the second singing video 60B is displayed in a reduced manner. Also, in the divided area 68 where the second singing user sings, the sound of the second singing video 60B is output and the second singing video 60B is displayed in an enlarged manner, while the sound of the first singing video 60A is not output and the first singing video 60A is displayed in a reduced manner. Also, in the divided area 68 where the first singing user and the second singing user sing together, the first singing video 60A and the second singing video 60B are displayed on the screen in the same image size as shown in FIG. 6, and both are output as sound.

[0088] In this way, the competitive singing function of this embodiment controls the audio output and screen display of the competitive singing video based on the alternating performance setting described above, so that even when singing videos are displayed simultaneously, it is easy to control the output of the competitive singing video on the viewing user's mobile terminal 3B.

[0089] [1-6-3. Voting function] The video posting and viewing application has a voting function that accepts input of evaluations (hereinafter referred to as "votes") for each singing video in the singing competition from the mobile terminal 3B of the viewing user.

[0090] A vote is entered by a viewer clicking on operation icon 58A provided for each singing video as shown in Figs. 6 and 8. That is, when a viewing user sympathizes with a singing video, the viewing user clicks operation icon 58A as an indication of the intention to give a favorable evaluation to the singing video. Then, an image 66 showing the evaluation result for each singing video that has been received (hereinafter referred to as a "voting result image") is delivered so as to be displayed on screen 3a of mobile terminal 3B together with the singing video.

[0091] In this way, the voting function according to the present embodiment allows the viewing user to evaluate the singing battle videos by clicking the operation icon 58A, for example, so that the viewing user can easily judge the quality of the singing when a singing battle is held. Note that the viewing user can evaluate one singing video and the other singing video at the same time.

[0092] The voting function accepts input of points as votes, and derives the total points input during the distribution of the singing video (hereinafter referred to as the "total evaluation score") as the evaluation result. The total evaluation score is the sum of the points input by multiple viewing users. The voting function then determines the winner of the singing competition based on the total evaluation scores input by the time the singing competition ends. In other words, the singing user whose singing video has a relatively high total evaluation score is determined to be the winner. In this way, according to the voting function of this embodiment, multiple viewing users can vote cooperatively for the singing user (singing video) they support, thereby causing the singing user they support to be the winner, allowing the viewing users to empathize more with the singing user.

[0093] In the voting function according to this embodiment, one point is input each time the operation icon 58A is clicked once. The numbers (21 and 185) in the voting result image 66 shown in Figs. 6 and 8 indicate the total evaluation points for each singing user (singing video), and the bar image that extends to the left and right of the screen 3a and is hatched (colored differently) on the left and right relatively indicates the total evaluation points for each singing video.

[0094] In addition, an upper limit is set for the number of times each viewing user can click the operation icon 58A (hereinafter referred to as "upper click limit"), and the upper click limit according to this embodiment is one time. When the upper click limit is reached, the operation icon 58D is displayed on the screen 3a in place of the operation icon 58A, as shown in FIG.

[0095] By clicking the operation icon 58D, the viewing user can superimpose a decorative image (hereinafter referred to as a "throwing effect image") on the singing video corresponding to the clicked operation icon 58D. In this way, the voting function has a throwing effect function that receives a throwing effect image to be superimposed on the singing video from the mobile terminal 3B and superimposes the received throwing effect image on the singing video. In the following description, the viewing user's instruction (selection) to display the throwing effect image via the mobile terminal 3B is referred to as a throwing input, as described above.

[0096] That is, the viewing user decorates a singing video that he or she sympathizes with by superimposing the coin tip effect image 69 on the singing video, so that the coin tip effect function can liven up the viewers and the singing video itself during the distribution of the singing video. The coin tip effect function is a function executed by the server 4 in response to a display instruction from the viewing user via the video posting and viewing application.

[0097] 9 shows a screen display of the mobile terminal 3B to which the viewing user transitions when the viewing user clicks the operation icon 58D, and displays a plurality of different tip effect images 69 that the viewing user can select. Points are set for each tip effect image 69, and the design differs according to the points. The viewing user selects one of the plurality of tip effect images 69 displayed on the screen that can be acquired with the points owned. Note that different designs refer to, for example, different shapes, colors, or orientations.

[0098] As an example, a charge amount is set for each point, and the viewing user purchases points, and the types of selectable tip effect images 69 increase or decrease depending on the points owned. When a tip effect image 69 is selected by the viewing user, the points owned by the viewing user decrease according to the points of the selected tip effect image 69. Note that points may be obtained not only by charging, but also by increasing by using other online services, etc.

[0099] The coin tip effect image 69 illustrated in Fig. 9 includes four types of spotlight images that are divergent toward the end and imitate spotlights in different directions, and four types of combined spotlight images that are different in color and are made by combining multiple spotlight images. By making the coin tip effect image 69 an image that imitates a spotlight, the viewing user can feel as if he or she is participating in a concert or the like. Note that the coin tip effect image 69 is not limited to the example in Fig. 9, and may be another image.

[0100] 10 is an example of a singing video (hereinafter referred to as an "effect-superimposed singing video") in which a combined spotlight image is selected by a viewing user as a coin-throwing effect image 69 and the coin-throwing effect image 69 is superimposed. The effect-superimposed singing video is viewable not only by the viewing user who selected the coin-throwing effect image 69, but also by other viewing users who are viewing the singing competition.

[0101] The tip effect function according to the present embodiment can be applied to a singing video in which singing is being performed, and after inputting a tip, the tip effect image 69 is superimposed on the singing video with almost no time delay. That is, in the example of Fig. 10, the viewing user can superimpose the tip effect image 69 on the first singing video 60A, but cannot superimpose the tip effect image 69 on the second singing video 60B in which the singing user is not singing. More specifically, even if the viewing user clicks on the operation icon 58D corresponding to a singing video in which the singing user is not singing, the tip effect function does not accept the click.

[0102] Furthermore, when the voting function accepts the superimposition of the coin tip effect image 69, it accepts input of a score corresponding to the coin tip effect image 69 as an evaluation. In the present embodiment, as an example, points corresponding to the coin tip effect image are input as the evaluation score. That is, every time a coin tip input is made, points corresponding to the coin tip effect image 69 selected by the viewing user are added to the above-mentioned three evaluation total score.

[0103] In this way, the voting function according to the present embodiment can encourage viewing users to input a donation by accepting input of a score as an evaluation in response to the superimposition of the donation effect image 69. There is no upper limit to the number of times each viewing user can input donations. In other words, the viewing user can increase the total evaluation score of the singing video that he or she sympathizes with by repeatedly clicking the operation icon 58D.

[0104] Furthermore, an image (icon image 64) showing a viewing user who has given a relatively higher rating (vote) to the singing video than other viewing users, i.e., a viewing user who has input a large number of points (hereinafter referred to as a "highly rated user"), is displayed on the screen 3a of the mobile terminal 3B. This allows the viewing user to make other viewing users aware of the singing user whom the viewing user is supporting. The viewing user can also make the singing user aware that the viewing user is supporting the singing user.

[0105] In the voting function according to this embodiment, the top three users with the highest number of points entered are determined as highly rated users, and icon images 64 of the highly rated users are displayed on the screen 3a for each singing video, but the number of highly rated users for which icon images 64 are displayed is not limited to this.

[0106] In addition, in the voting function according to this embodiment, a score is input as an evaluation when the operation icon 58A is clicked and when a coin is deposited, but this is not limited to the above. For example, a score may be input as an evaluation when a coin is deposited, or a score may be input as an evaluation when the operation icon 58A is clicked.

[0107] [1-6-4.Other features] The server 4 may store information for each singing user (hereinafter referred to as "singing user information") in the HDD 26. The singing user information includes the number of fans the singing user has, the singing user's past match results and winning rate, favorite songs, etc. The singing battle function may accept a battle request from a first singing user who has about the same number of fans to a second singing user. It is considered that the number of fans a singing user has varies depending on the singing ability of the singing user. In this way, by making the same number of fans a condition for accepting a singing battle, it is possible to prevent singing users with significantly different singing abilities from competing in a singing battle.

[0108] More specifically, when a first singing user makes a request for a match with a second singing user, the singing match function compares the number of fans of the first singing user with the number of fans of the second singing user, and if the difference in the number of fans is within a predetermined reference value (e.g., within ±20%), accepts the request for a match from the first singing user to the second singing user. The number of fans increases when a viewing user registers that he or she is a fan of the singing user via a video posting / viewing app. There is no limit to the number of singing users that a viewing user can register as fans.

[0109] The singing competition function may accept a competition request if the number of fans is similar but other conditions are met, or may accept a competition request if the number of fans is not similar but the second singing user agrees. On the other hand, the singing competition function may only accept competition requests from users with similar numbers of fans. Here, "only" means that, for example, a competition request from users with an unsimilar number of fans will not be accepted even if other conditions are met.

[0110] The singing competition function may also provide the singing user who wins the singing competition with a compensation according to the total evaluation points acquired by the votes cast for the singing user. The compensation may be money, points that can be used in a video posting and viewing application (video posting site) or other online services, etc. Also, the singing user who wins the singing competition may receive compensation according to the total points obtained by adding up not only his / her own evaluation total points but also the total evaluation points of his / her opponent (so-called take all).

[0111] [1-7. Functional block of singing competition function] 11 is a functional block diagram of the singing battle function according to this embodiment. The CPU 20 of the server 4 includes a battle request receiving unit 70, a battle acceptance determining unit 71, a battle setting unit 72, a video evaluating unit 73, a coin tip effect superimposing unit 74, and a video distributing unit 75. The processes executed by each function of the server 4 are realized by a program stored in the HDD 26.

[0112] The match request receiving unit 70 receives a match request from a first singing user to a second singing user. The match request receiving unit 70 may also receive a match request from a first singing user to a second singing user who has approximately the same number of fans.

[0113] The competition approval determination unit 71 determines whether or not the second singing user has approved the competition request from the first singing user.

[0114] The battle setting unit 72 performs various settings such as setting the song and the singing order for the singing battle. The battle setting unit 72 divides the song into a plurality of regions in chronological order, and sets the order of singing users who will sing in each region (alternate singing order). The battle setting unit 72 may also dynamically change the alternating singing order set based on the divided regions 68.

[0115] The video evaluation unit 73 receives input of evaluations (scores) for each singing video distributed to the mobile terminal 3B, and superimposition of a tip effect image 69 on the singing video (tipping input) from the mobile terminal 3B. Then, the video evaluation unit 73 derives the total evaluation points input during distribution of the singing videos, and determines the winner of the singing competition.

[0116] When a tip input is received, the tip effect superimposing unit 74 superimposes a tip effect image 69 corresponding to the received tip input on the singing video.

[0117] The video distribution unit 75 distributes the singing video to the mobile terminal 3B. When the second singing user accepts the battle request from the first singing user, the video distribution unit 75 distributes the first singing video 60A by the first singing user and the second singing video 60B by the second singing user so that they are simultaneously displayed on the screen 3a of the mobile terminal 3B. The video distribution unit 75 also distributes the battle singing video to the mobile terminal 3B so that the sound of the singing video in which singing is being performed is output, the sound of the singing video in which singing is not being performed is not output, and the singing video in which singing is being performed is displayed larger on the screen 3a than the singing video in which singing is not being performed.

[0118] [1-8. Flowchart of singing competition processing] 12 is a flowchart showing the flow of the singing competition process according to this embodiment, which is executed by the CPU 20 of the server 4. A program for executing the singing competition process according to this embodiment is stored in a predetermined area of ​​the HDD 26 in advance.

[0119] First, in step S100, the match request receiving unit 70 determines whether or not a match request from the first singing user to the second singing user has been made, and if the determination is affirmative, that is, if a match request from the first singing user has been received, the process proceeds to step S102. On the other hand, if the determination is negative, the process enters a waiting state until a match request is received.

[0120] In step S102, the competition approval determination unit 71 determines whether the second singing user has approved the competition request or not, and if the determination is affirmative, the process proceeds to step S104, and if the determination is negative, the process returns to step S100.

[0121] In step S104, the battle setting section 72 performs various settings for performing a singing battle.

[0122] In the next step S106, the video distribution unit 75 starts distribution of the competition singing video.

[0123] In the next step S108, the video distribution unit 75 determines whether the song of the singing competition has ended, and if the determination is affirmative, the process proceeds to step S110. On the other hand, if the determination is negative, the video distribution unit 75 continues to distribute the singing competition video until the song ends.

[0124] In the next step S110, the moving image distribution unit 75 ends the distribution of the competition singing moving image, and the process returns to step S100.

[0125] As described above, the server 4 (competitive singing function) according to the present embodiment accepts a singing video competition request from the first singing user to the second singing user, and when the second singing user accepts the competition request, distributes the first singing video 60A and the second singing video 60B so that they are simultaneously displayed on the screen 3a of the mobile terminal 3B. Therefore, the server 4 (competitive singing function) according to the present embodiment enables singing users to compete with each other by their own singing videos, and enables a viewing user to simultaneously view the competing singing videos.

[0126] [1-9. Voting process flowchart] 13 is a flowchart showing the flow of the voting process according to this embodiment, which is executed by the CPU 20 of the server 4. A program for executing the voting process according to this embodiment is stored in a predetermined area of ​​the HDD 26 in advance.

[0127] First, in step S200, the motion picture evaluation unit 73 judges whether or not the singing competition has started, and if the judgment is affirmative, the process proceeds to step S202. On the other hand, if the judgment is negative, the process enters a waiting state until the singing competition starts.

[0128] In step S202, the moving image evaluation section 73 judges whether or not the operation icon 58A has been clicked by the viewing user, and if the judgment is affirmative, the process proceeds to step S204, whereas if the judgment is negative, the process proceeds to step S206.

[0129] In step S204, the video evaluation unit 73 derives a total evaluation score, and the video distribution unit 75 updates the display of the total evaluation score.

[0130] In step S206, the moving image evaluation section 73 judges whether or not the operation icon 58D has been clicked by the viewing user, and if the judgment is affirmative, the process proceeds to step S208, whereas if the judgment is negative, the process proceeds to step S210.

[0131] In step S208, the coin tip effect superimposition unit 74 superimposes the coin tip effect image 69 selected by the viewing user on the target singing video, the video evaluation unit 73 derives a total evaluation score by adding points according to the superimposed coin tip effect image 69, and the video distribution unit 75 updates the display of the total evaluation score.

[0132] In the next step S210, the video evaluation unit 73 determines whether there has been a change in the users who have given the singing video high ratings. If the determination is affirmative, the process proceeds to step S212, and if the determination is negative, the process proceeds to step S214.

[0133] In step S212, the video distribution unit 75 updates the display of the icon images 64 of the highly rated users.

[0134] In step S214, the moving image distribution unit 75 judges whether or not the song for the singing competition has ended, and if the judgment is affirmative, the process proceeds to step S216, and if the judgment is negative, the process returns to step S202.

[0135] In step S216, the video evaluation unit 73 determines whether the contestants have won or lost based on the total evaluation points of each singing video, and the video distribution unit 75 distributes an image showing the result.

[0136] In the next step S218, the video distribution unit 75 ends the distribution of the competition singing video, and ends this voting process.

[0137] As described above, the server 4 (voting function) according to the present embodiment receives an evaluation of each singing video distributed to the mobile terminal 3 B from the mobile terminal 3 B. Therefore, the server 4 (voting function) according to the present embodiment enables a viewing user to easily judge the merits and demerits of the performance videos distributed by each of a plurality of singing users.

[0138] [2. Second embodiment] A second embodiment of the present invention will now be described.

[0139] The configurations of the karaoke system 1, the server 4, and the mobile terminal 3 according to this embodiment are similar to those of the karaoke system 1, the server 4, and the mobile terminal 3 according to the first embodiment, and therefore description thereof will be omitted.

[0140] [2-1. Overview of the Battle Dance Function] In the performance video according to this embodiment, the performers are dancers, the performance video is a dance video, and the dance video is uploaded to a video posting site (server 4). That is, the battle function according to this embodiment is a battle dance function that simultaneously displays a plurality of dance videos (first dance video 60C, second dance video 60D) by different dance users on screen 3a of mobile terminal 3B of the viewing user, as shown in Fig. 14.

[0141] A battle dance occurs when a first dance user makes a request (battle request) to another dance user (hereinafter referred to as the "second dance user") for simultaneous distribution of dance videos, and the second dance user accepts the battle request. As an example, when the first dance user makes a battle request to the second dance user, the first dance user indicates that this battle request is for a battle dance. This allows the second dance user and the server 4 to recognize that this battle request is for a battle dance. In the following description, the first dance video 60C and the second dance video 60D distributed in a battle dance are collectively referred to as battle dance videos.

[0142] As in the first embodiment, the dance battle function according to this embodiment sets the order of dance users who will dance for each divided area 68 (see FIG. 7) that virtually divides a song into a plurality of areas in chronological order (hereinafter referred to as "alternate dance setting"). In the alternate dance setting, a divided area 68 in which a first dance user and a second dance user dance together may be set.

[0143] [2-1-1. Enlarged display function for featured videos] The dance competition function according to this embodiment has a function of determining (attractive video determination function) the dance video with the largest movement of the subject among multiple dance videos simultaneously displayed on the screen 3a of the mobile terminal 3B as the featured video, and delivering the dance video to the mobile terminal 3B so that the featured video is displayed larger than the other dance videos. Note that the subject here refers to a dancer who is a person.

[0144] 15, first dance video 60C is the featured video and second dance video 60D is not, so first dance video 60C is enlarged (full screen display) while second dance video 60D is reduced (window display). Note that the image size and display position on screen 3a when the dance video is reduced may be determined in advance, or the viewing user may be able to change the image size and screen position to any desired value.

[0145] In this way, the enlarged display function determines a featured video to be displayed larger than other dance videos based on the movement of the subject, so that it is possible to change the display manner of the competition dance video on the screen 3a of the mobile terminal 3B without using the sound of the distributed dance video.

[0146] Furthermore, when a first dance user and a second dance user dance together, the dance video with the greater movements is enlarged and displayed on the viewing user's mobile terminal 3B, so that the competing dance users perform a more dynamic dance, which results in more excitement for the viewing users.

[0147] The enlarged display function also delivers the competition dance video to mobile terminal 3B so that the sound of the featured video is output and the sound of other dance videos is not output. This allows the sounds (voices, breathing, etc.) of the dancers in the featured video to be output from mobile terminal 3B, while sounds of dancers not in the featured video are not output from mobile terminal 3B. This allows the viewing user to watch the competition dance video without being distracted by sounds from dance videos that are not the featured video.

[0148] When the enlarged display function of this embodiment is executed, audio output and screen display based on the alternating performance setting described in the first embodiment are not performed, but this is not limited to the above, and the enlarged display function of this embodiment may be executed when the first dance user and the second dance user dance together, while audio output and screen display based on the alternating performance setting are performed.

[0149] [2-1-2. Attention video judgment function] The featured video determination function extracts images (hereinafter referred to as "dancer images") showing the subject dancer (person) from the dance video at a predetermined time interval, and determines the dance video with the greatest difference between the extracted dancers among multiple dance videos to be the featured video. Note that the image extraction interval (hereinafter referred to as "image extraction interval") is, for example, 0.5 seconds, and may be specified by the number of frames rather than time.

[0150] More specifically, the featured video determination function extracts dancer images at a predetermined time interval (0.5 seconds) from the start of the dance video, and derives the difference between the dancer images before and after the image extraction interval. The featured video determination function then compares the differences between the dance videos at the same timing derived for first dance video 60C and second dance video 60D, and selects the dance video with the greater difference between first dance video 60C and second dance video 60D as the featured video. Note that extraction of people from the dance videos may be performed, for example, by a known image analysis method.

[0151] In this way, the attention video determination function determines the magnitude of the dancer's movements directly from the dancer image contained in the dance video, so it can accurately determine dance videos in which the subject dancer's movements are relatively large. Note that the dance video according to this embodiment is a video in which the dancer's entire body is photographed and the dancer is photographed at a size that allows image analysis in order to perform image analysis of the dancer image.

[0152] Furthermore, the featured video determination function according to this embodiment determines differences in the movements of the dancer, who is the subject, based on the movements of the dancer's hands and feet.

[0153] FIG. 16 shows an example of dancer images extracted from a dance video at image extraction intervals. (A) and (B) are dancer images extracted at image extraction intervals from first dance video 60C, and Figures 16(C) and (D) are dancer images extracted at image extraction intervals from second dance video 60D. That is, in the example of Figure 16, the dancer image of first dance video 60C shown in Figure 16(A) changes to Figure 16(B) after a predetermined time, and the dancer image of second dance video 60D shown in Figure 16(C) changes to Figure 16(D) after a predetermined time.

[0154] In the example of Figure 16, as surrounded by the dashed area, the first dance video 60C shows large movements of the left hand and right foot, while the second dance video 60D shows only slight movement of the left and right feet, so the difference between the dancer images is greater in the first dance video 60C. For this reason, the first dance video 60C is set as the image of interest. Note that, as one example, the movement of the hands and feet refers to the movement of the tip positions of the hands and feet, and the movement of the tip positions of the hands and feet is derived from a change in the coordinates indicating the tip positions.

[0155] In this way, the attention video determination function determines differences in the movements of the subject dancer based on the movements of the dancer's arms and legs, thereby making it possible to more accurately determine the dancer's movements.

[0156] Here, there are cases where the dancer does not move for a moment during dancing. In such a case, if the dancer (subject) of another dance video that is not the attention video moves, the other dance video may be determined to be the attention video, and as a result, the video in which the dancer is not performing the dance may be enlarged and displayed on mobile terminal 3B.

[0157] Therefore, the zoom function may switch the other dance video as the featured video when the movements of the dancer in the featured video become smaller than the movements of the dancer in the other dance video for a predetermined time (e.g., 1 second) or more. In other words, even if the movements of the dancer in the featured video become smaller than the movements of the dancer in the other dance video, the other dance video will not be switched to the featured video if the time is less than the predetermined time.

[0158] This makes it possible to prevent another dance video in which the dancer in the featured video is not dancing from becoming the featured video even if the dancer in the featured video temporarily stops moving.

[0159] [2-2. Functional block of the competitive dance function] 17 is a functional block diagram of the battle dance function according to this embodiment. The CPU 20 of the server 4 includes a battle request receiving unit 70, a battle acceptance determination unit 71, a battle setting unit 72, a video evaluation unit 73, a coin throwing effect superimposition unit 74, and a video distribution unit 75, as well as a featured video determination unit 80. The processes executed by each function of the server 4 are realized by a program stored in the HDD 26. Note that the battle request receiving unit 70, the battle acceptance determination unit 71, the battle setting unit 72, the video evaluation unit 73, the coin throwing effect superimposition unit 74, and the video distribution unit 75 according to this embodiment are the same as those according to the first embodiment, although the video to be processed is a dance video, and therefore the description thereof will be omitted.

[0160] Attention moving image determination section 80 executes the attention moving image determination function described above, and determines that the dance moving image in which the subject (dancer) moves the most out of a plurality of dance moving images is the attention moving image.

[0161] Note that the video distribution section 75 according to this embodiment distributes the competition dance video to the mobile terminal 3B so that the sound of the featured video is output and the sounds of other dance videos that are not the featured video are not output.

[0162] [2-3. Flowchart of attention video expansion process] 18 is a flowchart showing the flow of the attention video 9 enlargement process according to this embodiment, which is executed by the CPU 20 of the server 4. A program for executing the attention video enlargement process according to this embodiment is stored in a predetermined area of ​​the HDD 26 in advance.

[0163] First, in step S300, the attention moving image determination unit 80 determines whether the music for the dance competition has started, and if the determination is affirmative, the process proceeds to step S302. On the other hand, if the determination is negative, the process enters a wait state until the music for the dance competition starts.

[0164] In the next step S302, immediately after the start of the competition dance music or after a predetermined time has elapsed (for example, one second), the attention video determination section 80 extracts dancer images from the first dance video 60C and the second dance video 60D.

[0165] In the next step S304, featured video determination unit 80 determines whether or not the image extraction interval has elapsed since the time when the previous dancer image was extracted, and if the determination is affirmative, the process proceeds to step S306. On the other hand, if the determination is negative, the process enters a wait state until the image extraction interval has elapsed.

[0166] In step S306, attention video determination section 80 extracts dancer images from first dance video 60C and second dance video 60D.

[0167] In the next step S308, noteworthy moving image determination section 80 derives the difference between the previously extracted dancer image and the currently extracted dancer image for each dance moving image.

[0168] In the next step S310, noted moving image determination section 80 compares the differences between the dancer images for each dance moving image to determine the noted moving image.

[0169] In the next step S312, video distribution unit 75 distributes the competition dance video to mobile terminal 3B so that the featured video is displayed larger (enlarged) than the other dance videos. When the dance video determined to be the featured video in step S310 is changed, the enlarged dance video is also changed.

[0170] In the next step S314, the featured video determination unit 80 determines whether or not the image extraction interval has elapsed since the last time the dancer image was extracted, and if the determination is positive, the process returns to step S306, and if the determination is negative, the process proceeds to step S316.

[0171] In step S316, the moving image distribution unit 75 determines whether or not the music for the competition dance has ended, and if the determination is affirmative, the process proceeds to step S318, and if the determination is negative, the process returns to step S314.

[0172] In the next step S318, the moving image distribution unit 75 ends the distribution of the competition dance moving image, and ends this featured moving image enlarging process.

[0173] As described above, the server 4 (dance battle function) according to this embodiment performs an attention video determination process to determine that the dance video with the largest dancer movements is the attention video among multiple dance videos simultaneously displayed on the screen 3a of the mobile terminal 3B, and delivers the attention video to the mobile terminal 3B so that it is displayed larger than the other dance videos. Therefore, the server 4 (dance battle function) according to this embodiment can change the display mode of the dance battle video on the screen 3a of the mobile terminal 3B without using the sound of the delivered dance video.

[0174] 3. Other embodiments The present invention has been described above using the above-mentioned embodiments, but the technical scope of the present invention is not limited to the scope described in the above-mentioned embodiments. Various modifications or improvements can be made to the above-mentioned embodiments without departing from the gist of the invention, and such modifications or improvements are also included in the technical scope of the present invention. In addition, the above-mentioned embodiments may be appropriately combined.

[0175] For example, in the above embodiment, a singing or dancing competition is performed by two performers (singing users or dancing users), but the present invention is not limited to this. For example, a singing or dancing competition may be performed by three or more performers. In this case, a performer may simultaneously request a competition with two or more other performers, or a performer who has received a competition request may further request a competition with other performers.

[0176] In the above embodiment, the voting result image 66 is described as a form in which the total evaluation score for each video is displayed as a bar image, but the present invention is not limited to this. For example, the total evaluation score for each video may be relatively displayed as a pie chart instead of a bar image.

[0177] In the above embodiment, the winner of the singing or dancing competition is determined by the votes of the viewers, but the present invention is not limited to this. For example, the singing or dancing competition may have an automatic scoring function, and the winner may be determined by the result of the automatic scoring function.

[0178] In the above first embodiment, the first singing video 60A and the second singing video 60B are outputted as audio and displayed on the screen based on the alternate performance setting, but the present invention is not limited to this. For example, the server 4 may perform image analysis (face recognition processing) on ​​the singing video transmitted from the mobile terminal 3A to determine the singing video in which the mouth is opened wider, and based on the determination result, the first singing video 60A and the second singing video 60B may be outputted as audio and displayed on the screen. That is, the singing video in which the mouth is opened relatively wider is determined to be the singing video in which the singing user is currently singing.

[0179] In the above embodiment, a real-time competition is described as a singing or dancing competition, but the present invention is not limited to this. For example, a performer may request a competition with a video of another performer that has already been recorded, and a competition between a live video and a recorded video, or a competition between recorded videos, etc. may be possible.

[0180] Furthermore, the process flow described in the above embodiment is also an example, and unnecessary steps may be deleted, new steps may be added, or the process order may be rearranged, without departing from the spirit of the present invention. [Explanation of symbols]

[0181] 3B Mobile terminal (terminal device) 3a screen 4 Server (information processing device) 60C 1st Dance Video (Featured Video) 60D 2nd Dance Video (Other Videos) 72 Battle setting unit (setting means) 75 Video distribution section (distribution means) 80 Attention video determination unit (determination means)

Claims

1. An information processing device that distributes videos posted by users to terminal devices, a distribution means for distributing a plurality of the videos so as to be simultaneously displayed on a screen of the terminal device; a determination means for determining, among the plurality of videos, a video having the greatest subject movement as a video of interest; The distribution means is an information processing device that distributes the video to the terminal device so that the attention video is displayed larger than the other videos.

2. The information processing apparatus according to claim 1 , wherein the determining means extracts images showing the subject from the moving images at predetermined time intervals, and determines, among the plurality of moving images, the moving image having the largest difference in the extracted subject to be the moving image of interest.

3. the subject is a person, 3. The information processing apparatus according to claim 2, wherein the determining means determines the difference between the subjects based on movements of the limbs of the subjects.

4. 4 . The information processing apparatus according to claim 1 , wherein the distribution means distributes the video to the terminal device such that a sound of the video of interest is output and sounds of the other videos are not output.

5. 5. The information processing device according to claim 1, wherein the determination means determines that the other video is the video of interest when the movement of the subject in the video of interest becomes smaller than the movement of the subject in the other video for a predetermined period of time or longer.

6. A video distribution method for distributing a video posted by a user to a terminal device, comprising the steps of: A first step of distributing a plurality of the videos so as to be simultaneously displayed on a screen of the terminal device; a second step of determining, among the plurality of moving images, the moving image having the largest subject movement as a moving image of interest; The second step is a video distribution method for distributing the videos to the terminal device so that the attention video is displayed larger than the other videos.

7. A computer included in an information processing device that distributes videos posted by users to a terminal device, a distribution means for distributing a plurality of the videos so as to be simultaneously displayed on a screen of the terminal device; determining, among the plurality of moving images, the moving image having the largest subject movement as the moving image of interest; The distribution means is a video distribution program that distributes the video to the terminal device so that the attention video is displayed larger than the other videos.

Images