Information processing device, video distribution method, and video distribution program

Abstract

To provide an information processing device, a moving image distribution method and a moving image distribution program which change a display mode of a moving image on a portable terminal without using a sound of the moving image.SOLUTION: A server performs a moving image of interest determination process for determining, as a moving image of interest, a dance moving image having the largest movement of a dancer among a plurality of dance moving images simultaneously displayed on the screen of the portable terminal, and distributes the moving image of interest to the portable terminal so as to be displayed larger than the other dance moving images. The moving image of interest determination process extracts an image indicating the dancer from the moving image at a predetermined time interval, and determines a moving image having the largest difference in the extracted subject among a plurality of moving images, as the moving image of interest.SELECTED DRAWING: Figure 18

Description

[Technical Field]

[0001] The present invention relates to an information processing device, a video distribution method, and a video distribution program. [Background technology]

[0002] BACKGROUND ART In recent years, online services such as websites (web pages, web services), online games, and application software (hereinafter referred to as "apps") that are distributed to information processing devices such as mobile terminals via computer networks have become widespread.

[0003] One type of online service is a video sharing site where users can upload videos they have taken themselves and other users can watch them. Users also upload performance videos, such as singing videos, to these video sharing sites. Online services such as competitions between performance videos of different users are also anticipated.

[0004] Patent Document 1 discloses a karaoke machine that, when displaying each karaoke video that constitutes a collaboration karaoke video, determines whether the volume of the singing voice in each karaoke video is equal to or greater than a predetermined reference value, and then displays the karaoke video in a manner that allows users whose singing voice volume is equal to or greater than the reference value to identify the karaoke video. As a result, the karaoke machine displays the karaoke video of users who are singing at a volume equal to or greater than the reference value in a larger size, and displays the karaoke video and karaoke video of users who are not singing in a smaller size. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-092592 Summary of the Invention [Problem to be solved by the invention]

[0006] However, the karaoke device disclosed in Patent Document 1 identifies karaoke singing videos based on the volume of the singing voice, and therefore cannot handle performance videos such as dance, in which the user may not make any sound.

[0007] The present invention has been made in consideration of the above circumstances, and aims to provide an information processing device, a video distribution method, and a video distribution program that can change the display mode of multiple videos without using the sound of the videos. [Means for solving the problem]

[0008] In order to solve the above problems, the information processing device, the video distribution method, and the video distribution program of the present invention employ the following means.

[0009] In order to solve the above problem, one aspect of the present invention, an "information processing device," is an information processing device that distributes videos posted by users to a terminal device, and is equipped with a distribution means that distributes multiple videos so that they are displayed simultaneously on the screen of the terminal device, and a determination means that determines that the video among the multiple videos with the largest subject movement is the featured video, and the distribution means distributes the videos to the terminal device so that the featured video is displayed larger than the other videos.

[0010] In order to solve the above problem, one aspect of the present invention, a "video distribution method," is a video distribution method for distributing videos posted by users to a terminal device, and includes a first step of distributing multiple videos so that they are displayed simultaneously on the screen of the terminal device, and a second step of determining that the video with the greatest subject movement among the multiple videos is the featured video, and the second step distributes the videos to the terminal device so that the featured video is displayed larger than the other videos.

[0011] In order to solve the above problem, one aspect of the present invention, a "video distribution program," causes a computer provided in an information processing device that distributes videos posted by users to a terminal device to function as a distribution means that distributes multiple videos so that they are displayed simultaneously on the screen of the terminal device, and as a determination means that determines that the video among the multiple videos with the largest subject movement is the featured video, and the distribution means distributes the videos to the terminal device so that the featured video is displayed larger than the other videos.

[0012] Various technical limitations may be imposed on the above-mentioned "information processing device," as exemplified below. Furthermore, technical limitations of the same nature may be imposed on the processing steps executed by the "video distribution method" or the functions of the "video distribution program."

[0013] The determination means extracts images showing the subject from the video at predetermined time intervals, and determines the video with the greatest difference in the extracted subject from among the plurality of videos to be the video of interest.

[0014] The subject is a person, and the determining means determines the difference between the subjects based on the movements of the limbs of the subjects.

[0015] The distribution means distributes the video to the terminal device so that the sound of the video of interest is output and the sound of the other videos is not output.

[0016] When the movement of the subject in the target video becomes smaller than the movement of the subject in another video for a predetermined time or longer, the determination means determines that the other video is the target video. [Effects of the Invention]

[0017] According to the present invention, it is possible to change the display mode of a plurality of moving images without using the sound of the moving images. [Brief explanation of the drawings]

[0018] [Figure 1]1 is a configuration diagram of a karaoke system according to a first embodiment of the present invention. [Figure 2] 1 is a block diagram showing the electrical configuration of a server according to a first embodiment of the present invention. [Figure 3] 1 is a block diagram showing the electrical configuration of a mobile terminal according to a first embodiment of the present invention. [Figure 4] FIG. 3 is a diagram showing a screen display of a mobile terminal when shooting a singing video according to the first embodiment of the present invention. [Figure 5] FIG. 2 is a diagram showing a screen display of a mobile terminal when viewing a singing video according to the first embodiment of the present invention. [Figure 6] FIG. 2 is a diagram showing the screen display of a mobile terminal of a viewing user in a singing battle according to the first embodiment of the present invention. [Figure 7] FIG. 1 is a schematic diagram showing divided regions of a musical piece used in a singing battle according to a first embodiment of the present invention. [Figure 8] FIG. 10 is a diagram showing another example of the screen display on the mobile terminal of the viewing user in the singing battle according to the first embodiment of the present invention. [Figure 9] FIG. 10 is a diagram showing a screen display when selecting a coin tip effect image according to the first embodiment of the present invention. [Figure 10] FIG. 1 is a diagram showing a singing video on which a coin tip effect image is superimposed according to the first embodiment of the present invention. [Figure 11] FIG. 1 is a functional block diagram relating to a singing battle function according to a first embodiment of the present invention. [Figure 12] 1 is a flowchart showing the flow of a singing battle process according to the first embodiment of the present invention. [Figure 13] 1 is a flowchart showing the flow of a voting process according to the first embodiment of the present invention. [Figure 14] FIG. 10 is a diagram showing the screen display of a mobile terminal of a viewing user in a dance battle according to the second embodiment of the present invention. [Figure 15] FIG. 10 is a diagram showing an enlarged display of a featured video in a dance battle according to a second embodiment of the present invention. [Figure 16]10 is a schematic diagram for explaining an attention moving image determination process according to a second embodiment of the present invention. [Figure 17] FIG. 10 is a functional block diagram relating to a dance battle function according to a second embodiment of the present invention. [Figure 18] 10 is a flowchart showing the flow of attention moving image enlargement processing according to the second embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0019] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An information processing device, a video distribution method, and a video distribution program according to an embodiment of the present invention will be described below with reference to the accompanying drawings.

[0020] [1. First embodiment] A first embodiment of the present invention will be described below. In this embodiment, a performer records their own performance as a video using a mobile terminal and transmits it to a server, thereby uploading it to a video sharing site. The video uploaded to the video sharing site (posted video) can be viewed via a mobile terminal. In this embodiment, the performance is referred to as singing, the performer is referred to as a singing user, and the video uploaded to the video sharing site is referred to as a singing video. Furthermore, a user who views a singing video uploaded to the video sharing site is referred to as a viewing user.

[0021] [1-1. Karaoke system configuration] 1 is a schematic diagram of a karaoke system 1 according to this embodiment. The karaoke system 1 includes a communication line 2, a plurality of mobile terminals 3 (mobile terminals 3A1, 3A2, 3B), and a server 4.

[0022] The communication line 2 forms a computer network, and is, for example, a wide area communication line provided by an electric utility company.

[0023] The mobile terminal 3 is an information processing terminal such as a smartphone, tablet, or laptop computer, and is used by users to access online services. The mobile terminal 3 includes a touch panel display 3a for displaying images, a speaker 3b for outputting sound, a microphone 3c for inputting sound, a camera 3d for capturing images of a subject, and an earphone jack 3e for connecting earphones (not shown). "Capturing" here refers to a state in which the camera 3d is functioning and the subject is displayed on the touch panel display 3a, regardless of whether recording is occurring. The touch panel display 3a includes, for example, an LCD (Liquid Crystal Display) and a touch sensor. The LCD displays various images, and the touch sensor accepts various input operations performed using a pointing device such as a finger, a stylus, or a pen. In the following description, the touch panel display 3a is also referred to as the screen 3a.

[0024] The server 4 is an information processing device that provides online services to the mobile terminal 3 via the communication line 2. In the example of FIG. 1, a singing user uploads his / her singing video (singing video data) to a video posting site by transmitting the singing video from the mobile terminal 3A to the server 4. A viewing user then accesses the video posting site using the mobile terminal 3B and views the singing video. The singing user can also view the singing video that he / she has uploaded by accessing the video posting site using the mobile terminal 3A. The user of the mobile terminal 3B can also become a singing user and upload a singing video to the video posting site.

[0025] [1-2. Server configuration] FIG. 2 is a block diagram showing the electrical configuration of the server 4 according to this embodiment.

[0026] The server 4 according to this embodiment includes a CPU (Central Processing Unit) 20, which is a main control unit that controls the overall operation of the server 4, a ROM in which various programs and various data are stored in advance, (Read Only Memory) 22, RAM (Random Access Memory) 24 used as a work area when the CPU 20 executes various programs, and HDD (Hard Disk Drive) 26 as storage means for storing various programs and various data.

[0027] The HDD 26 stores singing video data transmitted from the mobile terminal 3A, i.e., singing video data uploaded to a video posting site, song data indicating songs that the singing user can sing, etc. The storage means is not limited to the HDD 26, and may be, for example, another storage medium such as a semiconductor memory, such as a flash memory.

[0028] Furthermore, the server 4 is equipped with an operation input unit 28 consisting of a keyboard, mouse, etc., which accepts input of various operations, a monitor 30 such as a liquid crystal display device which displays various images, and an external interface 32 which is connected to other information processing devices such as a mobile terminal 3 via the communication line 2 and sends and receives various data to and from the other information processing devices.

[0029] The CPU 20, ROM 22, RAM 24, HDD 26, operation input unit 28, monitor 30, and external interface 32 are electrically connected to one another via a system bus 34. Therefore, the CPU 20 can access the ROM 22, RAM 24, and HDD 26, grasp the operation status of the operation input unit 28, display images on the monitor 30, and send and receive various data to and from other information processing devices, etc. via the external interface 32.

[0030] [1-3. Electrical configuration of mobile terminal] FIG. 3 is a functional block diagram showing the electrical configuration of the mobile terminal 3. As shown in FIG.

[0031] The mobile terminal 3 includes a main control unit 40, a main memory unit 42, an auxiliary memory unit 44, a communication unit 46, and an operation button 48 in addition to the components shown in FIG.

[0032] The main control unit 40 is, for example, a CPU, a microprocessor, a DSP (Digital Signal Processor), or the like, and controls the overall operation of the mobile terminal 3.

[0033] The main storage unit 42 is configured with, for example, RAM or DRAM (Dynamic Random Access Memory), and is used as a work area when the main control unit 40 executes processes based on various programs.

[0034] The auxiliary storage unit 44 is, for example, a non-volatile memory such as a flash memory, and stores various data such as images, and programs used for processing by the main control unit 40. The programs stored in the auxiliary storage unit 44 include, for example, an operating system (OS) for implementing the basic functions of the mobile terminal 3, drivers for controlling various hardware, and programs for implementing email, web browsing, and various other functions. The auxiliary storage unit 44 also stores applications for shooting and posting singing videos and for viewing videos on video posting sites. (hereinafter referred to as the "video posting and viewing app") is pre-stored.

[0035] The communication unit 46 is, for example, a NIC (Network Interface Controller), and has a function of connecting to the communication line 2. Note that the communication unit 46 may have, instead of or together with the NIC, a function of connecting to a wireless LAN (Local Area Network), a function of connecting to a wireless WAN (Wide Area Network), a function of enabling short-range wireless communication such as Bluetooth (registered trademark), infrared communication, etc.

[0036] The operation buttons 48 are provided on the side of the mobile terminal 3, and include a power button for starting or stopping the mobile terminal 3, a volume adjustment button for adjusting the volume of the sound output by the speaker 3b, and the like.

[0037] The main control unit 40, main memory unit 42, auxiliary memory unit 44, communication unit 46, operation buttons 48, touch panel display 3a, speaker 3b, microphone 3c, camera 3d, and earphone jack 3e are electrically connected to one another via a system bus 49. Therefore, the main control unit 40 can access the main memory unit 42 and auxiliary memory unit 44, display images on the touch panel display 3a, grasp the operation status of the touch panel display 3a or operation buttons 48 by the user, input sound to the microphone 3c, output sound from the speaker 3b or earphones connected to the earphone jack 3e, control the camera 3d, and access various communication networks or other information processing devices via the communication unit 46.

[0038] [1-4. Filming of singing videos by singing users] A case where a singing user shoots a singing video using the mobile terminal 3A will be described.

[0039] When a singing user shoots a singing video, the singing user launches a video posting and viewing app on the mobile terminal 3A. When the video posting and viewing app is launched, the mobile terminal 3A accesses the server 4, which stores multiple pieces of music data. The singing user then arbitrarily selects a piece of music to sing from the video posting and viewing app and downloads the music data from the server 4 to the mobile terminal 3A. The singing user then plays the music at a timing of their choice using the video posting and viewing app and sings. The video posting and viewing app starts playing the music and starts shooting a video with the camera 3d. In other words, the singing video is a video shot by the mobile terminal 3A while the music is being played from the mobile terminal 3A.

[0040] Note that song data is also associated with lyric data, and when song data is downloaded from the server 4 to the mobile terminal 3A, the associated lyric data is also downloaded to the mobile terminal 3A. Note that in the following explanation, song data is assumed to include lyric data.

[0041] FIG. 4 shows an example of a display state (hereinafter referred to as "screen display") on the screen 3a of the mobile terminal 3A when shooting a singing video.

[0042] 4, the screen 3a is divided into a lyrics display area 50A and a captured image display area 50B. The lyrics display area 50A includes a lyrics image 52 that displays the lyrics of the song being sung by the user, a pitch image 54 that displays the pitch of the song, and a progress bar 56 that displays the progress of the capture.

[0043] The lyric image 52 and the pitch image 54 are updated as the song progresses. In the present embodiment, as an example, the lyric image 52 and the pitch image 54 are updated every few phrases and displayed in the lyrics display area 50A. Note that the lyric image 52 and the pitch image 54 may be updated at the same time or at different times.

[0044] As an example, the lyrics image 52 displays lyrics in multiple rows (two rows in the example of FIG. 4), and the color of the lyrics in the upper row changes from the left end to the right end as the song progresses so that the singing user can understand the lyrics that should currently be sung. When the color change of the lyrics in the upper row reaches the right end, the lyrics in the lower row rises and are displayed in the upper row, and new lyrics are displayed in the lower row, and the color of the lyrics in the upper row changes again from the left end to the right end as the song progresses.

[0045] As an example, the pitch image 54 displays multiple pitch bars 54A in a stepped pattern in the left-right direction according to the pitch strength. Then, to enable the singing user to grasp the pitch of the lyrics that should currently be sung, the color of the pitch bars 54A changes from the left end to the right end as the song progresses, and the pointer 54B moves from the left end to the right end. When the color of the pitch bar 54A changes and the pointer 54B reaches the right end, the pitch image 54 indicating the next pitch is updated and displayed.

[0046] As an example, the length of the progress bar 56 from the left end to the right end indicates the length of the entire song. When playback of the song begins, a pointer 56A indicating the playback position of the song moves from the left end to the right end, and when the pointer 56A reaches the right end, the song ends. Note that the part of the progress bar 56 that the pointer 56A has passed through is displayed thicker than its position before the progress bar 56 began.

[0047] Recording of a singing video starts a predetermined time (e.g., 10 seconds) after the singing user selects a song and clicks a recording start button (not shown) displayed on screen 3a. The start and end of video recording may coincide with the start and end of the song, but this is not limiting. Video recording may start a predetermined time (e.g., 5 seconds) before the start of the song, or may end a predetermined time (e.g., 5 seconds) after the song ends.

[0048] The singing user connects earphones to the earphone terminal 3e, listens to the music being played using the earphones, and sings along with the music. The mobile terminal 3A captures a photo of the singing user using the camera 3d and records the singing user's singing using the microphone 3c. In other words, the microphone 3c does not capture the sound of the music being played. The mobile terminal 3A then records the singing user's singing voice captured by the microphone 3c and uses the recorded data as singing data.

[0049] The singing data may be filtered to extract the frequency band of the human voice, which removes noise from the singing user's surrounding environment, making the recorded singing voice clearer.

[0050] The video posting and viewing app then combines the music data and singing data with the recording data to generate singing video data that can be sent to the server 4. As an example, the user can select one of the following two options for the timing of sending the singing video data to the server 4, i.e., the timing of uploading the data to the video posting site.

[0051] One is live streaming, in which a singing user uploads singing video data to a video sharing site in real time while singing. In live streaming, viewing users watch the singing user sing in real time. The other is non-live streaming, in which a singing user uploads singing video data to a video sharing site at a timing of their choice after completing singing of a song.

[0052] When performing live streaming, the singing user sets up the live streaming before recording the singing video, and the singing video data is uploaded to the video sharing site at the same time as the video recording starts. Note that in the case of live streaming, the singing video data may be uploaded to the video sharing site without being stored in the mobile terminal 3A.

[0053] In addition, when performing live streaming, a singing user can set either a first live streaming setting that allows viewing users to view the singing video during live streaming, or a second live streaming setting that allows viewing users to view the singing video even after the live streaming. That is, with the first live streaming setting, the singing video data is deleted from the server 4 when the live streaming ends, and viewing users cannot view the live-streamed singing video after the live streaming ends. On the other hand, with the second live streaming setting, the server 4 continues to store the singing video data even after the live streaming ends, so viewing users can view the singing video as a non-live stream even after the live streaming ends.

[0054] In the case of non-live distribution, the singing video data is temporarily stored in the mobile terminal 3A, and the singing user operates the video posting and viewing application to upload the singing video to the video posting site at any time.

[0055] [1-5. Viewing of singing videos by viewers] A case where a viewing user views a singing video using the mobile terminal 3B will be described.

[0056] When a viewing user wishes to view a singing video, the viewing user launches a video posting and viewing app on the mobile terminal 3B. When the video posting and viewing app is launched, the mobile terminal 3B accesses a server 4 that stores multiple singing video data, i.e., a video posting site. The viewing user then selects the singing video they wish to view via the video posting and viewing app and displays it on the screen 3a. The server 4 distributes the singing video to the mobile terminal 3B by streaming, for example.

[0057] FIG. 5 is an example of a screen display on the mobile terminal 3B when watching a singing video, showing a screen display when live streaming is being performed.

[0058] The screen 3a displays a singing video and also has a singing user display area 50C, a lyrics display area 50D, and a comment input display area 50E. The singing user display area 50C, the lyrics display area 50D, and the comment input display area 50E may be displayed superimposed on the singing video.

[0059] The singing user display area 50C displays the username of the singing user who posted the singing video, an indication of whether or not it is a live broadcast, and the name of the song being sung.

[0060] The lyrics of the singing video are displayed in the lyrics display area 50D. For example, the lyrics displayed are multiple phrases at a time, and the color of the lyrics changes from the left end to the right end as the music progresses. For example, the lyrics display area 50D may display lyrics in multiple rows. In this case, when the color change of the lyrics in the upper row reaches the right end, the lyrics in the lower row rise and are displayed in the upper row, and new lyrics are displayed in the lower row. The color of the lyrics in the upper row changes again from the left end to the right end as the music progresses.

[0061] In the comment input display area 50E, a comment input field is displayed, and comments from viewing users who are viewing the singing video are displayed together with the user names. As an example, each time a comment is input from a viewing user, the comment is additionally displayed at the top of the comment input display area 50E, and comments that were previously displayed are moved down. When there are more comments than can be displayed in the comment input display area 50E, a scroll bar (not shown) is displayed on the right side of the comment display area, and the viewing user can operate the scroll bar to display comments that were not previously displayed on the screen 3a.

[0062] Furthermore, operation icons 58A to 58D are displayed on the screen 3a to allow the viewing user to perform various operations.

[0063] The operation icon 58A is an icon that is clicked when the viewing user empathizes with the singing video that the viewing user is viewing, and the total number of clicks on the operation icon 58A for the singing video is displayed above the operation icon 58A.

[0064] Operation icon 58B is an icon that is clicked by a viewing user when the viewing user challenges a singing user who is live streaming a singing video displayed on screen 3a to a singing battle (hereinafter referred to as a "singing battle"). A singing battle involves simultaneously displaying multiple singing videos (first singing video, second singing video) by different singing users on screen 3a of the viewing user's mobile terminal 3B, and the singing videos alternate singing the same song. In other words, the viewing user who clicks operation icon 58B becomes the singing user who will participate in the singing battle.

[0065] The operation icon 58C is an icon that is clicked by the viewing user when making various settings for the video posting and viewing application.

[0066] The operation icon 58D is an icon that the viewing user clicks when superimposing an ornamental image on the singing video displayed on the screen 3a. The ornamental images according to this embodiment have a price determined according to their type, and can be purchased by the viewing user for a fee. The viewing user then superimposes an ornamental image on the singing video that they are viewing by clicking the operation icon 58D. The singing user of the singing video on which the ornamental image is superimposed receives money corresponding to the superimposed ornamental image from the operator of the video posting site. In other words, the viewing user's superimposition (display instruction) of an ornamental image on a singing video corresponds to a so-called tipping payment to the singing user.

[0067] [1-6. Overview of the competitive singing function] The video posting and viewing app according to this embodiment has a battle function in which multiple users, who are performers, compete against each other to see who can show the best performance video of their own. The battle function according to this embodiment is a kind of so-called karaoke battle, and is a singing battle function in which multiple singing videos (first singing video 60A, second singing video 60B) by different singing users are simultaneously displayed on the screen 3a of the mobile terminal 3B of the viewing user, as illustrated in FIG. 6. The singing battle function is executed by the server 4.

[0068] Fig. 6 shows a screen display on the mobile terminal 3B of the viewing user in a singing battle. The "VS" display shown in Fig. 6 is displayed when the singing battle begins, and is stopped a predetermined time (e.g., 3 seconds) after the singing battle begins. The screen display on the mobile terminal 3A of the singing user may be the same as that shown in Fig. 6, or may be a screen display such as that shown in Fig. 4 with the other singing users participating in the singing battle displayed in a reduced size (see Fig. 8 described later).

[0069] In order for a singing competition to take place, a singing user (hereinafter referred to as the "first singing user") requests another singing user (hereinafter referred to as the "second singing user") to simultaneously stream a singing video (hereinafter referred to as the "competition request"), and the second singing user must accept the competition request.

[0070] More specifically, the first singing user starts a video posting and viewing application on his / her mobile terminal 3A1 and sends a challenge request to a second singing user who is live streaming a singing video using the video posting and viewing application. The challenge request is sent by the first singing user clicking on the operation icon 58B. The first singing user selects the song to be sung in the singing challenge. The selected song Information indicating the song (hereinafter referred to as the "competition song") (such as the title and singer's name) is sent to the second singing user together with the competition request.

[0071] The match request transmitted from the mobile terminal 3A1 is transmitted to the mobile terminal 3A2 of the second singing user via the server 4. An image corresponding to the received match request is displayed on the screen 3a of the mobile terminal 3A2, and if the second singing user accepts the match request, he or she clicks on a predetermined image displayed on the screen 3a.

[0072] Then, when the second singing user accepts the battle request from the first singing user, the server 4 starts the battle singing by distributing the first singing video 60A by the first singing user and the second singing video 60B by the second singing user so that they are simultaneously displayed on the screen 3a of the mobile terminal 3B. This allows the viewing user to watch the battle singing between the first singing user and the second singing user in real time (real-time battle). In the following description, the first singing video 60A and the second singing video 60B distributed in the battle singing are also collectively referred to as battle singing videos.

[0073] In this way, the singing competition function accepts a singing video competition request from a first singing user to a second singing user, and when the second singing user accepts the competition request, distributes the first singing video 60A and the second singing video 60B so that they are simultaneously displayed on the screen 3a of the mobile terminal 3B. Therefore, the singing competition function enables singing users to compete with each other using their own singing videos, and also enables viewing users to simultaneously view multiple competing singing videos.

[0074] It is also possible that the second singing user accepts the battle request but does not accept the battle song. For such a case, the battle singing function may have a function to transmit information indicating a change in the battle song and the battle song selected by the second singing user from the mobile terminal 3A2 of the second singing user to the mobile terminal 3A1 of the first singing user, and to request approval from the first singing user.

[0075] [1-6-1. Alternating singing in singing competitions] In the singing battle function according to this embodiment, a first singing user and a second singing user alternately sing the same song (hereinafter referred to as "alternate singing").

[0076] Alternate singing may take the form of, for example, a first singing user finishing singing a song, followed by a second singing user singing the same song in its entirety. However, the singing battle function according to this embodiment virtually divides a song into multiple regions as shown in FIG. 7, and sets the order of singing users to sing for each divided region 68 (hereinafter referred to as "alternate performance setting"). As a result, the first singing user and the second singing user alternate singing the same song according to the alternating performance setting, allowing viewing users to clearly recognize the difference in singing ability between the first singing user and the second singing user, and to enjoy the singing battle even more. In the following description, the order of singing users to sing is referred to as the alternating singing order.

[0077] As an example, the competitive singing function highlights the portion of the lyrics that the singing user is to sing, thereby allowing the singing user to recognize the divided area 68 that he or she is to sing. The highlighting is achieved by changing the color or thickness of the lyrics, for example.

[0078] 7, divided areas 608 are set so that the first singing user and the second singing user sing alternately, and divided areas 68 are also set so that the first singing user and the second singing user sing together. The divided areas 68 are set in advance based on, for example, phrases, choruses, or measures of a song, and the time lengths of the divided areas 68 do not necessarily have to be the same.

[0079] The alternating singing order is determined when a singing battle is decided. For example, the order is set so that the first singing user who requested the battle sings first, and the second singing user sings afterwards. Note that the divided area 68 in which the first singing user and the second singing user sing together may be set in advance for each song.

[0080] Furthermore, the alternating singing order set based on the divided areas may change dynamically. For example, singing users with relatively higher total points obtained through a voting function (described later) may sing in more divided areas 68. More specifically, the total points for each singing user (singing video) are compared at each predetermined timing in the song, and the singing user with the relatively higher total point sings the subsequent divided areas 68 in succession. In this case, the maximum number of divided areas 68 that can be sung in succession is predetermined.

[0081] As a result, singing users with a relatively high total score will have more divided areas 68 to sing in, while singing users with a relatively low total score will have fewer divided areas 68 to sing in. Therefore, singing users with a relatively high total score can better showcase their singing ability to viewing users and attract more viewing users.

[0082] [1-6-2. Screen display and audio output during alternating singing] As described above, Fig. 6 shows the display screen of the viewing user's mobile terminal 3B in a singing battle, where the first singing video 60A and the second singing video 60B are both displayed in the same image size. Furthermore, a display (“NOW PLAYING” in Fig. 6) is displayed so that the viewing user can recognize the singing video in progress.

[0083] Here, a singing video and its audio when the singing is not currently being performed are not of interest to the viewing user and may distract the viewing user who is viewing the singing in progress.

[0084] Therefore, the competitive singing function according to this embodiment distributes singing videos to the mobile terminal 3B so that the audio of the singing videos in which singing is being performed is output and the audio of the singing videos in which singing is not being performed is not output. Furthermore, the server 4 distributes singing videos to the mobile terminal 3B so that the singing videos in which singing is being performed are displayed larger on the screen 3a of the mobile terminal 3B than the singing videos in which singing is not being performed. This allows the viewing user to watch the competitive singing videos without being distracted by the singing videos in which singing is not being performed.

[0085] Fig. 8 is an example of a screen display on the mobile terminal 3B during a singing battle. In the example of Fig. 8, the first singing video 60A is currently being sung, and the second singing video 60B is not currently being sung, so the first singing video 60A is displayed enlarged (full screen display), while the second singing video 60B is displayed reduced (window display). The image size and display position on the screen 3a when the singing videos are displayed reduced may be predetermined, or the viewing user may be able to change the image size and screen position to any desired value.

[0086] In addition, the competitive singing function of this embodiment distributes singing videos to the mobile terminal 3B so that the audio of the first singing video 60A and the second singing video 60B is output or the screen of the first singing video 60A and the second singing video 60B is displayed based on the alternating singing order described above.

[0087] That is, in the divided area 68 where the first singing user sings, the audio of the first singing video 60A is output and the first singing video 60A is displayed enlarged, while the audio of the second singing video 60B is not output and the second singing video 60B is displayed reduced. Also, in the divided area 68 where the second singing user sings, the audio of the second singing video 60B is output and the second singing video 60B is displayed enlarged, while the audio of the first singing video 60A is not output and the first singing video 60A is displayed reduced. Also, in the divided area 68 where the first and second singing users sing together, the first singing video 60A and the second singing video 60B are displayed on the screen at the same image size, as shown in FIG. 6, and both are output as audio.

[0088] In this way, the competitive singing function of this embodiment controls the audio output and screen display of the competitive singing video based on the alternating performance settings described above, so that even when singing videos are displayed simultaneously, it is easy to control the output of the competitive singing video on the viewing user's mobile terminal 3B.

[0089] [1-6-3. Voting function] The video posting and viewing application has a voting function that accepts input of evaluations (hereinafter referred to as "votes") for each singing video in the singing competition from the mobile terminal 3B of the viewing user.

[0090] A viewer inputs a vote by clicking an operation icon 58A provided for each singing video as shown in Figures 6 and 8. That is, if a viewing user sympathizes with a singing video, the viewing user clicks operation icon 58A as a sign of their intention to rate the singing video favorably. An image 66 showing the received evaluation results for each singing video (hereinafter referred to as a "voting result image") is then delivered to be displayed on the screen 3a of the mobile terminal 3B together with the singing video.

[0091] In this way, the voting function according to the present embodiment allows the viewing user to rate the singing competition videos by clicking the operation icon 58A, for example, so that when a singing competition takes place, the viewing user can easily determine the merits of the singing. Note that the viewing user can rate one singing video and the other singing video at the same time.

[0092] The voting function accepts input of points as votes and derives the total points input during the distribution of the singing video (hereinafter referred to as "total evaluation score") as the evaluation result. The total evaluation score is the sum of the points input by multiple viewing users. The voting function then determines the winner of the singing competition based on the total evaluation scores input by the time the singing competition ends. In other words, the singing user whose singing video has a relatively high total evaluation score is determined to be the winner. In this way, according to the voting function of this embodiment, multiple viewing users can vote cooperatively for the singing user (singing video) they support, thereby making the singing user they support the winner, allowing the viewing users to empathize more with the singing user.

[0093] In the voting function according to this embodiment, one point is input each time the operation icon 58A is clicked. The numbers (21 and 185) in the voting result image 66 shown in Figures 6 and 8 indicate the total evaluation points for each singing user (singing video), and the bar image extending to the left and right of the screen 3a and hatched in different colors on the left and right indicates the relative total evaluation points for each singing video.

[0094] Furthermore, an upper limit is set on the number of times each viewing user can click operation icon 58A (hereinafter referred to as "upper click limit"), and the upper click limit according to this embodiment is one time. When the upper click limit is reached, operation icon 58D is displayed on screen 3a in place of operation icon 58A, as shown in FIG.

[0095] By clicking the operation icon 58D, the viewing user can superimpose a decorative image (hereinafter referred to as a "tip effect image") on the singing video corresponding to the clicked operation icon 58D. In this way, the voting function has a tip effect function that receives from the mobile terminal 3B a request to superimpose a tip effect image on the singing video and superimposes the received tip effect image on the singing video. In the following description, the instruction (selection) by the viewing user via the mobile terminal 3B to display the tip effect image is referred to as a "tip input" as described above.

[0096] That is, the viewing user decorates the singing video by superimposing the coin tip effect image 69 on the singing video that he or she sympathizes with, so the coin tip effect function can liven up the viewers and the singing video itself while the singing video is being distributed. The coin tip effect function is a function executed by the server 4 in response to a display instruction from the viewing user via the video posting and viewing app.

[0097] FIG. 9 shows the screen display of the mobile terminal 3B to which the viewing user transitions when he or she clicks the operation icon 58D, and displays a plurality of different tip effect images 69 that the viewing user can select. Points are assigned to each tip effect image 69, and the design differs depending on the points. The viewing user selects one of the multiple tip effect images 69 displayed on the screen that can be acquired with the points they possess. Note that a different design means, for example, a different shape, color, or orientation.

[0098] As an example, a charge amount is set for each point, and viewing users purchase points, and the types of tip effect images 69 that can be selected increase or decrease depending on the points they own. When a tip effect image 69 is selected by a viewing user, the points owned by the viewing user decrease according to the points of the selected tip effect image 69. Note that points may be acquired not only by charging, but also by using other online services, etc.

[0099] The coin tip effect image 69 illustrated in Fig. 9 includes four types of spotlight images that mimic spotlights and have different fan-shaped directions, and four types of combined spotlight images that combine multiple spotlight images and have different colors. By using the coin tip effect image 69 as an image that mimics a spotlight, the viewing user can feel as if they are participating in a concert or the like. Note that the coin tip effect image 69 is not limited to the example in Fig. 9, and other images may also be used.

[0100] 10 is an example of a singing video (hereinafter referred to as an "effect-superimposed singing video") in which a combined spotlight image is selected by a viewing user as the coin-throwing effect image 69 and the coin-throwing effect image 69 is superimposed. The effect-superimposed singing video is viewable not only by the viewing user who selected the coin-throwing effect image 69, but also by other viewing users who are watching the singing competition.

[0101] The tip effect function according to this embodiment can be applied to a singing video in which singing is being performed, and after a tip input is made, a tip effect image 69 is superimposed on the singing video with almost no time delay. In other words, in the example of FIG. 10 , the viewing user can superimpose the tip effect image 69 on the first singing video 60A, but cannot superimpose the tip effect image 69 on the second singing video 60B in which the singing user is not singing. More specifically, even if the viewing user clicks on the operation icon 58D corresponding to a singing video in which the singing user is not singing, the tip effect function does not accept the click.

[0102] Furthermore, when the voting function accepts the superimposition of the coin tip effect image 69, it accepts input of a score corresponding to the coin tip effect image 69 as an evaluation. In the present embodiment, as an example, points corresponding to the coin tip effect image are input as evaluation points. That is, each time a coin tip is input, points corresponding to the coin tip effect image 69 selected by the viewing user are added to the above-mentioned three evaluation total points.

[0103] In this way, the voting function according to this embodiment can encourage viewing users to input a donation by accepting input of a score as an evaluation in accordance with the superimposition of the donation effect image 69. There is no upper limit to the number of times each viewing user can input donations. In other words, the viewing user can increase the total evaluation score of a singing video that he or she sympathizes with by repeatedly clicking the operation icon 58D.

[0104] Furthermore, an image (icon image 64) showing a viewing user who has given a relatively higher rating (vote) to the singing video than other viewing users, i.e., a viewing user who has input a large number of points (hereinafter referred to as a "highly rated user"), is displayed on the screen 3a of the mobile terminal 3B. This allows the viewing user to make other viewing users aware of the singing user they are supporting. Furthermore, the viewing user can also make the singing user aware that they are supporting him.

[0105] In the voting function according to this embodiment, the top three people with the most points entered are designated as highly rated users, and icon images 64 of the highly rated users are displayed on the screen 3a for each singing video, but the number of highly rated users whose icon images 64 are displayed is not limited to this.

[0106] Furthermore, in the voting function according to this embodiment, points are input as an evaluation when the operation icon 58A is clicked and when a coin is input, but this is not limited to this. For example, points may be input as an evaluation when a coin is input, or points may be input as an evaluation when the operation icon 58A is clicked.

[0107] [1-6-4. Other functions] The server 4 may store information for each singing user (hereinafter referred to as "singing user information") in the HDD 26. The singing user information includes the number of fans the singing user has, the singing user's past match results and win rate, and favorite songs. The singing battle function may also accept a battle request from a first singing user with a similar number of fans to a second singing user. The number of fans a singing user has is thought to differ depending on the singing user's singing ability. In this way, by setting the similar number of fans as a condition for accepting a singing battle, it is possible to prevent singing battles between singing users with significantly different singing abilities.

[0108] More specifically, when a first singing user requests a match with a second singing user, the match-singing function compares the number of fans of the first singing user with the number of fans of the second singing user, and if the difference in the number of fans is within a predetermined reference value (for example, within ±20%), accepts the match request from the first singing user to the second singing user. The number of fans increases when a viewing user registers that they are a fan of the singing user via the video posting / viewing app. There is no limit to the number of singing users that a viewing user can register as a fan.

[0109] The singing battle function may accept a battle request even if the number of fans is similar as long as other conditions are met, or may accept a battle request even if the number of fans is not similar as long as the second singing user agrees. On the other hand, the singing battle function may only accept battle requests from users with similar numbers of fans. Here, "only" means, for example, that a battle request from users with an insufficient number of fans will not be accepted even if other conditions are met.

[0110] Furthermore, the singing battle function may provide a singing user who wins a singing battle with compensation according to the total evaluation points that the singing user has earned through votes for that user. The compensation here may be money, points that can be used in a video posting / viewing app (video posting site) or other online services, etc. Furthermore, a singing user who wins a singing battle may receive compensation according to the total points that are the sum of not only his or her own total evaluation points but also the total evaluation points of his or her opponents (so-called take-all).

[0111] [1-7. Functional block of competitive singing function] 11 is a functional block diagram of the singing battle function according to this embodiment. The CPU 20 of the server 4 includes a battle request receiving unit 70, a battle acceptance determination unit 71, a battle setting unit 72, a video evaluation unit 73, a coin tip effect superimposition unit 74, and a video distribution unit 75. The processes executed by each function of the server 4 are realized by a program stored in the HDD 26.

[0112] The match request receiving unit 70 receives a match request from a first singing user to a second singing user. Note that the match request receiving unit 70 may also receive a match request from a first singing user to a second singing user who has approximately the same number of fans.

[0113] The competition acceptance determination unit 71 determines whether or not the second singing user has accepted the competition request from the first singing user.

[0114] The battle setting unit 72 performs various settings such as setting the song and the singing order for the singing battle. The battle setting unit 72 divides the song into multiple regions in chronological order and sets the order of singing users who will sing in each region (alternate singing order). The battle setting unit 72 may also dynamically change the alternating singing order set based on the divided regions 68.

[0115] The video evaluation unit 73 receives, from the mobile terminal 3B, an input of an evaluation (score) for each singing video being distributed to the mobile terminal 3B, and an input of superimposing a tip effect image 69 on the singing video (tipping input). Then, the video evaluation unit 73 derives the total evaluation score input during distribution of the singing video, and determines the winner of the singing competition.

[0116] When a coin tip input is received, the coin tip effect superimposing unit 74 superimposes a coin tip effect image 69 corresponding to the received coin tip input on the singing video.

[0117] The video distribution unit 75 distributes the singing video to the mobile terminal 3B. Furthermore, when the second singing user accepts the battle request from the first singing user, the video distribution unit 75 distributes the first singing video 60A by the first singing user and the second singing video 60B by the second singing user so that they are simultaneously displayed on the screen 3a of the mobile terminal 3B. Furthermore, the video distribution unit 75 distributes the battle singing videos to the mobile terminal 3B so that the sound of the singing video in which singing is being performed is output, the sound of the singing video in which singing is not being performed is not output, and the singing video in which singing is being performed is displayed larger on the screen 3a than the singing video in which singing is not being performed.

[0118] [1-8. Flowchart of singing competition processing] 12 is a flowchart showing the flow of the singing battle process according to this embodiment, which is executed by the CPU 20 of the server 4. A program for executing the singing battle process according to this embodiment is stored in advance in a predetermined area of ​​the HDD 26.

[0119] First, in step S100, the match request receiving unit 70 determines whether or not a match request has been made by the first singing user to the second singing user, and if the determination is affirmative, i.e., if a match request from the first singing user has been received, the process proceeds to step S102. On the other hand, if the determination is negative, the process enters a waiting state until a match request is received.

[0120] In step S102, the competition acceptance determination unit 71 determines whether the second singing user has accepted the competition request, and if the determination is affirmative, the process proceeds to step S104, and if the determination is negative, the process returns to step S100.

[0121] In step S104, the battle setting section 72 performs various settings for the singing battle.

[0122] In the next step S106, the video distribution unit 75 starts distribution of the competition singing video.

[0123] In the next step S108, the video distribution unit 75 determines whether the song for the singing competition has ended, and if the determination is affirmative, the process proceeds to step S110. On the other hand, if the determination is negative, the video distribution unit 75 continues to distribute the singing competition video until the song has ended.

[0124] In the next step S110, the video distribution unit 75 ends the distribution of the competitive singing video, and the process returns to step S100.

[0125] As described above, the server 4 (competitive singing function) according to this embodiment accepts a singing video competition request from a first singing user to a second singing user, and when the second singing user accepts the competition request, distributes the first singing video 60A and the second singing video 60B so that they are simultaneously displayed on the screen 3a of the mobile terminal 3B. Therefore, the server 4 (competitive singing function) according to this embodiment enables singing users to compete with each other using their own singing videos, and also enables viewing users to simultaneously view the competing singing videos.

[0126] [1-9. Voting process flowchart] 13 is a flowchart showing the flow of the voting process according to this embodiment, which is executed by the CPU 20 provided in the server 4. A program for executing the voting process according to this embodiment is stored in a predetermined area of ​​the HDD 26 in advance.

[0127] First, in step S200, the moving image evaluation unit 73 determines whether or not the singing competition has started, and if the determination is affirmative, the process proceeds to step S202. On the other hand, if the determination is negative, the process waits until the singing competition starts.

[0128] In step S202, the moving image evaluation unit 73 determines whether or not the operation icon 58A has been clicked by the viewing user, and if the determination is affirmative, the process proceeds to step S204, and if the determination is negative, the process proceeds to step S206.

[0129] In step S204, the video evaluation unit 73 derives the total evaluation score, and the video distribution unit 75 updates the display of the total evaluation score.

[0130] In step S206, the moving image evaluation unit 73 determines whether or not the operation icon 58D has been clicked by the viewing user, and if the determination is affirmative, the process proceeds to step S208, and if the determination is negative, the process proceeds to step S210.

[0131] In step S208, the coin tip effect superimposition unit 74 superimposes the coin tip effect image 69 selected by the viewing user on the target singing video, the video evaluation unit 73 derives a total evaluation score by adding points according to the superimposed coin tip effect image 69, and the video distribution unit 75 updates the display of the total evaluation score.

[0132] In the next step S210, the video evaluation unit 73 determines whether there has been a change in the users who have given the singing video a high rating, and if the determination is affirmative, the process proceeds to step S212, and if the determination is negative, the process proceeds to step S214.

[0133] In step S212, the video distribution unit 75 updates the display of the icon image 64 of the highly rated user.

[0134] In step S214, the video distribution unit 75 determines whether the song for the singing competition has ended, and if the determination is affirmative, the process proceeds to step S216, and if the determination is negative, the process returns to step S202.

[0135] In step S216, the video evaluation unit 73 determines the winner based on the total evaluation score of each singing video, and the video distribution unit 75 distributes an image showing the result.

[0136] In the next step S218, the video distribution unit 75 ends the distribution of the competition singing video, and ends this voting process.

[0137] As described above, the server 4 (voting function) according to this embodiment receives, from the mobile terminal 3 B, an evaluation of each singing video distributed to the mobile terminal 3 B. Therefore, the server 4 (voting function) according to this embodiment allows the viewing users to easily determine the merits and demerits of the performance videos distributed by each of the multiple singing users.

[0138] [2. Second Embodiment] A second embodiment of the present invention will now be described.

[0139] The configurations of the karaoke system 1, server 4, and mobile terminal 3 according to this embodiment are the same as those of the karaoke system 1, server 4, and mobile terminal 3 according to the first embodiment, and therefore description thereof will be omitted.

[0140] [2-1. Overview of the Battle Dance Feature] In the performance video according to this embodiment, the performers are dancers, the performance video is a dance video, and the dance video is uploaded to a video posting site (server 4). That is, the battle function according to this embodiment is a battle dance function that simultaneously displays multiple dance videos (first dance video 60C, second dance video 60D) by different dance users on the screen 3a of the viewing user's mobile terminal 3B, as shown in FIG.

[0141] A dance match occurs when a first dance user makes a request (a match request) to another dance user (hereinafter referred to as a "second dance user") to simultaneously distribute dance videos, and the second dance user accepts the request. As an example, when the first dance user requests a dance match to the second dance user, the first dance user indicates that this request is a dance match. This allows the second dance user and the server 4 to recognize that this request is a dance match. In the following description, the first dance video 60C and the second dance video 60D distributed in a dance match are collectively referred to as dance match videos.

[0142] As in the first embodiment, the dance battle function according to this embodiment sets the order of dance users who will dance for each divided area 68 (see FIG. 7) that is obtained by virtually dividing a song into multiple areas in chronological order (hereinafter referred to as "alternate dance setting"). In the alternate dance setting, a divided area 68 may be set in which a first dance user and a second dance user will dance together.

[0143] [2-1-1. Featured video enlargement function] The dance competition function according to this embodiment has an enlargement function that determines the dance video with the largest subject movement among multiple dance videos simultaneously displayed on the screen 3a of the mobile terminal 3B as the featured video (featured video determination function), and delivers the dance video to the mobile terminal 3B so that the featured video is displayed larger than the other dance videos. Note that the subject here refers to a human dancer.

[0144] 15, first dance video 60C is the featured video and second dance video 60D is not, so first dance video 60C is displayed in an enlarged size (full screen display) while second dance video 60D is displayed in a reduced size (window display). Note that the image size and display position on screen 3a when the dance video is displayed in a reduced size may be determined in advance, or the viewing user may be able to change the image size and screen position to any desired value.

[0145] In this way, the enlarged display function determines the featured video to be displayed larger than other dance videos based on the movement of the subject, so that the display mode of the competitive dance video on the screen 3a of the mobile terminal 3B can be changed without using the sound of the dance video being distributed.

[0146] Furthermore, when the first dance user and the second dance user dance together, the dance video with the larger movements is enlarged and displayed on the viewing user's mobile terminal 3B, so the competing dance users will perform a more dynamic dance, which will result in the viewing users getting more excited.

[0147] Furthermore, the enlarged display function delivers the dance competition video to mobile terminal 3B so that the sound of the featured video is output and the sound of other dance videos is not output. As a result, the sounds (voices, breathing, etc.) emitted by the dancers in the featured video are output from mobile terminal 3B, while the sounds emitted by dancers not in the featured video are not output from mobile terminal 3B. This allows the viewing user to watch the dance competition video without being distracted by the sounds from dance videos that are not the featured video.

[0148] When the enlarged display function of this embodiment is executed, audio output and screen display based on the alternating performance setting described in the first embodiment are not performed, but this is not limited to this, and the enlarged display function of this embodiment may be executed when the first dance user and the second dance user dance together, even if audio output and screen display based on the alternating performance setting are performed.

[0149] [2-1-2. Featured video identification function] The featured video determination function extracts images (hereinafter referred to as "dancer images") showing the subject dancer (person) from a dance video at predetermined time intervals, and determines the dance video with the greatest difference between the extracted dancers among multiple dance videos as the featured video. The image extraction interval (hereinafter referred to as "image extraction interval") is, for example, 0.5 seconds, and may be specified by the number of frames rather than time.

[0150] More specifically, the featured video determination function extracts dancer images at predetermined intervals (0.5 seconds) from the start of the dance video and derives the differences between the dancer images before and after the image extraction interval. The featured video determination function then compares the differences between the dance videos at the same timing derived for first dance video 60C and second dance video 60D, and selects the dance video with the greatest difference between first dance video 60C and second dance video 60D as the featured video. Note that extraction of people from dance videos may be performed using, for example, a known image analysis method.

[0151] In this way, the featured video determination function directly determines the size of the dancer's movements from the dancer image contained in the dance video, so it can accurately determine dance videos in which the subject dancer's movements are relatively large. Note that the dance video according to this embodiment is a video in which the dancer's entire body is photographed and the dancer is photographed at a size that allows for image analysis in order to analyze the dancer image.

[0152] Furthermore, the featured video determination function according to this embodiment determines differences in the movements of the dancers who are the subjects based on the movements of the dancers' hands and feet.

[0153] FIG. 16 shows an example of dancer images extracted from a dance video at image extraction intervals. (A) and (B) are dancer images extracted at image extraction intervals from first dance video 60C, and Figures 16(C) and (D) are dancer images extracted at image extraction intervals from second dance video 60D. That is, in the example of Figure 16, the dancer image of first dance video 60C shown in Figure 16(A) changes to that shown in Figure 16(B) after a predetermined time, and the dancer image of second dance video 60D shown in Figure 16(C) changes to that shown in Figure 16(D) after a predetermined time.

[0154] In the example of Figure 16, as shown by the dashed line area, the first dance video 60C shows large movements of the left hand and right foot, while the second dance video 60D shows only slight movements of the left and right feet, resulting in a greater difference between the dancer images in first dance video 60C. For this reason, first dance video 60C is designated as the featured image. Note that, as an example, the movement of the limbs refers to the movement of the tip positions of the limbs, and the movement of the tip positions of the limbs is derived from changes in the coordinates indicating the tip positions.

[0155] In this way, the featured video determination function determines differences in the movements of the subject dancer based on the movements of the dancer's arms and legs, making it possible to more accurately determine the dancer's movements.

[0156] In this case, there may be a moment when the dancer is not moving. In such a case, if a dancer (subject) in another dance video that is not the featured video moves, the other dance video may be determined to be the featured video, and as a result, the video in which the dancer is not dancing may be enlarged and displayed on mobile terminal 3B.

[0157] Therefore, the zoom function may switch the other dance video as the featured video if the movements of the dancer in the featured video become smaller than the movements of the dancer in the other dance video for a predetermined time (for example, one second) or more. In other words, even if the movements of the dancer in the featured video become smaller than the movements of the dancer in the other dance video, the other dance video will not be switched as the featured video if this time is less than the predetermined time.

[0158] This prevents other dance videos in which the dancer in the featured video is not dancing from becoming the featured video even if the dancer in the featured video temporarily stops moving.

[0159] [2-2. Functional block of the competitive dance function] 17 is a functional block diagram of the dance-matching function according to this embodiment. The CPU 20 of the server 4 includes a match request receiving unit 70, a match acceptance determination unit 71, a match setting unit 72, a video evaluation unit 73, a coin tip effect superimposition unit 74, and a video distribution unit 75, as well as a featured video determination unit 80. The processing executed by each function of the server 4 is realized by a program stored in the HDD 26. Note that the match request receiving unit 70, match acceptance determination unit 71, match setting unit 72, video evaluation unit 73, coin tip effect superimposition unit 74, and video distribution unit 75 according to this embodiment are the same as those according to the first embodiment, although the video to be processed is a dance video, and therefore a description thereof will be omitted.

[0160] The featured video determination unit 80 executes the featured video determination function described above, and determines that the dance video in which the subject (dancer) moves the most vigorously among a plurality of dance videos is the featured video.

[0161] Note that video distribution section 75 according to this embodiment distributes the competition dance video to mobile terminal 3B so that the sound of the featured video is output and the sounds of other dance videos that are not the featured video are not output.

[0162] [2-3. Flowchart of featured video enlargement process] 18 is a flowchart showing the flow of the attention video 9 enlargement process according to this embodiment, which is executed by the CPU 20 of the server 4. A program for executing the attention video enlargement process according to this embodiment is stored in advance in a predetermined area of ​​the HDD 26.

[0163] First, in step S300, the featured moving image determination unit 80 determines whether the music for the dance competition has started, and if the determination is affirmative, the process proceeds to step S302. On the other hand, if the determination is negative, the process waits until the music for the dance competition starts.

[0164] In the next step S302, immediately after the start of the dance competition music or after a predetermined time has elapsed (for example, one second), the featured video determination unit 80 extracts dancer images from the first dance video 60C and the second dance video 60D.

[0165] In the next step S304, featured moving image determination unit 80 determines whether the image extraction interval has elapsed since the previous time the dancer image was extracted, and if the determination is affirmative, proceeds to step S306. On the other hand, if the determination is negative, the process waits until the image extraction interval has elapsed.

[0166] In step S306, the featured video determination unit 80 extracts dancer images from each of the first dance video 60C and the second dance video 60D.

[0167] In the next step S308, the featured moving image determination unit 80 derives the difference between the previously extracted dancer image and the currently extracted dancer image for each dance moving image.

[0168] In the next step S310, the featured moving image determination unit 80 compares the differences in the dancer images for each dance moving image to determine the featured moving image.

[0169] In the next step S312, video distribution unit 75 distributes the competition dance video to mobile terminal 3B so that the featured video is displayed larger (enlarged) than the other dance videos. Note that if the dance video determined to be the featured video in step S310 is changed, the enlarged dance video will also be changed.

[0170] In the next step S314, the featured video determination unit 80 determines whether the image extraction interval has elapsed since the last time the dancer image was extracted, and if the determination is positive, the process returns to step S306, and if the determination is negative, the process proceeds to step S316.

[0171] In step S316, the video distribution unit 75 determines whether the music for the dance competition has ended, and if the determination is affirmative, the process proceeds to step S318, and if the determination is negative, the process returns to step S314.

[0172] In the next step S318, the video distribution unit 75 ends the distribution of the competition dance video, and ends this featured video enlarging process.

[0173] As explained above, the server 4 (dance battle function) according to this embodiment performs a featured video determination process to determine that the dance video with the largest dancer movements is the featured video among multiple dance videos simultaneously displayed on the screen 3a of the mobile terminal 3B, and distributes the featured video to the mobile terminal 3B so that it is displayed larger than the other dance videos. Therefore, the server 4 (dance battle function) according to this embodiment can change the display mode of the dance battle video on the screen 3a of the mobile terminal 3B without using the sound of the distributed dance video.

[0174] 3. Other Embodiments Although the present invention has been described above using the above-mentioned embodiments, the technical scope of the present invention is not limited to the scope described in the above-mentioned embodiments. Various modifications and improvements can be made to the above-mentioned embodiments without departing from the gist of the invention, and such modifications and improvements are also included in the technical scope of the present invention. Furthermore, the above-mentioned embodiments may be combined as appropriate.

[0175] For example, in the above embodiment, a singing or dancing competition is described in which two performers (singing users or dancing users) compete in a singing or dancing competition, but the present invention is not limited to this. For example, a singing or dancing competition may be performed by three or more performers. In this case, a performer may simultaneously request a competition from two or more other performers, or a performer who has received a competition request may further request a competition from other performers.

[0176] In the above embodiment, the voting result image 66 is described as displaying the total evaluation score for each video as a bar image, but the present invention is not limited to this. For example, instead of a bar image, the total evaluation score for each video may be displayed relatively as a pie chart.

[0177] In the above embodiment, the outcome of a singing or dancing competition is determined by votes from viewing users, but the present invention is not limited to this. For example, the singing or dancing competition may have an automatic scoring function, and the outcome may be determined by the results of the automatic scoring function.

[0178] In the first embodiment, the audio output and screen display of the first singing video 60A and the second singing video 60B are performed based on the alternating performance setting. However, the present invention is not limited to this. For example, the server 4 may perform image analysis (face recognition processing) on ​​the singing videos transmitted from the mobile terminal 3A to determine which singing video has a larger mouth opening, and based on this determination result, the audio output and screen display of the first singing video 60A and the second singing video 60B may be performed. In other words, the singing video with a relatively larger mouth opening is determined to be the singing video in which the singing user is currently singing.

[0179] In the above embodiment, a real-time competition has been described as a singing or dancing competition, but the present invention is not limited to this. For example, a performer may request a competition with a video of another performer that has already been recorded, allowing a competition between a live video and a recorded video, or a competition between recorded videos.

[0180] Furthermore, the flow of each process described in the above embodiment is also an example, and unnecessary steps may be deleted, new steps may be added, or the order of processes may be changed within the scope of the present invention. [Explanation of symbols]

[0181] 3B Mobile terminal (terminal device) 3a screen 4 Server (information processing device) 60C 1st Dance Video (Featured Video) 60D 2nd Dance Video (Other Videos) 72 Battle setting unit (setting means) 75 Video Distribution Department (Distribution Method) 80 Attention video determination unit (determination means)

Claims

1. A user terminal, a display area for displaying the performance of a first performer and the performance of a second performer in a comparative manner; a first button for cheering on the first performer; a second button for cheering on the second performer; an image showing a comparison of cheers for the performances of the first performer and the second performer, the image changing in response to selection of the first button and the second button; Display the first screen including When a predetermined condition is satisfied, in response to selection of a third button displayed on the user terminal, a second screen is displayed on the user terminal, allowing the viewing user to consume points owned by the viewing user to select a performance image for cheering on at least one of the first performer and the second performer. Information processing device.

2. The processor: a display area for displaying the performance of a first performer and the performance of a second performer in a comparative manner; a first button for cheering on the first performer; a second button for cheering on the second performer; an image showing a comparison of cheers for the performances of the first performer and the second performer, the image changing in response to selection of the first button and the second button; displaying a first screen including the following on the user terminal; a processor, in response to selection of a third button displayed on the user terminal when a predetermined condition is satisfied, causes the user terminal to display a second screen on which the viewing user can consume points owned by the viewing user to select a performance image for cheering on at least one of the first performer and the second performer; Information processing methods.

3. Based on data delivered from a server, a display area for displaying the performance of a first performer and the performance of a second performer in a comparative manner; a first button for cheering on the first performer; a second button for cheering on the second performer; an image showing a comparison of cheers for the performances of the first performer and the second performer, the image changing in response to selection of the first button and the second button; Display the first screen including displaying, in response to a selection of a third button displayed on the display when a predetermined condition is satisfied, a second screen on the display in which the viewing user can consume points owned by the viewing user to select a performance image for cheering on at least one of the first performer and the second performer; A program that causes a processor to execute a process.

4. A server and a user terminal are provided, The server a display area for displaying the performance of a first performer and the performance of a second performer in a comparative manner; a first button for cheering on the first performer; a second button for cheering on the second performer; an image showing a comparison of cheers for the performances of the first performer and the second performer, the image changing in response to selection of the first button and the second button; displaying a first screen including the following on the user terminal; When a predetermined condition is satisfied, in response to selection of a third button displayed on the user terminal, a second screen is displayed on the user terminal, allowing the viewing user to consume points owned by the viewing user to select a performance image for cheering on at least one of the first performer and the second performer. system.

Images