Information processing device, video distribution method, and video distribution program

Abstract

The objective is to provide an information processing device, a video distribution method, and a video distribution program that change the display mode of a video on a mobile device without using the sound of the video. [Solution] The server performs a focus video determination process to identify the dance video with the most dynamic dancer movements among multiple dance videos displayed simultaneously on the mobile device screen, and delivers the focus video to the mobile device so that it is displayed larger than the other dance videos. The focus video determination process extracts images representing the dancer from the video at predetermined time intervals, and determines that the video with the greatest difference in the extracted subjects among multiple videos is the focus video.

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, a video distribution method, and a video distribution program.

Background Art

[0002] In recent years, online services such as websites (web pages, web services), online games, and application software (hereinafter referred to as "apps") distributed to information processing apparatuses such as mobile terminals via computer networks have become widely popular.

[0003] One of the online services is a video posting site that enables users to post videos they have taken themselves and allows other users to view those videos. On this video posting site, users also post performance videos such as singing videos. In addition, online services such as battles between performance videos by different posters are also envisioned.

[0004] Here, Patent Document 1 discloses a karaoke device that, when displaying each karaoke singing video that constitutes a collaborative karaoke singing video, determines whether the volume of the singing voice of each karaoke singing video is equal to or greater than a predetermined reference value, and displays the karaoke singing videos whose determined singing voice volume is equal to or greater than the predetermined reference value in an identifiable manner. As a result, this karaoke device will display the karaoke singing videos of users singing at a volume equal to or greater than the reference value prominently, and display the karaoke singing videos of users not singing and the karaoke singing videos small.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] However, the karaoke device disclosed in Patent Document 1 identifies karaoke singing videos based on the volume of the singing voice, and therefore cannot handle performance videos such as dance, where the user may not make any sound.

[0007] The present invention has been made in view of these circumstances, and aims to provide an information processing device, a video distribution method, and a video distribution program that can change the display mode of multiple videos without using the sound of the video. [Means for solving the problem]

[0008] To solve the above problems, the information processing device, video distribution method, and video distribution program of the present invention employ the following means.

[0009] To solve the above problems, an "information processing device" according to one aspect of the present invention is an information processing device that distributes videos posted by a user to a terminal device, comprising: distribution means for distributing a plurality of the videos so that they are displayed simultaneously on the screen of the terminal device; and determination means for determining that the video in which the subject movement is greatest is a video of interest, wherein the distribution means distributes the videos to the terminal device so that the video of interest is displayed larger than the other videos.

[0010] To solve the above problems, one aspect of the present invention, a "video distribution method," is a video distribution method for distributing videos posted by a user to a terminal device, comprising: a first step of distributing a plurality of the videos so that they are displayed simultaneously on the screen of the terminal device; and a second step of determining that the video with the greatest movement of the subject among the plurality of videos is a featured video, wherein the second step distributes the videos to the terminal device so that the featured video is displayed larger than the other videos.

[0011] To solve the above problems, in one aspect of the present invention, a "video distribution program" provides a computer in an information processing device that distributes user-submitted videos to a terminal device, which functions as a distribution means for distributing multiple videos so that they are displayed simultaneously on the screen of the terminal device, and a determination means for determining that the video with the greatest movement of the subject among the multiple videos is a video of interest, and the distribution means distributes the videos to the terminal device so that the video of interest is displayed larger than the other videos.

[0012] Various technical limitations may be added to the "information processing device" described above, as illustrated below. Furthermore, technical limitations of a similar nature may be added to the processing steps executed by the "video distribution method" and the functions of the "video distribution program."

[0013] The determination means extracts images showing the subject from the video at predetermined time intervals and determines that the video with the greatest difference in the extracted subjects among the multiple videos is the video of interest.

[0014] The subject is a person, and the determination means determines the difference of the subject based on the movement of the subject's limbs.

[0015] The distribution means distributes the video to the terminal device such that the sound of the featured video is output, but the sound of other videos is not output.

[0016] The determination means determines that the other video is the video of interest if the movement of the subject in the video of interest becomes smaller than the movement of the subject in the other video for a predetermined period of time or longer. [Effects of the Invention]

[0017] According to the present invention, the display mode of multiple videos can be changed without using the sound of the videos. [Brief explanation of the drawing]

[0018] [Figure 1]It is a configuration diagram of a karaoke system according to the first embodiment of the present invention. [Figure 2] It is a block diagram showing the electrical configuration of a server according to the first embodiment of the present invention. [Figure 3] It is a block diagram showing the electrical configuration of a mobile terminal according to the first embodiment of the present invention. [Figure 4] It is a diagram showing the screen display of a mobile terminal when shooting a singing video according to the first embodiment of the present invention. [Figure 5] It is a diagram showing the screen display of a mobile terminal when viewing a singing video according to the first embodiment of the present invention. [Figure 6] It is a diagram showing the screen display of a mobile terminal of a viewing user in competitive singing according to the first embodiment of the present invention. [Figure 7] It is a schematic diagram showing the divided areas of a music piece used in competitive singing according to the first embodiment of the present invention. [Figure 8] It is a diagram showing another example of the screen display of a mobile terminal of a viewing user in competitive singing according to the first embodiment of the present invention. [Figure 9] It is a diagram showing the screen display when selecting a coin - effect image according to the first embodiment of the present invention. [Figure 10] It is a diagram showing a singing video with a coin - effect image superimposed according to the first embodiment of the present invention. [Figure 11] It is a functional block diagram regarding the competitive - singing function according to the first embodiment of the present invention. [Figure 12] It is a flowchart showing the flow of competitive - singing processing according to the first embodiment of the present invention. [Figure 13] It is a flowchart showing the flow of voting processing according to the first embodiment of the present invention. [Figure 14] It is a diagram showing the screen display of a mobile terminal of a viewing user in competitive dance according to the second embodiment of the present invention. [Figure 15] It is a diagram showing an enlarged display of a highlighted video in competitive dance according to the second embodiment of the present invention. [Figure 16]This is a schematic diagram necessary for explaining the video detection process according to the second embodiment of the present invention. [Figure 17] This is a functional block diagram relating to the competitive dance function according to the second embodiment of the present invention. [Figure 18] This is a flowchart showing the flow of the video enlargement process according to the second embodiment of the present invention. [Modes for carrying out the invention]

[0019] Below, an embodiment of the information processing device, video distribution method, and video distribution program according to the present invention will be described with reference to the drawings.

[0020] [1. First Embodiment] The first embodiment of the present invention will be described below. In this embodiment, a performer records their performance as a video using a mobile device and sends it to a server, thereby uploading it to a video sharing site. The video uploaded to the video sharing site (posted video) can be viewed via a mobile device. In this embodiment, the performance is referred to as singing, the performer as the singing user, and the video uploaded to the video sharing site as the singing video. Furthermore, a user who views the singing video uploaded to the video sharing site is referred to as the viewing user.

[0021] [1-1. Karaoke System Configuration] Figure 1 is a schematic diagram of the karaoke system 1 according to this embodiment. The karaoke system 1 consists of a communication line 2, a plurality of mobile terminals 3 (mobile terminals 3A1, 3A2, 3B), and a server 4.

[0022] Communication line 2 forms a computer network and is, for example, a wide-area communication line provided by an electric power company.

[0023] The mobile terminal 3 is, for example, an information processing terminal such as a smartphone, tablet, or laptop computer, and is used by users to access online services. The mobile terminal 3 includes a touch panel display 3a for displaying images, a speaker 3b for outputting sound, a microphone 3c for receiving sound input, a camera 3d for photographing subjects, and an earphone jack 3e for connecting earphones (not shown). Here, "photography" refers to the state in which the camera 3d is functioning and the subject is displayed on the touch panel display 3a, regardless of whether recording is being made or not. The touch panel display 3a includes, for example, an LCD (Liquid Crystal Display) and a touch sensor. The LCD displays various images, and the touch sensor accepts various input operations performed using an object such as a finger, stylus, or pen. In the following description, the touch panel display 3a will also be referred to as screen 3a.

[0024] Server 4 is an information processing device that provides online services to mobile terminal 3 via communication line 2. In the example shown in Figure 1, the singing user uploads their singing video (singing video data) to the video sharing site by sending it from mobile terminal 3A to Server 4. The viewing user then accesses the video sharing site using mobile terminal 3B and watches the singing video. The singing user can also view the singing video they uploaded by accessing the video sharing site using mobile terminal 3A. Furthermore, the user of mobile terminal 3B can also become the singing user and upload a singing video to the video sharing site.

[0025] [1-2. Server Configuration] Figure 2 is a block diagram showing the electrical configuration of server 4 according to this embodiment.

[0026] The server 4 according to this embodiment includes a CPU (Central Processing Unit) 20, which is the main control unit that manages the operation of the entire server 4, and a ROM in which various programs and various data are pre-stored. It includes Read Only Memory (Read Only Memory) 22, Random Access Memory (RAM) 24 used as a work area when various programs are executed by the CPU 20, and a Hard Disk Drive (HDD) 26 as a storage means for storing various programs and data.

[0027] The HDD26 stores singing video data transmitted from the mobile terminal 3A, i.e., singing video data uploaded to video sharing sites, as well as song data indicating songs that the singing user can sing. The storage means is not limited to the HDD26; other storage media such as semiconductor memory like flash memory may also be used.

[0028] Furthermore, the server 4 includes an input unit 28 consisting of a keyboard and mouse, etc., which accepts input for various operations; a monitor 30 such as a liquid crystal display device that displays various images; and an external interface 32 that is connected to other information processing devices such as a mobile terminal 3 via a communication line 2 and transmits and receives various data with other information processing devices.

[0029] The CPU 20, ROM 22, RAM 24, HDD 26, operation input unit 28, monitor 30, and external interface 32 are electrically connected to each other via the system bus 34. Therefore, the CPU 20 can access the ROM 22, RAM 24, and HDD 26, understand the operation status of the operation input unit 28, display images on the monitor 30, and send and receive various types of data with other information processing devices via the external interface 32.

[0030] [1-3. Electrical Configuration of Mobile Devices] Figure 3 is a functional block diagram showing the electrical configuration of the mobile terminal 3.

[0031] In addition to the configuration shown in Figure 1, the mobile terminal 3 includes a main control unit 40, a main memory unit 42, an auxiliary memory unit 44, a communication unit 46, and operation buttons 48.

[0032] The main control unit 40 is, for example, a CPU, microprocessor, or DSP (Digital Signal Processor), and controls the overall operation of the mobile terminal 3.

[0033] The main memory unit 42 is composed of, for example, RAM or DRAM (Dynamic Random Access Memory), and is used as a work area when the main control unit 40 executes processing based on various programs.

[0034] The auxiliary storage unit 44 is a non-volatile memory such as flash memory, and stores various data such as images and programs used for processing by the main control unit 40. The programs stored in the auxiliary storage unit 44 include, for example, the OS (Operating System) for realizing the basic functions of the mobile terminal 3, drivers for controlling various hardware, programs for email and web browsing, and other various functions. The auxiliary storage unit 44 also stores applications for shooting and posting singing videos and viewing video sharing sites. (Hereinafter referred to as the "video posting and viewing app") is pre-programmed.

[0035] The communication unit 46 is, for example, a NIC (Network Interface Controller) and has the function of connecting to the communication line 2. Alternatively, the communication unit 46 may have functions to connect to a wireless LAN (Local Area Network), a wireless WAN (Wide Area Network), short-range wireless communication such as Bluetooth®, and infrared communication, either in place of or together with the NIC.

[0036] The operation buttons 48 are located on the side of the mobile terminal 3 and include a power button for starting or stopping the mobile terminal 3, and a volume control button for the sound output by the speaker 3b.

[0037] The main control unit 40, main memory unit 42, auxiliary memory unit 44, communication unit 46, operation buttons 48, touch panel display 3a, speaker 3b, microphone 3c, camera 3d, and earphone terminal 3e are electrically connected to each other via a system bus 49. Therefore, the main control unit 40 can access the main memory unit 42 and auxiliary memory unit 44, display images on the touch panel display 3a, understand the user's operation status on the touch panel display 3a and operation buttons 48, input sound to the microphone 3c, output sound from the speaker 3b or earphones connected to the earphone terminal 3e, control the camera 3d, and access various communication networks and other information processing devices via the communication unit 46.

[0038] [1-4. Filming of singing videos by singing users] This section explains how a singing user can record a singing video using a mobile device 3A.

[0039] When a singing user records a singing video, they launch a video posting and viewing app on their mobile device 3A. When the video posting and viewing app is launched, the mobile device 3A accesses server 4, which stores multiple song data files. The singing user then selects a song to sing from the video posting and viewing app and downloads the song data from server 4 to the mobile device 3A. The singing user then uses the video posting and viewing app to play the song at any time and sing. The video posting and viewing app starts playing the song and simultaneously starts recording the video using camera 3d. In other words, the singing video is a video recorded by the mobile device 3A while the song is playing from the mobile device 3A.

[0040] Furthermore, the song data is associated with the lyrics data, and when the song data is downloaded from server 4 to mobile device 3A, the associated lyrics data is also downloaded to mobile device 3A. In the following explanation, it will be assumed that the song data includes the lyrics data.

[0041] Figure 4 shows an example of the display state on screen 3a of the mobile device 3A when recording a singing video (hereinafter referred to as "screen display").

[0042] As shown in Figure 4, screen 3a is divided into a lyrics display area 50A and a captured image display area 50B. The lyrics display area 50A includes a lyrics image 52 showing the lyrics of the song the user is singing, a pitch image 54 showing the pitch of the song, and a progress bar 56 showing the progress of the capture.

[0043] The lyrics image 52 and the pitch image 54 are updated according to the progress of the song. In this embodiment, as an example, the lyrics image 52 and the pitch image 54 are updated every few phrases and displayed in the lyrics display area 50A. The update timing of the lyrics image 52 and the pitch image 54 may be the same or different.

[0044] As an example, lyric image 52 displays lyrics in multiple lines (two lines in the example in Figure 4), and the color of the lyrics in the upper line changes from left to right in accordance with the progress of the song, so that the singing user can keep track of the lyrics they should be singing at any given time. When the color change of the lyrics in the upper line reaches the right edge, the lyrics in the lower line rise and are displayed in the upper line, and new lyrics are displayed in the lower line, and the color of the lyrics in the upper line changes again from left to right in accordance with the progress of the song.

[0045] In the pitch image 54, for example, multiple pitch bars 54A are displayed in a staircase-like pattern from left to right according to the strength of the pitch. To allow the singing user to understand the pitch of the lyrics they should be singing, the color of the pitch bars 54A changes from left to right as the song progresses, and the pointer 54B moves from left to right. When the color of the pitch bars 54A changes and the pointer 54B reaches the right end, the pitch image 54 indicating the next pitch is updated and displayed.

[0046] The progress bar 56, for example, shows the total length of the song from left to right. When playback of the song begins, the pointer 56A, which indicates the playback position of the song, moves from left to right, and the song ends when pointer 56A reaches the right end. Note that the progress bar 56 that pointer 56A has passed over is displayed thicker than its previous position.

[0047] Recording of the singing video begins after the singing user selects a song and clicks the recording start button (not shown) displayed on screen 3a, after a predetermined time interval (for example, 10 seconds). The start and end of the video recording may coincide with the start and end of the song, but is not limited to this; the video recording may start a predetermined time before the start of the song (for example, 5 seconds before) or end a predetermined time after the end of the song (for example, 5 seconds after).

[0048] The singing user connects earphones to the earphone jack 3e and listens to the music being played using the earphones, singing along to the music. The mobile terminal 3A photographs the singing user with the camera 3d and records the singing user's singing with the microphone 3c. In other words, the microphone 3c does not capture the sound of the music being played. The mobile terminal 3A then records the singing user's voice captured by the microphone 3c and uses it as singing data.

[0049] Furthermore, the singing data may be filtered to extract the frequency range of the human voice. This filtering process removes noise originating from the singing user's surrounding environment, resulting in a clearer recording of the user's voice.

[0050] The video posting and viewing app then combines the music data, singing data, and recording data to create singing video data that can be sent to server 4. The user can, for example, choose one of the following two timings for sending the singing video data to server 4, i.e., uploading it to the video posting site.

[0051] One method is live streaming, where the singing user uploads the singing video data to a video sharing site in real time while singing. In live streaming, viewers watch the singing user's performance in real time. The other method is non-live streaming, where the singing user uploads the singing video data to a video sharing site at a time of their choosing after the song has been sung.

[0052] When a singing user is performing a live stream, they should configure the settings for live streaming before recording the singing video, so that the singing video data is uploaded to the video sharing site as soon as the video recording starts. In the case of live streaming, the singing video data may be uploaded to the video sharing site without being stored on the mobile device 3A.

[0053] Furthermore, when conducting a live stream, the singer can choose between two settings: a first live stream setting that allows viewers to watch the singing video during the live stream, and a second live stream setting that allows viewers to watch the singing video even after the live stream has ended. In other words, with the first live stream setting, the singing video data is deleted from server 4 when the live stream ends, and viewers cannot watch the live-streamed singing video after the live stream has ended. On the other hand, with the second live stream setting, server 4 continues to store the singing video data even after the live stream has ended, so viewers can watch the singing video as a non-live stream even after the live stream has ended.

[0054] In the case of non-live streaming, the singing video data is temporarily stored on the mobile device 3A, and the singing user can upload the singing video to a video sharing site at any time by operating the video posting and viewing app.

[0055] [1-5. Viewing of singing videos by viewers] This section explains how viewers can watch singing videos using a mobile device (3B).

[0056] When a user wants to watch a singing video, they launch a video posting and viewing app on their mobile device 3B. When the video posting and viewing app is launched, the mobile device 3B accesses server 4, which stores data on multiple singing videos, i.e., a video posting site. The user then selects the singing video they want to watch via the video posting and viewing app and displays it on screen 3a. One example of the method used by server 4 to deliver singing videos to mobile device 3B is streaming.

[0057] Figure 5 shows an example of the screen display on mobile device 3B when viewing a singing video, specifically when a live stream is taking place.

[0058] Screen 3a displays a singing video and also includes a singing user display area 50C, a lyrics display area 50D, and a comment input display area 50E. The singing user display area 50C, the lyrics display area 50D, and the comment input display area 50E may be displayed superimposed on the singing video.

[0059] The singing user display area 50C displays the username of the singing user who posted the singing video, whether or not it is a live stream, and the name of the song being sung.

[0060] The lyrics display area 50D displays the lyrics of the singing video. For example, the displayed lyrics are shown in multiple phrases, and the color of the lyrics changes from left to right in accordance with the progress of the song. For example, the lyrics display area 50D may also display the lyrics in multiple lines. In this case, when the color change of the lyrics in the upper line reaches the right edge, the lyrics in the lower line move up and are displayed in the upper line, and new lyrics are displayed in the lower line, and the color of the lyrics in the upper line changes again from left to right in accordance with the progress of the song.

[0061] The comment input display area 50E displays a comment input field, along with comments from viewers watching the singing video, along with their usernames. For example, each time a viewer enters a comment, that comment is added to the top of the comment input display area 50E, and the previously displayed comments are shifted down. If the comments can no longer be displayed in the comment input display area 50E, a scroll bar (not shown) will appear on the right side of the comment display area, and viewers can use this scroll bar to display comments that were not previously shown on screen 3a.

[0062] Furthermore, screen 3a displays operation icons 58A to 58D for the viewer to perform various operations.

[0063] Operation icon 58A is clicked by viewers when they feel a connection to or appreciation of a singing video they are watching. The total number of clicks on operation icon 58A for that singing video is displayed above operation icon 58A.

[0064] Operation icon 58B is clicked when a viewer requests a singing user who is live-streaming a singing video displayed on screen 3a to participate in a singing battle (hereinafter referred to as "singing battle"). Singing battle involves simultaneously displaying multiple singing videos (first singing video, second singing video) by different singing users on screen 3a of the viewer's mobile device 3B, with the singing videos alternating between the two users singing the same song. In other words, a viewer who clicks operation icon 58B becomes a singing user participating in a singing battle.

[0065] Operation icon 58C is the icon that viewers click when they want to adjust various settings for the video posting and viewing app.

[0066] Operation icon 58D is an icon that viewers click when they want to overlay a decorative image onto the singing video displayed on screen 3a. In this embodiment, the decorative images have a price determined by their type and can be purchased by viewers through a fee. By clicking operation icon 58D, viewers can overlay a decorative image onto the singing video they are watching. The singer of the singing video on which the decorative image has been overlaid receives money from the video sharing site operator corresponding to the overlaid decorative image. In other words, the overlaying (display instruction) of a decorative image onto a singing video by a viewer is equivalent to a tip to the singer.

[0067] [1-6. Overview of the competitive singing function] The video posting and viewing application according to this embodiment has a competitive function in which multiple users, who are performers, compete against each other to determine the superiority of their performance videos. The competitive function according to this embodiment is a type of so-called karaoke battle, and as illustrated in Figure 6, it is a competitive singing function that simultaneously displays multiple singing videos (first singing video 60A, second singing video 60B) by different singing users on the screen 3a of the viewing user's mobile terminal 3B. The competitive singing function is a function executed by the server 4.

[0068] Figure 6 shows the screen display of the viewing user's mobile device 3B during a competitive singing session. The "VS" display shown in Figure 6 is displayed at the start of the competitive singing session and disappears after a predetermined time has elapsed (for example, 3 seconds). The screen display of the singing user's mobile device 3A may be the same as in Figure 6, or other singing users participating in the competitive singing session may be displayed in a reduced size relative to the screen display shown in Figure 4 (see Figure 8 below).

[0069] For a competitive singing competition to take place, one singing user (hereinafter referred to as "First Singing User") must request another singing user (hereinafter referred to as "Second Singing User") to simultaneously stream their singing video (hereinafter referred to as "Competition Request"), and the Second Singing User must accept the Competition Request.

[0070] More specifically, the first singing user launches a video posting and viewing app on their mobile device 3A1 and sends a battle request to the second singing user who is live streaming a singing video using the video posting and viewing app. The battle request is sent by the first singing user clicking the operation icon 58B. The first singing user selects the song to be sung in the battle. Selected song Information indicating the "battle song" (title and artist name) is sent to the second singing user along with the battle request.

[0071] A battle request sent from mobile terminal 3A1 is transmitted to the second singing user's mobile terminal 3A2 via server 4. An image corresponding to the received battle request is displayed on screen 3a of mobile terminal 3A2, and the second singing user clicks on the designated image displayed on screen 3a if they accept the battle request.

[0072] Then, when the second singing user accepts the challenge request from the first singing user, the server 4 starts the singing battle by distributing the first singing video 60A by the first singing user and the second singing video 60B by the second singing user so that they are simultaneously displayed on the screen 3a of the mobile terminal 3B. This allows viewers to watch the singing battle (real-time battle) between the first and second singing users in real time. In the following explanation, the first singing video 60A and the second singing video 60B distributed during the singing battle will be collectively referred to as the singing battle video.

[0073] Thus, the competitive singing function accepts a request for a singing video battle from the first singing user to the second singing user, and when the second singing user accepts the battle request, it distributes the first singing video 60A and the second singing video 60B so that they are displayed simultaneously on the screen 3a of the mobile terminal 3B. Therefore, the competitive singing function enables singing users to compete with each other using their respective singing videos, and also enables viewers to simultaneously watch multiple competing singing videos.

[0074] Furthermore, it is conceivable that the second singing user may accept the battle request but not the battle song. In such cases, the battle singing function may have a function to send information indicating the change of battle song and the battle song selected by the second singing user from the second singing user's mobile terminal 3A2 to the first singing user's mobile terminal 3A1, and to request the first singing user's consent.

[0075] [1-6-1. Alternating singing in competitive singing] In the competitive singing function according to this embodiment, the first singing user and the second singing user take turns singing the same song (hereinafter referred to as "alternating singing").

[0076] Alternating singing may take the form of, for example, a first singer finishing an entire song before a second singer singing the same song in its entirety. However, the competitive singing function according to this embodiment, as shown in Figure 7, virtually divides the song into multiple regions and sets the order in which the singing users will perform in each of these divided regions 68 (hereinafter referred to as "alternating performance setting"). As a result, the first and second singers will alternately sing the same song according to the alternating performance setting, allowing viewers to clearly recognize the difference in singing ability between the first and second singers and enjoy competitive singing more. In the following explanation, the order in which the singing users perform will be referred to as the alternating singing order.

[0077] Furthermore, the competitive singing function, as an example, highlights the lyrics that the singing user is singing, thereby allowing the singing user to recognize the divided area 68 that they are singing. The highlighting can be achieved through changes in the color or thickness of the lyrics.

[0078] In the example shown in Figure 7, a division region 608 is set up so that the first and second singing users sing alternately, and a division region 68 is also set up so that the first and second singing users sing together. The division region 68 is set up in advance based on, for example, a phrase, chorus, or measure of the song, and the duration of each division region 68 does not necessarily have to be the same.

[0079] The alternating singing order is determined when the decision is made to perform a singing battle. For example, the first singing user who initiated the battle request sings first, and the second singing user sings afterward. The divided area 68 in which the first and second singing users sing together may be pre-set for each song.

[0080] Furthermore, the alternating singing order, which is set based on the divided areas, may change dynamically. For example, a singing user with a relatively high total score obtained through the voting function described later may sing in more divided areas 68. More specifically, the total score of each singing user (singing video) is compared at predetermined timings in the song, and the singing user with a relatively high total score sings in subsequent divided areas 68 consecutively. In this case, the maximum number of divided areas 68 that can be sung consecutively is predetermined.

[0081] As a result, singing users with relatively high total scores will have more divided areas 68 to sing in, while singing users with relatively low total scores will have fewer divided areas 68 to sing in. Therefore, singing users with relatively high total scores can better showcase their singing ability to viewers and attract them more.

[0082] [1-6-2. Screen display and audio output in alternating singing] As mentioned above, Figure 6 shows the display screen of the viewer's mobile device 3B during a competitive singing session, with both the first singing video 60A and the second singing video 60B displayed at the same image size. For singing videos that are currently in progress, a display that allows the viewer to recognize it ("NOW PLAYING" in Figure 6) is shown.

[0083] In this context, singing videos or audio recordings that do not show actual singing are unlikely to be of interest to viewers and may distract viewers who are watching live singing.

[0084] Therefore, the competitive singing function according to this embodiment distributes singing videos to the mobile terminal 3B in such a way that the audio of the singing video in progress is output, while the audio of singing videos that are not currently in progress is not output. Furthermore, the server 4 distributes singing videos to the mobile terminal 3B in such a way that the singing video in progress is displayed larger on the screen 3a of the mobile terminal 3B than the singing video that is not currently in progress. As a result, viewers can watch competitive singing videos without their attention being distracted by singing videos that are not currently in progress.

[0085] Figure 8 shows an example of the screen display on the mobile terminal 3B during competitive singing. In the example in Figure 8, the first singing video 60A is in the process of singing, while the second singing video 60B is not in the process of singing. Therefore, the first singing video 60A is displayed enlarged (full screen), while the second singing video 60B is displayed reduced (windowed). The image size and display position on screen 3a when the singing video is displayed reduced may be predetermined, or the viewer may be able to change the image size and screen position as they wish.

[0086] Furthermore, the competitive singing function according to this embodiment distributes the singing videos to the mobile terminal 3B so that, based on the alternating singing order described above, audio output of the first singing video 60A and the second singing video 60B, or screen display of the first singing video 60A and the second singing video 60B, is performed.

[0087] Specifically, in the divided area 68 where the first singing user performs, the audio of the first singing video 60A is output and the first singing video 60A is displayed enlarged, while the audio of the second singing video 60B is not output and the second singing video 60B is displayed in a reduced size. Similarly, in the divided area 68 where the second singing user performs, the audio of the second singing video 60B is output and the second singing video 60B is displayed enlarged, while the audio of the first singing video 60A is not output and the first singing video 60A is displayed in a reduced size. Furthermore, in the divided area 68 where the first and second singing users perform together, as shown in Figure 6, the first singing video 60A and the second singing video 60B are displayed on the screen at the same image size and both have audio output.

[0088] Thus, the competitive singing function according to this embodiment controls the audio output and screen display of the competitive singing video based on the alternating performance settings described above. Therefore, even when displaying singing videos simultaneously, it is possible to easily control the output of the competitive singing video on the viewer's mobile terminal 3B.

[0089] [1-6-3. Voting function] The video posting and viewing app has a voting function that allows viewers to input their evaluations (hereinafter referred to as "votes") for each singing video in competitive singing via their mobile device 3B.

[0090] Voting is performed by viewers clicking on an operation icon 58A provided for each singing video, as shown in Figures 6 and 8. In other words, viewers click the operation icon 58A to indicate their positive evaluation of a singing video if they find it appealing or otherwise enjoyable. An image (hereinafter referred to as the "voting result image") 66 showing the evaluation results for each singing video is then delivered and displayed on the screen 3a of the mobile device 3B along with the singing video.

[0091] As described above, the voting function according to this embodiment allows viewers to evaluate competitive singing videos by, for example, clicking the operation icon 58A. This makes it easy for viewers to determine the superiority or inferiority of the singing performances when competitive singing takes place. Furthermore, viewers can evaluate both singing videos simultaneously.

[0092] The voting function accepts score inputs as votes and derives the total score entered during the streaming of the singing video (hereinafter referred to as "total evaluation score") as the evaluation result. The total evaluation score is the sum of the scores entered by multiple viewing users. The voting function then determines the winner of the singing competition based on the total evaluation score entered by the end of the singing competition. In other words, the singing user of the singing video with a relatively high total evaluation score is declared the winner. Thus, with the voting function according to this embodiment, multiple viewing users can cooperate in voting for the singing user (singing video) they support, making their supported singing user the winner, and thus viewers can empathize more with the singing user.

[0093] In this embodiment, the voting function inputs 1 point each time the operation icon 58A is clicked. The numbers (21 and 185) in the voting result image 66 shown in Figures 6 and 8 represent the total evaluation score for each singing user (singing video), and the bar image that extends to the left and right of screen 3a and has different hatching (colors) on the left and right sides shows the total evaluation score for each singing video relatively.

[0094] Furthermore, there is an upper limit (hereinafter referred to as the "click limit") on the number of times each viewer can click the operation icon 58A, and in this embodiment, the click limit is one click. When the click limit is reached, the operation icon 58D is displayed on screen 3a in place of the operation icon 58A, as shown in Figure 8.

[0095] By clicking the operation icon 58D, viewers can overlay decorative images (hereinafter referred to as "tipping effect images") onto the singing video corresponding to the clicked operation icon 58D. Thus, the voting function has a tipping effect function that accepts requests for tipping effect images to be overlaid on the singing video from the mobile device 3B and overlays the received tipping effect images onto the singing video. In the following explanation, the instruction (selection) of a tipping effect image to be displayed by a viewer via the mobile device 3B will be referred to as tipping input, as described above.

[0096] In other words, viewers can decorate singing videos they find appealing by overlaying the tipping effect image 69 onto them, thus the tipping effect function can enhance the audience and the singing video itself during its distribution. The tipping effect function is a function that is executed by the server 4 in response to display instructions from viewers via the video posting and viewing app.

[0097] Figure 9 shows the screen display of the mobile device 3B when a viewer clicks the operation icon 58D, displaying several different tipping effect images 69 that the viewer can select. Each tipping effect image 69 has a point value assigned to it, and its design differs according to the point value. The viewer selects one of the multiple tipping effect images 69 displayed on the screen that can be obtained with the points they possess. Note that a different design means, for example, that the shape, color, or orientation is different.

[0098] For example, points are assigned a fee for each point, and viewers purchase points. The number of available tipping effect images 69 increases or decreases depending on the number of points the viewer possesses. When a viewer selects a tipping effect image 69, the number of points the viewer possesses decreases according to the point value of the selected tipping effect image 69. Points can be increased not only through purchases but also through the use of other online services, etc.

[0099] The tipping effect images 69 exemplified in Figure 9 consist of four types of spotlight images with different orientations and a widening base, and four types of combined spotlight images, each with a different color, created by combining multiple spotlight images. By using spotlight-like images for the tipping effect images 69, viewers can get the feeling that they are participating in a concert or similar event. Note that the tipping effect images 69 are not limited to the examples in Figure 9; other images may also be used.

[0100] Figure 10 shows an example of a singing video (hereinafter referred to as "effect-supervised singing video") in which a combined spotlight image is selected by the viewer as the tipping effect image 69, and the tipping effect image 69 is superimposed. The effect-supervised singing video can be viewed not only by the viewer who selected the tipping effect image 69, but also by other viewers who are watching the competitive singing.

[0101] Furthermore, the tipping effect function according to this embodiment can be applied to a singing video in which singing is taking place, and after a tip is entered, the tipping effect image 69 is superimposed on the singing video with virtually no delay. In other words, in the example in Figure 10, the viewer can superimpose the tipping effect image 69 onto the first singing video 60A, but cannot superimpose the tipping effect image 69 onto the second singing video 60B in which the singing user is not singing. More specifically, even if the viewer clicks the operation icon 58D corresponding to a singing video in which the singing user is not singing, the tipping effect function will not accept the click.

[0102] Furthermore, when the voting function receives the superposition of a tipping effect image 69, it accepts the input of points corresponding to the tipping effect image 69 as an evaluation. In this embodiment, as an example, points corresponding to the tipping effect image are input as the evaluation score. That is, each time a tip is made, points corresponding to the tipping effect image 69 selected by the viewer are added to the above-mentioned total evaluation score.

[0103] Thus, the voting function according to this embodiment can encourage viewers to make donations by accepting score inputs as evaluations in accordance with the superimposition of the donation effect image 69. There is no upper limit to the number of times each viewer can make a donation. In other words, viewers can increase the total evaluation score of singing videos that they sympathize with by clicking the operation icon 58D multiple times.

[0104] Furthermore, an image (icon image 64) representing viewers who have given a relatively higher rating (vote) to the singing video than other viewers, i.e., viewers who have entered a large number of points (hereinafter referred to as "high-rated users"), is displayed on the screen 3a of the mobile device 3B. This allows viewers to make other viewers aware of the singers they are supporting. In addition, viewers can also make singers aware that they are being supported.

[0105] In this embodiment of the voting function, the top three users with the highest scores are designated as highly-rated users, and their icon images 64 are displayed on screen 3a for each singing video. However, the number of highly-rated users whose icon images 64 are displayed is not limited to these three.

[0106] Furthermore, in this embodiment, the voting function inputs a score as an evaluation when the operation icon 58A is clicked and when a donation is made. However, it is not limited to these two cases; for example, a score may be input as an evaluation when a donation is made, or a score may be input as an evaluation when the operation icon 58A is clicked.

[0107] [1-6-4. Other Features] Server 4 may store information for each singing user (hereinafter referred to as "singing user information") on HDD 26. Singing user information includes the number of fans a singing user has, the singing user's past battle record and win rate, and their favorite songs. The battle singing function may accept battle requests from a first singing user with a similar number of fans to a second singing user. The number of fans a singing user has is thought to vary depending on the singing user's singing ability. In this way, by making the number of fans similar a condition for accepting battle singing requests, it is possible to prevent battle singing between singing users with vastly different singing abilities.

[0108] More specifically, when the first singing user requests a battle from the second singing user, the battle singing function compares the number of fans of the first singing user with the number of fans of the second singing user. If the difference in the number of fans is within a predetermined threshold (for example, within ±20%), the battle request from the first singing user to the second singing user is accepted. The number of fans increases when a viewer registers that they are a fan of the singing user through the video posting and viewing app. There is no limit to the number of singing users that a viewer can register as a fan of.

[0109] Furthermore, the competitive singing function may accept battle requests even if the number of fans is similar, as long as other conditions are met. It may also accept battle requests even if the number of fans is not similar, as long as the second singer agrees. On the other hand, the competitive singing function may only accept battle requests from users with a similar number of fans. "Only" here means, for example, that battle requests from users with a different number of fans will not be accepted, even if other conditions are met.

[0110] Furthermore, the competitive singing feature may reward the winning singer in a competitive singing battle with a score based on the total evaluation points they receive from votes cast for themselves. This reward could be money, points usable on video sharing apps (video sharing sites), or other online services. Additionally, the winning singer in a competitive singing battle may receive a score based on the combined total of their own evaluation points and their opponent's evaluation points (a so-called winner-take-all system).

[0111] [1-7. Functionality Block for the Battle Singing Feature] Figure 11 is a functional block diagram relating to the competitive singing function according to this embodiment. The CPU 20 of the server 4 includes a battle request reception unit 70, a battle acceptance determination unit 71, a battle setting unit 72, a video evaluation unit 73, a tipping effect superimposition unit 74, and a video distribution unit 75. The processing performed by each function of the server 4 is realized by programs stored in the HDD 26.

[0112] The battle request receiving unit 70 accepts battle requests from the first singing user to the second singing user. The battle request receiving unit 70 may also accept battle requests from the first singing user to the second singing user if the number of fans is similar.

[0113] The match acceptance determination unit 71 determines whether the second singing user has accepted the match request from the first singing user.

[0114] The battle setting unit 72 performs various settings for competitive singing, such as setting the song and the singing order. The battle setting unit 72 divides the song into multiple time-series areas and sets the order in which the singing users will sing (alternating singing order) for each area. The battle setting unit 72 may also dynamically change the alternating singing order set based on the divided areas 68.

[0115] The video evaluation unit 73 receives input of evaluations (scores) for each singing video distributed to the mobile terminal 3B, as well as the superimposition of tipping effect images 69 onto the singing videos (tipping input) from the mobile terminal 3B. The video evaluation unit 73 then calculates the total evaluation score entered during the distribution of the singing videos and determines the winner or loser of the singing competition.

[0116] The tipping effect overlay unit 74, upon receiving a tipping input, overlays a tipping effect image 69 corresponding to the received tipping input onto the singing video.

[0117] The video distribution unit 75 distributes the singing video to the mobile terminal 3B. Furthermore, if the second singing user accepts a battle request from the first singing user, the video distribution unit 75 distributes the first singing video 60A by the first singing user and the second singing video 60B by the second singing user so that they are simultaneously displayed on the screen 3a of the mobile terminal 3B. Additionally, the video distribution unit 75 distributes the battle singing video to the mobile terminal 3B such that the audio of the singing video currently in progress is output, while the audio of singing videos that are not currently in progress is not output, and the singing video currently in progress is displayed larger on the screen 3a than the singing videos that are not currently in progress.

[0118] [1-8. Flowchart for the competitive singing process] Figure 12 is a flowchart showing the flow of the competitive singing process according to this embodiment, which is executed by the CPU 20 of the server 4. The program for executing the competitive singing process according to this embodiment is stored in advance in a predetermined area of ​​the HDD 26.

[0119] First, in step S100, the battle request receiving unit 70 determines whether the first singing user has requested a battle from the second singing user. If the determination is positive, that is, if a battle request from the first singing user has been received, the system proceeds to step S102. On the other hand, if the determination is negative, the system waits until a battle request is received.

[0120] In step S102, the battle acceptance determination unit 71 determines whether the second singing user has accepted the battle request. If the determination is positive, the process proceeds to step S104; otherwise, the process returns to step 5S100.

[0121] In step S104, the battle setting unit 72 performs various settings for conducting the battle singing competition.

[0122] In the next step, S106, Video Distribution Department 75 will begin distributing videos of the competitive singing performances.

[0123] In the next step, S108, the video distribution unit 75 determines whether the song for the singing competition has finished. If the determination is positive, the system proceeds to step S110. If the determination is negative, the video distribution unit 75 continues to distribute the singing competition video until the song is finished.

[0124] In the next step, S110, the video distribution unit 75 finishes distributing the competitive singing video and returns to step S100.

[0125] As described above, the server 4 (competitive singing function) according to this embodiment receives a request for a competitive singing video from the first singing user to the second singing user, and when the second singing user accepts the request, it distributes the first singing video 60A and the second singing video 60B so that they are displayed simultaneously on the screen 3a of the mobile terminal 3B. Therefore, the server 4 (competitive singing function) according to this embodiment enables singing users to compete with each other using their respective singing videos, and also enables viewers to simultaneously view multiple competing singing videos.

[0126] [1-9. Flowchart of the voting process] Figure 13 is a flowchart showing the flow of the voting process according to this embodiment, which is executed by the CPU 20 of the server 4. The program for executing the voting process according to this embodiment is stored in advance in a predetermined area of ​​the HDD 26.

[0127] First, in step S200, the video evaluation unit 73 determines whether or not the competitive singing has started. If the determination is positive, the process proceeds to step S202. On the other hand, if the determination is negative, the process waits until the competitive singing begins.

[0128] In step S202, the video evaluation unit 73 determines whether or not the operation icon 58A was clicked by the viewer. If the determination is positive, the process proceeds to step S204; otherwise, the process proceeds to step S206.

[0129] In step S204, the video evaluation unit 73 derives the total evaluation score, and the video distribution unit 75 updates the display of the total evaluation score.

[0130] In step S206, the video evaluation unit 73 determines whether the user has clicked the operation icon 58D. If the determination is positive, the process proceeds to step S208; otherwise, the process proceeds to step S210.

[0131] In step S208, the tipping effect overlay unit 74 overlays the tipping effect image 69 selected by the viewer onto the target singing video, the video evaluation unit 73 derives a total evaluation score by adding points corresponding to the overlaid tipping effect image 69, and the video distribution unit 75 updates the display of the total evaluation score.

[0132] In the next step, S210, the video evaluation unit 73 determines whether there has been a change in the number of users who have given high ratings to the singing video. If the determination is positive, the process proceeds to step S212; if the determination is negative, the process proceeds to step S214.

[0133] In step S212, the video distribution unit 75 updates the display of the icon image 64 of the highly-rated user.

[0134] In step S214, the video distribution unit 75 determines whether the song for the singing competition has finished. If the determination is positive, the process proceeds to step S216; otherwise, it returns to step S202.

[0135] In step S216, the video evaluation unit 73 determines the winner based on the total evaluation score for each singing video, and the video distribution unit 75 distributes an image showing the result.

[0136] In the next step, S218, the video distribution unit 75 will end the distribution of the battle singing video and terminate the voting process.

[0137] As described above, the server 4 (voting function) according to this embodiment receives evaluations of each singing video distributed to the mobile terminal 3B from the mobile terminal 3B. Therefore, the server 4 (voting function) according to this embodiment makes it possible for viewers to easily judge the quality of performance videos distributed by multiple singing users.

[0138] [2. Second Embodiment] A second embodiment of the present invention will be described below.

[0139] The configuration of the karaoke system 1, server 4, and mobile terminal 3 according to this embodiment is the same as the configuration of the karaoke system 1, server 4, and mobile terminal 3 according to the first embodiment, so a description will be omitted.

[0140] [2-1. Overview of the Battle Dance Feature] In this embodiment, the performance video is a dance video, with the performer being a dancer, and the dance video being uploaded to a video sharing site (server 4). In other words, the competitive function in this embodiment is a competitive dance function that simultaneously displays multiple dance videos (first dance video 60C, second dance video 60D) by different dance users on the screen 3a of the viewer's mobile terminal 3B, as shown in Figure 14.

[0141] A competitive dance is initiated when the first dance user requests another dance user (hereinafter referred to as the "second dance user") to simultaneously stream dance videos (a competitive request), and the second dance user accepts the competitive request. For example, when the first dance user makes a competitive request to the second dance user, they indicate that this request is for a competitive dance. This allows the second dance user and server 4 to recognize that this request is for a competitive dance. In the following explanation, the first dance video 60C and the second dance video 60D streamed in a competitive dance are collectively referred to as competitive dance videos.

[0142] In this embodiment, the competitive dance function, similar to the first embodiment, sets the order in which dance users perform dances for each divided region 68 (see Figure 7), which is a virtual division of the song into multiple time-series regions (hereinafter referred to as "alternating dance setting"). In the alternating dance setting, a divided region 68 in which the first dance user and the second dance user perform dances together may be set.

[0143] [2-1-1. Featured Video Enlargement Function] The competitive dance function according to this embodiment has an enlarged display function that determines the dance video with the most dynamic subject movement among multiple dance videos simultaneously displayed on the screen 3a of the mobile terminal 3B as the featured video (featured video determination function), and delivers the dance video to the mobile terminal 3B so that the featured video is displayed larger than the other dance videos. The subject referred to here is a person, such as a dancer.

[0144] In the example shown in Figure 15, the first dance video 60C is the featured video, while the second dance video 60D is not. Therefore, the first dance video 60C is displayed enlarged (fullscreen), while the second dance video 60D is displayed reduced (windowed). The image size and display position on screen 3a when the dance video is displayed reduced may be predetermined, or the viewer may be able to change the image size and screen position as they wish.

[0145] In this way, the enlargement function determines which dance videos to display larger than other dance videos based on the movement of the subject, so it is possible to change the display mode of the competitive dance video on the screen 3a of the mobile device 3B without using the sound of the distributed dance video.

[0146] Furthermore, when the first and second dance users dance together, the dance video with larger movements is displayed enlarged on the viewer's mobile device 3B, resulting in the competing dance users performing more dynamic dances, which in turn makes the viewer more excited.

[0147] Furthermore, the enlarged display function delivers the battle dance video to the mobile device 3B in such a way that the sound of the featured video is output, while the sound of other dance videos is not. As a result, the sounds (voice, breathing, etc.) made by the dancers in the featured video are output from the mobile device 3B, while the sounds made by dancers in other videos are not output from the mobile device 3B. Therefore, viewers can watch the battle dance video without being distracted by sounds from other dance videos.

[0148] When the magnified display function according to this embodiment is executed, the audio output and screen display based on the alternating performance settings described in the first embodiment will not be performed. However, the system is not limited to this, and the magnified display function according to this embodiment may be executed when the first dance user and the second dance user dance together, even if the audio output and screen display based on the alternating performance settings are performed.

[0149] [2-1-2. Featured Video Judgment Function] The featured video detection function extracts images of the dancers (people) from dance videos at predetermined time intervals (hereinafter referred to as "dancer images"), and determines that the dance video with the greatest difference in the extracted dancers among multiple dance videos is the featured video. The image extraction interval (hereinafter referred to as "image extraction interval") is, for example, 0.5 seconds, but may also be defined in frames rather than time.

[0150] More specifically, the featured video detection function extracts dancer images at predetermined time intervals (0.5 seconds) from the start of the dance video and derives the difference between the dancer images before and after the image extraction interval. The featured video detection function then compares the differences between the first dance video 60C and the second dance video 60D at the same timing, and designates the dance video with the larger difference between the first dance video 60C and the second dance video 60D as the featured video. The extraction of people from the dance video can be performed, for example, using known image analysis methods.

[0151] Thus, the video recognition function directly determines the relative size of the dancer's movements from the dancer images contained in the dance video, allowing it to accurately identify dance videos in which the dancer's movements are relatively large. In this embodiment, the dance video is one in which the entire body of the dancer is filmed and the dancer is filmed at a size sufficient for image analysis.

[0152] Furthermore, the video recognition function according to this embodiment determines differences in the movements of the dancer, who is the subject of the video, based on the movements of the dancer's arms and legs.

[0153] Figure 16 shows an example of dancer images extracted from a dance video at an image extraction interval. Figures 16(A) and 16(B) show dancer images extracted from the first dance video 60C at image extraction intervals, while Figures 16(C) and 16(D) show dancer images extracted from the second dance video 60D at image extraction intervals. In other words, in the example of Figure 16, the dancer image from the first dance video 60C shown in Figure 16(A) changes as shown in Figure 16(B) after a predetermined time, and the dancer image from the second dance video 60D shown in Figure 16(C) changes as shown in Figure 16(D) after a predetermined time.

[0154] In the example in Figure 16, as enclosed by the dashed area, the movement of the left hand and right foot is large in the first dance video 60C, while the movement of both feet is only slight in the second dance video 60D. Therefore, the difference in the dancer images is greater in the first dance video 60C. For this reason, the first dance video 60C is considered the image of interest. As an example, the movement of the limbs refers to the movement of the tip of the limbs, and the movement of the tip of the limbs is derived from the change in the coordinates indicating the tip position.

[0155] In this way, the featured video detection function determines differences in the movements of the dancer, who is the subject of the video, based on the movements of the dancer's arms and legs, allowing for more accurate detection of the dancer's movements.

[0156] In this case, there are moments when the dancers are motionless. If, in such a situation, the dancers (subjects) in other dance videos that are not the featured video start moving, those other dance videos may be identified as the featured video, and as a result, videos that do not feature dancing may be displayed in an enlarged view on the mobile device 3B.

[0157] Therefore, the zoom function may switch to the other dance video as the featured video if the dancer's movements in the featured video become smaller than the dancer's movements in the other dance video for a predetermined time (e.g., 1 second) or longer. In other words, even if the dancer's movements in the featured video become smaller than the dancer's movements in the other dance video, the other dance video will not be switched to the featured video if this period is less than the predetermined time.

[0158] This prevents other dance videos that are not performing from becoming featured videos, even if the dancer in a featured video temporarily stops moving.

[0159] [2-2. Functional block for the battle dance function] Figure 17 is a functional block diagram relating to the competitive dance function according to this embodiment. The CPU 20 of the server 4 includes a competitive request reception unit 70, a competitive acceptance determination unit 71, a competitive setting unit 72, a video evaluation unit 73, a tipping effect superimposition unit 74, and a video distribution unit 75, along with a featured video determination unit 80. The processing performed by each function of the server 4 is realized by programs stored in the HDD 26. Note that the competitive request reception unit 70, competitive acceptance determination unit 71, competitive setting unit 72, video evaluation unit 73, tipping effect superimposition unit 74, and video distribution unit 75 according to this embodiment are the same as the parts according to the first embodiment, although the video to be processed is a dance video, so their explanation is omitted.

[0160] The attention video determination unit 80 performs the attention video determination function described above and determines that the dance video in which the subject (dancer) moves the most among multiple dance videos is the attention video.

[0161] In this embodiment, the video distribution unit 75 distributes the competitive dance video to the mobile terminal 3B in such a way that the sound of the featured video is output, and the sound of other dance videos that are not featured is not output.

[0162] [2-3. Flowchart for enlarging featured videos] Figure 18 is a flowchart showing the flow of the video enlargement process according to this embodiment, which is executed by the CPU 20 of the server 4. The program for executing the video enlargement process according to this embodiment is stored in advance in a predetermined area of ​​the HDD 26.

[0163] First, in step S300, the video detection unit 80 determines whether or not the music for the battle dance has started. If the determination is positive, the system proceeds to step S302. On the other hand, if the determination is negative, the system waits until the music for the battle dance begins.

[0164] In the next step S302, immediately after the start of the dance battle music or after a predetermined time has elapsed (for example, after 1 second), the video detection unit 80 extracts images of the dancers from the first dance video 60C and the second dance video 60D.

[0165] In the next step, S304, the focus video determination unit 80 determines whether the image extraction interval has elapsed since the last time a dancer image was extracted. If the determination is positive, the process proceeds to step S306. On the other hand, if the determination is negative, the process waits until the image extraction interval has elapsed.

[0166] In step S306, the focus video determination unit 80 extracts images of the respective dancers from the first dance video 60C and the second dance video 60D.

[0167] In the next step, S308, the focus video determination unit 80 derives the difference between the dancer image extracted previously and the dancer image extracted this time for each dance video.

[0168] In the next step, S310, the focus video determination unit 80 compares the differences in the dancer images for each dance video to determine which video is the focus video.

[0169] In the next step, S312, the video distribution unit 75 distributes the featured dance video to the mobile terminal 3B so that the featured video is displayed larger (enlarged) compared to other dance videos. If the dance video that was determined to be the featured video in step S310 is switched, the dance video that is displayed enlarged will also be switched.

[0170] In the next step, S314, the focus video determination unit 80 determines whether an image extraction interval has elapsed since the time when the dancer image was last extracted. If the determination is positive, the process returns to step S306; otherwise, it proceeds to step S316.

[0171] In step S316, the video distribution unit 75 determines whether the dance battle music has finished or not. If the determination is positive, the process proceeds to step S318; otherwise, it returns to step S314.

[0172] In the next step, S318, the video distribution unit 75 terminates the distribution of the battle dance video and ends the processing of enlarging this featured video.

[0173] As described above, the server 4 (competitive dance function) according to this embodiment performs a focus video determination process to determine which of the multiple dance videos simultaneously displayed on the screen 3a of the mobile terminal 3B has the most dynamic dancer movements, and distributes the focus video to the mobile terminal 3B so that it is displayed larger than the other dance videos. Therefore, the server 4 (competitive dance function) according to this embodiment can change the display manner of the competitive dance videos on the screen 3a of the mobile terminal 3B without using the sound of the distributed dance videos.

[0174] [3. Other Embodiments] Although the present invention has been described above using the embodiments described above, the technical scope of the present invention is not limited to the scope described in the embodiments above. Many modifications or improvements can be made to the embodiments above without departing from the spirit of the invention, and such modified or improved forms are also included in the technical scope of the present invention. Furthermore, the embodiments above may be combined as appropriate.

[0175] For example, the above embodiment describes a form in which a singing or dancing competition is performed by two performers (singing users or dancing users), but the present invention is not limited thereto. For example, a singing or dancing competition may be performed by three or more performers. In this form, one performer may simultaneously request a competition from two or more other performers, and a performer who receives a competition request may further request a competition from other performers.

[0176] Furthermore, in the above embodiment, a form was described in which the total evaluation score for each video is displayed as a bar image as the voting result image 66, but the present invention is not limited thereto. For example, instead of a bar image, the total evaluation score for each video may be displayed relatively using a pie chart.

[0177] Furthermore, while the above embodiments describe a configuration in which the winner of a singing or dancing competition is determined by votes from viewers, the present invention is not limited thereto. For example, the singing or dancing competition may have an automatic scoring function, and the winner may be determined by the result of this automatic scoring function.

[0178] Furthermore, while the first embodiment described above describes a configuration in which the audio output and screen display of the first singing video 60A and the second singing video 60B are performed based on alternating performance settings, the present invention is not limited thereto. For example, the server 4 may perform image analysis (face recognition processing) on ​​the singing video transmitted from the mobile terminal 3A to determine which singing video has the mouth opened wider, and based on this determination result, it may perform the audio output and screen display of the first singing video 60A and the second singing video 60B. In other words, a singing video in which the mouth is opened relatively wider is determined to be a singing video in which the singing user is currently performing a song.

[0179] Furthermore, although the above embodiments described real-time battles as competitive singing or competitive dancing, the present invention is not limited thereto. For example, a performer may request a battle against a video already recorded by another performer, enabling battles between live videos and recorded videos, or battles between recorded videos.

[0180] Furthermore, the processing flow described in the above embodiments is merely an example, and unnecessary steps may be deleted, new steps added, or the processing order rearranged without departing from the spirit of the present invention. [Explanation of symbols]

[0181] 3B Mobile terminals (terminal devices) 3a screen 4. Server (Information Processing Device) 60C First Dance Video (Featured Video) 60D 2nd Dance Video (Other Videos) 72. Battle Settings Section (Setting Method) 75. Video Distribution Department (Distribution Methods) 80. Featured Video Judgment Unit (Judgment Means)

Claims

1. An information processing device that distributes videos posted by users to terminal devices, Distribution means for distributing multiple videos so that they are displayed simultaneously on the screen of the terminal device, The system includes a determination means for determining that the video in which the subject's movement is greatest among a plurality of such videos is the video of interest, The distribution means is an information processing device that distributes the video to the terminal device such that the featured video is displayed larger than other videos.

2. The information processing apparatus according to claim 1, wherein the determination means extracts images showing the subject from the video at predetermined time intervals, and determines that the video with the greatest difference in the extracted subjects among a plurality of videos is the video of interest.

3. The subject in question is a person. The information processing apparatus according to claim 2, wherein the determination means determines the difference of the subject based on the movement of the subject's limbs.

4. The information processing apparatus according to any one of claims 1 to 3, wherein the distribution means distributes the video to the terminal device such that the sound of the featured video is output and the sound of other videos is not output.

5. The information processing apparatus according to any one of claims 1 to 4, wherein the determination means determines that the other video is the video of interest if the movement of the subject in the video of interest becomes smaller than the movement of the subject in the other video for a predetermined period of time or longer.

6. A video distribution method that delivers user-submitted videos to a terminal device, A first step is to distribute multiple videos so that they are displayed simultaneously on the screen of the terminal device, The process includes a second step of determining that the video in which the subject's movement is greatest among a plurality of such videos is the video of interest, The second step is a video distribution method that distributes the video to the terminal device such that the video of interest is displayed larger than the other videos.

7. The computer in an information processing device that distributes user-submitted videos to terminal devices is Distribution means for distributing multiple videos so that they are displayed simultaneously on the screen of the terminal device, This means functions as a determination mechanism that determines, among multiple videos, the video with the greatest movement of the subject to be the video of interest. The distribution means is a video distribution program that distributes the featured video to the terminal device such that the featured video is displayed larger than other videos.

Images