Information processing device, video distribution method, and video distribution program

Abstract

To provide an information processing apparatus, a moving image distribution method, and a moving image distribution program which allow a user to easily determine the superiority of a moving image distributed by each of a plurality of users.SOLUTION: A server distributes a plurality of song moving images posted by different singing users so as to be simultaneously displayed on the screen of a portable terminal. Then, the server receives from the portable terminal the evaluation of each song moving image distributed to the portable terminal, and distributes a voting result image indicating the evaluation of each song moving image so as to be displayed on the screen of the portable terminal together with the song moving image.SELECTED DRAWING: Figure 13

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, a video distribution method, and a video distribution program.

Background Art

[0002] In recent years, online services such as websites (web pages, web services), online games, and application software (hereinafter referred to as "apps") distributed to information processing apparatuses such as mobile terminals via a computer network have become widely popular.

[0003] One of the online services is a video posting site that allows users to post videos they have taken themselves and enables other users to view these videos. On this video posting site, users also post performance videos such as singing videos. In addition, online services such as battles between performance videos by different posters are also envisioned.

[0004] [[ID=2(0]]Here, Patent Document 1 discloses a karaoke device that allows an audience listening to a singer's singing in a karaoke box or the like to participate in the evaluation of the singing. The karaoke device plays a karaoke song and analyzes the frequency and volume of the singing voice to score this singing. The audience listening to the singing inputs the evaluation of this singing by directly accessing the karaoke device using their mobile phone or accessing the aggregation center. After the performance of the karaoke song ends, the karaoke device comprehensively evaluates the score by its own scoring function and the evaluation input from the audience to determine the final evaluation and displays this on a monitor.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] The karaoke device disclosed in Patent Document 1 allows the audience to evaluate the singing based on their own feelings, but it requires them to call a designated phone number when they think the singing is good, which is time-consuming and the system is complex. Furthermore, for example, when two singers sing simultaneously, the audience does not make a judgment on which is better.

[0007] The present invention has been made in view of these circumstances, and aims to provide an information processing device, a video distribution method, and a video distribution program that enable multiple users to easily determine the quality of videos distributed by each user. [Means for solving the problem]

[0008] To solve the above problems, the information processing device, video distribution method, and video distribution program of the present invention employ the following means.

[0009] To solve the above problems, an "information processing device" according to one aspect of the present invention is an information processing device that distributes videos posted by a user to a terminal device, comprising: distribution means for distributing multiple videos so that they are displayed simultaneously on the screen of the terminal device; and evaluation means for receiving input from the terminal device for evaluation of each video distributed to the terminal device.

[0010] To solve the above problems, one aspect of the present invention, a "video distribution method," is a video distribution method for distributing videos posted by a user to a terminal device, comprising: a first step of distributing multiple videos so that they are displayed simultaneously on the screen of the terminal device; and a second step of receiving input from the terminal device for evaluation of each of the videos distributed to the terminal device.

[0011] To solve the above problems, one aspect of the present invention, a "video distribution program," provides a computer in an information processing device that distributes user-submitted videos to a terminal device, which functions as a distribution means for distributing multiple videos so that they are displayed simultaneously on the screen of the terminal device, and an evaluation means for receiving evaluation input for each of the videos distributed to the terminal device from the terminal device.

[0012] Various technical limitations may be added to the "information processing device" described above, as illustrated below. Furthermore, technical limitations of a similar nature may be added to the processing steps executed by the "video distribution method" and the functions of the "video distribution program."

[0013] The distribution means distributes an image showing the evaluation result for each video to the terminal device along with the video.

[0014] The evaluation means accepts score input as part of the evaluation and derives the total score entered during the distribution of the video.

[0015] The evaluation means includes a superimposing means that receives a request to superimpose a decorative image onto the video and superimposes the received decorative image onto the video.

[0016] When the evaluation means receives the superposition of the decorative image, it accepts the input of a score corresponding to the decorative image as the evaluation.

[0017] The distribution means distributes images indicating viewers who have given the video a relatively higher rating than other viewers, so that these images are displayed on the screen of the terminal device. [Effects of the Invention]

[0018] According to the present invention, there is an effect that other users can easily judge the quality of videos distributed by each of multiple users. [Brief explanation of the drawing]

[0019] [Figure 1]It is a configuration diagram of a karaoke system according to the present invention. [Figure 2] It is a block diagram showing the electrical configuration of a server according to the present invention. [Figure 3] It is a block diagram showing the electrical configuration of a mobile terminal according to the present invention. [Figure 4] It is a diagram showing the screen display of a mobile terminal when shooting a singing video according to the present invention. [Figure 5] It is a diagram showing the screen display of a mobile terminal when viewing a singing video according to the present invention. [Figure 6] It is a diagram showing the screen display of a mobile terminal of a viewing user in a battle singing according to the present invention. [Figure 7] It is a schematic diagram showing the divided area of a music piece used in a battle singing according to the present invention. [[ID=​​​​​​​​​​​​​​​​​​​​​​​​​​In this embodiment, the performer records their performance as a video using a mobile device and sends it to a server, uploading it to a video sharing site. The video uploaded to the video sharing site (posted video) can be viewed via a mobile device. In this embodiment, the performance is referred to as singing, the performer as the singing user, and the video uploaded to the video sharing site as the singing video. Furthermore, the user who views the singing video uploaded to the video sharing site is referred to as the viewing user.

[0022] [1. Karaoke System Configuration] Figure 1 is a schematic diagram of the karaoke system 1 according to this embodiment. The karaoke system 1 consists of a communication line 2, a plurality of mobile terminals 3 (mobile terminals 3A1, 3A2, 3B), and a server 4.

[0023] Communication line 2 forms a computer network and is, for example, a wide-area communication line provided by an electric power company.

[0024] The mobile terminal 3 is, for example, an information processing terminal such as a smartphone, tablet, or laptop computer, and is used by users to access online services. The mobile terminal 3 includes a touch panel display 3a for displaying images, a speaker 3b for outputting sound, a microphone 3c for receiving sound input, a camera 3d for photographing subjects, and an earphone jack 3e for connecting earphones (not shown). Here, "photography" refers to the state in which the camera 3d is functioning and the subject is displayed on the touch panel display 3a, regardless of whether recording is being made or not. The touch panel display 3a includes, for example, an LCD (Liquid Crystal Display) and a touch sensor. The LCD displays various images, and the touch sensor accepts various input operations performed using an object such as a finger, stylus, or pen. In the following description, the touch panel display 3a will also be referred to as screen 3a.

[0025] Server 4 is an information processing device that provides online services to mobile terminal 3 via communication line 2. In the example shown in Figure 1, the singing user uploads their singing video (singing video data) to the video sharing site by sending it from mobile terminal 3A to Server 4. The viewing user then accesses the video sharing site using mobile terminal 3B and watches the singing video. The singing user can also view the singing video they uploaded by accessing the video sharing site using mobile terminal 3A. Furthermore, the user of mobile terminal 3B can also become the singing user and upload a singing video to the video sharing site.

[0026] [2. Server Configuration] Figure 2 is a block diagram showing the electrical configuration of server 4 according to this embodiment.

[0027] The server 4 according to this embodiment includes a CPU (Central Processing Unit) 20, which is the main control unit that manages the operation of the entire server 4, and a ROM in which various programs and various data are pre-stored. It includes Read Only Memory (Read Only Memory) 22, Random Access Memory (RAM) 24 used as a work area when various programs are executed by the CPU 20, and a Hard Disk Drive (HDD) 26 as a storage means for storing various programs and data.

[0028] The HDD26 stores singing video data transmitted from the mobile terminal 3A, i.e., singing video data uploaded to video sharing sites, as well as song data indicating songs that the singing user can sing. The storage means is not limited to the HDD26; other storage media such as semiconductor memory like flash memory may also be used.

[0029] Furthermore, the server 4 includes an input unit 28 consisting of a keyboard and mouse, etc., which accepts input for various operations; a monitor 30 such as a liquid crystal display device that displays various images; and an external interface 32 that is connected to other information processing devices such as a mobile terminal 3 via a communication line 2 and transmits and receives various data with other information processing devices.

[0030] The CPU 20, ROM 22, RAM 24, HDD 26, operation input unit 28, monitor 30, and external interface 32 are electrically connected to each other via the system bus 34. Therefore, the CPU 20 can access the ROM 22, RAM 24, and HDD 26, understand the operation status of the operation input unit 28, display images on the monitor 30, and send and receive various types of data with other information processing devices via the external interface 32.

[0031] [3. Electrical configuration of mobile devices] Figure 3 is a functional block diagram showing the electrical configuration of the mobile terminal 3.

[0032] In addition to the configuration shown in Figure 1, the mobile terminal 3 includes a main control unit 40, a main memory unit 42, an auxiliary memory unit 44, a communication unit 46, and operation buttons 48.

[0033] The main control unit 40 is, for example, a CPU, microprocessor, or DSP (Digital Signal Processor), and controls the overall operation of the mobile terminal 3.

[0034] The main memory unit 42 is composed of, for example, RAM or DRAM (Dynamic Random Access Memory), and is used as a work area when the main control unit 40 executes processing based on various programs.

[0035] The auxiliary storage unit 44 is a non-volatile memory such as flash memory, and stores various data such as images and programs used for processing by the main control unit 40. The programs stored in the auxiliary storage unit 44 include, for example, the OS (Operating System) for realizing the basic functions of the mobile terminal 3, drivers for controlling various hardware, programs for email and web browsing, and other various functions. The auxiliary storage unit 44 also stores applications for shooting and posting singing videos and viewing video sharing sites. (Hereinafter referred to as the "video posting and viewing app") is pre-programmed.

[0036] The communication unit 46 is, for example, a NIC (Network Interface Controller) and has the function of connecting to the communication line 2. Alternatively, the communication unit 46 may have functions to connect to a wireless LAN (Local Area Network), a wireless WAN (Wide Area Network), short-range wireless communication such as Bluetooth®, and infrared communication, either in place of or together with the NIC.

[0037] The operation buttons 48 are located on the side of the mobile terminal 3 and include a power button for starting or stopping the mobile terminal 3, and a volume control button for the sound output by the speaker 3b.

[0038] The main control unit 40, main memory unit 42, auxiliary memory unit 44, communication unit 46, operation buttons 48, touch panel display 3a, speaker 3b, microphone 3c, camera 3d, and earphone terminal 3e are electrically connected to each other via a system bus 49. Therefore, the main control unit 40 can access the main memory unit 42 and auxiliary memory unit 44, display images on the touch panel display 3a, understand the user's operation status on the touch panel display 3a and operation buttons 48, input sound to the microphone 3c, output sound from the speaker 3b or earphones connected to the earphone terminal 3e, control the camera 3d, and access various communication networks and other information processing devices via the communication unit 46.

[0039] [4. Filming of singing videos by singing users] This section explains how a singing user can record a singing video using a mobile device 3A.

[0040] When a singing user records a singing video, they launch a video posting and viewing app on their mobile device 3A. When the video posting and viewing app is launched, the mobile device 3A accesses server 4, which stores multiple song data files. The singing user then selects a song to sing from the video posting and viewing app and downloads the song data from server 4 to the mobile device 3A. The singing user then uses the video posting and viewing app to play the song at any time and sing. The video posting and viewing app starts playing the song and simultaneously starts recording the video using camera 3d. In other words, the singing video is a video recorded by the mobile device 3A while the song is playing from the mobile device 3A.

[0041] Furthermore, the song data is associated with the lyrics data, and when the song data is downloaded from server 4 to mobile device 3A, the associated lyrics data is also downloaded to mobile device 3A. In the following explanation, it will be assumed that the song data includes the lyrics data.

[0042] Figure 4 shows an example of the display state on screen 3a of the mobile device 3A when recording a singing video (hereinafter referred to as "screen display").

[0043] As shown in Figure 4, screen 3a is divided into a lyrics display area 50A and a captured image display area 50B. The lyrics display area 50A includes a lyrics image 52 showing the lyrics of the song the user is singing, a pitch image 54 showing the pitch of the song, and a progress bar 56 showing the progress of the capture.

[0044] The lyrics image 52 and the pitch image 54 are updated according to the progress of the song. In this embodiment, as an example, the lyrics image 52 and the pitch image 54 are updated every few phrases and displayed in the lyrics display area 50A. The update timing of the lyrics image 52 and the pitch image 54 may be the same or different.

[0045] As an example, lyric image 52 displays lyrics in multiple lines (two lines in the example in Figure 4), and the color of the lyrics in the upper line changes from left to right in accordance with the progress of the song, so that the singing user can keep track of the lyrics they should be singing at any given time. When the color change of the lyrics in the upper line reaches the right edge, the lyrics in the lower line rise and are displayed in the upper line, and new lyrics are displayed in the lower line, and the color of the lyrics in the upper line changes again from left to right in accordance with the progress of the song.

[0046] In the pitch image 54, for example, multiple pitch bars 54A are displayed in a staircase-like pattern from left to right according to the strength of the pitch. To allow the singing user to understand the pitch of the lyrics they should be singing, the color of the pitch bars 54A changes from left to right as the song progresses, and the pointer 54B moves from left to right. When the color of the pitch bars 54A changes and the pointer 54B reaches the right end, the pitch image 54 indicating the next pitch is updated and displayed.

[0047] The progress bar 56, for example, shows the total length of the song from left to right. When playback of the song begins, the pointer 56A, which indicates the playback position of the song, moves from left to right, and the song ends when pointer 56A reaches the right end. Note that the progress bar 56 that pointer 56A has passed over is displayed thicker than its previous position.

[0048] Recording of the singing video begins after the singing user selects a song and clicks the recording start button (not shown) displayed on screen 3a, after a predetermined time interval (for example, 10 seconds). The start and end of the video recording may coincide with the start and end of the song, but is not limited to this; the video recording may start a predetermined time before the start of the song (for example, 5 seconds before) or end a predetermined time after the end of the song (for example, 5 seconds after).

[0049] The singing user connects earphones to the earphone jack 3e and listens to the music being played using the earphones, singing along to the music. The mobile terminal 3A photographs the singing user with the camera 3d and records the singing user's singing with the microphone 3c. In other words, the microphone 3c does not capture the sound of the music being played. The mobile terminal 3A then records the singing user's voice captured by the microphone 3c and uses it as singing data.

[0050] Furthermore, the singing data may be filtered to extract the frequency range of the human voice. This filtering process removes noise originating from the singing user's surrounding environment, resulting in a clearer recording of the user's voice.

[0051] The video posting and viewing app then combines the music data, singing data, and recording data to create singing video data that can be sent to server 4. The user can, for example, choose one of the following two timings for sending the singing video data to server 4, i.e., uploading it to the video posting site.

[0052] One method is live streaming, where the singing user uploads the singing video data to a video sharing site in real time while singing. In live streaming, viewers watch the singing user's performance in real time. The other method is non-live streaming, where the singing user uploads the singing video data to a video sharing site at a time of their choosing after the song has been sung.

[0053] When a singing user is performing a live stream, they should configure the settings for live streaming before recording the singing video, so that the singing video data is uploaded to the video sharing site as soon as the video recording starts. In the case of live streaming, the singing video data may be uploaded to the video sharing site without being stored on the mobile device 3A.

[0054] Furthermore, when conducting a live stream, the singer can choose between two settings: a first live stream setting that allows viewers to watch the singing video during the live stream, and a second live stream setting that allows viewers to watch the singing video even after the live stream has ended. In other words, with the first live stream setting, the singing video data is deleted from server 4 when the live stream ends, and viewers cannot watch the live-streamed singing video after the live stream has ended. On the other hand, with the second live stream setting, server 4 continues to store the singing video data even after the live stream has ended, so viewers can watch the singing video as a non-live stream even after the live stream has ended.

[0055] In the case of non-live streaming, the singing video data is temporarily stored on the mobile device 3A, and the singing user can upload the singing video to a video sharing site at any time by operating the video posting and viewing app.

[0056] [5. Viewing of singing videos by viewers] This section explains how viewers can watch singing videos using a mobile device (3B).

[0057] When a user wants to watch a singing video, they launch a video posting and viewing app on their mobile device 3B. When the video posting and viewing app is launched, the mobile device 3B accesses server 4, which stores data on multiple singing videos, i.e., a video posting site. The user then selects the singing video they want to watch via the video posting and viewing app and displays it on screen 3a. One example of the method used by server 4 to deliver singing videos to mobile device 3B is streaming.

[0058] Figure 5 shows an example of the screen display on mobile device 3B when viewing a singing video, specifically when a live stream is taking place.

[0059] Screen 3a displays a singing video and also includes a singing user display area 50C, a lyrics display area 50D, and a comment input display area 50E. The singing user display area 50C, the lyrics display area 50D, and the comment input display area 50E may be displayed superimposed on the singing video.

[0060] The singing user display area 50C displays the username of the singing user who posted the singing video, whether or not it is a live stream, and the name of the song being sung.

[0061] The lyrics display area 50D displays the lyrics of the singing video. For example, the displayed lyrics are shown in multiple phrases, and the color of the lyrics changes from left to right in accordance with the progress of the song. For example, the lyrics display area 50D may also display the lyrics in multiple lines. In this case, when the color change of the lyrics in the upper line reaches the right edge, the lyrics in the lower line move up and are displayed in the upper line, and new lyrics are displayed in the lower line, and the color of the lyrics in the upper line changes again from left to right in accordance with the progress of the song.

[0062] The comment input display area 50E displays a comment input field, along with comments from viewers watching the singing video, along with their usernames. For example, each time a viewer enters a comment, that comment is added to the top of the comment input display area 50E, and the previously displayed comments are shifted down. If the comments can no longer be displayed in the comment input display area 50E, a scroll bar (not shown) will appear on the right side of the comment display area, and viewers can use this scroll bar to display comments that were not previously shown on screen 3a.

[0063] Furthermore, screen 3a displays operation icons 58A to 58D for the viewer to perform various operations.

[0064] Operation icon 58A is clicked by viewers when they feel a connection to or appreciation of a singing video they are watching. The total number of clicks on operation icon 58A for that singing video is displayed above operation icon 58A.

[0065] Operation icon 58B is clicked when a viewer requests a singing user who is live-streaming a singing video displayed on screen 3a to participate in a singing battle (hereinafter referred to as "singing battle"). Singing battle involves simultaneously displaying multiple singing videos (first singing video, second singing video) by different singing users on screen 3a of the viewer's mobile device 3B, with the singing videos alternating between the two users singing the same song. In other words, a viewer who clicks operation icon 58B becomes a singing user participating in a singing battle.

[0066] Operation icon 58C is the icon that viewers click when they want to adjust various settings for the video posting and viewing app.

[0067] Operation icon 58D is an icon that viewers click when they want to overlay a decorative image onto the singing video displayed on screen 3a. In this embodiment, the decorative images have a price determined by their type and can be purchased by viewers through a fee. By clicking operation icon 58D, viewers can overlay a decorative image onto the singing video they are watching. The singer of the singing video on which the decorative image has been overlaid receives money from the video sharing site operator corresponding to the overlaid decorative image. In other words, the overlaying (display instruction) of a decorative image onto a singing video by a viewer is equivalent to a tip to the singer.

[0068] [6. Overview of the competitive singing function] The video posting and viewing application according to this embodiment has a competitive function in which multiple users, who are performers, compete against each other to determine the superiority of their performance videos. The competitive function according to this embodiment is a type of so-called karaoke battle, and as illustrated in Figure 6, it is a competitive singing function that simultaneously displays multiple singing videos (first singing video 60A, second singing video 60B) by different singing users on the screen 3a of the viewing user's mobile terminal 3B. The competitive singing function is a function executed by the server 4.

[0069] Figure 6 shows the screen display of the viewing user's mobile device 3B during a competitive singing session. The "VS" display shown in Figure 6 is displayed at the start of the competitive singing session and disappears after a predetermined time has elapsed (for example, 3 seconds). The screen display of the singing user's mobile device 3A may be the same as in Figure 6, or other singing users participating in the competitive singing session may be displayed in a reduced size relative to the screen display shown in Figure 4 (see Figure 8 below).

[0070] For a competitive singing competition to take place, one singing user (hereinafter referred to as "First Singing User") must request another singing user (hereinafter referred to as "Second Singing User") to simultaneously stream their singing video (hereinafter referred to as "Competition Request"), and the Second Singing User must accept the Competition Request.

[0071] More specifically, the first singing user launches a video posting and viewing app on their mobile device 3A1 and sends a battle request to the second singing user who is live streaming a singing video using the video posting and viewing app. The battle request is sent by the first singing user clicking the operation icon 58B. The first singing user selects the song to be sung in the battle. Selected song Information indicating the "battle song" (title and artist name) is sent to the second singing user along with the battle request.

[0072] A battle request sent from mobile terminal 3A1 is transmitted to the second singing user's mobile terminal 3A2 via server 4. An image corresponding to the received battle request is displayed on screen 3a of mobile terminal 3A2, and the second singing user clicks on the designated image displayed on screen 3a if they accept the battle request.

[0073] Then, when the second singing user accepts the challenge request from the first singing user, the server 4 starts the singing battle by distributing the first singing video 60A by the first singing user and the second singing video 60B by the second singing user so that they are simultaneously displayed on the screen 3a of the mobile terminal 3B. This allows viewers to watch the singing battle (real-time battle) between the first and second singing users in real time. In the following explanation, the first singing video 60A and the second singing video 60B distributed during the singing battle will be collectively referred to as the singing battle video.

[0074] Thus, the competitive singing function accepts a request for a singing video battle from the first singing user to the second singing user, and when the second singing user accepts the battle request, it distributes the first singing video 60A and the second singing video 60B so that they are displayed simultaneously on the screen 3a of the mobile terminal 3B. Therefore, the competitive singing function enables singing users to compete with each other using their respective singing videos, and also enables viewers to simultaneously watch multiple competing singing videos.

[0075] Furthermore, it is conceivable that the second singing user may accept the battle request but not the battle song. In such cases, the battle singing function may have a function to send information indicating the change of battle song and the battle song selected by the second singing user from the second singing user's mobile terminal 3A2 to the first singing user's mobile terminal 3A1, and to request the first singing user's consent.

[0076] [6-1. Alternating singing in competitive singing] In the competitive singing function according to this embodiment, the first singing user and the second singing user take turns singing the same song (hereinafter referred to as "alternating singing").

[0077] Alternating singing may take the form of, for example, a first singer finishing an entire song before a second singer singing the same song in its entirety. However, the competitive singing function according to this embodiment, as shown in Figure 7, virtually divides the song into multiple regions and sets the order in which the singing users will perform in each of these divided regions 68 (hereinafter referred to as "alternating performance setting"). As a result, the first and second singers will alternately sing the same song according to the alternating performance setting, allowing viewers to clearly recognize the difference in singing ability between the first and second singers and enjoy competitive singing more. In the following explanation, the order in which the singing users perform will be referred to as the alternating singing order.

[0078] Furthermore, the competitive singing function, as an example, highlights the lyrics that the singing user is singing, thereby allowing the singing user to recognize the divided area 68 that they are singing. The highlighting can be achieved through changes in the color or thickness of the lyrics.

[0079] In the example shown in Figure 7, the divided regions 68 are set up so that the first and second singing users sing alternately, and a divided region 68 is also set up so that the first and second singing users sing together. The divided regions 68 are set in advance based on, for example, phrases, choruses, or measures of a song, and the duration of each divided region 68 does not necessarily have to be the same.

[0080] The alternating singing order is determined when the decision is made to perform a singing battle. For example, the first singing user who initiated the battle request sings first, and the second singing user sings afterward. The divided area 68 in which the first and second singing users sing together may be pre-set for each song.

[0081] Furthermore, the alternating singing order, which is set based on the divided areas, may change dynamically. For example, a singing user with a relatively high total score obtained through the voting function described later may sing in more divided areas 68. More specifically, the total score of each singing user (singing video) is compared at predetermined timings in the song, and the singing user with a relatively high total score sings in subsequent divided areas 68 consecutively. In this case, the maximum number of divided areas 68 that can be sung consecutively is predetermined.

[0082] As a result, singing users with relatively high total scores will have more divided areas 68 to sing in, while singing users with relatively low total scores will have fewer divided areas 68 to sing in. Therefore, singing users with relatively high total scores can better showcase their singing ability to viewers and attract them more.

[0083] 0 [6-2. Screen display and audio output in alternating singing] As mentioned above, Figure 6 shows the display screen of the viewer's mobile device 3B during a competitive singing session, with both the first singing video 60A and the second singing video 60B displayed at the same image size. For singing videos that are currently in progress, a display that allows the viewer to recognize it ("NOW PLAYING" in Figure 6) is shown.

[0084] In this context, singing videos or audio recordings that do not show actual singing are unlikely to be of interest to viewers and may distract viewers who are watching live singing.

[0085] Therefore, the competitive singing function according to this embodiment distributes singing videos to the mobile terminal 3B in such a way that the audio of the singing video in progress is output, while the audio of singing videos that are not currently in progress is not output. Furthermore, the server 4 distributes singing videos to the mobile terminal 3B in such a way that the singing video in progress is displayed larger on the screen 3a of the mobile terminal 3B than the singing video that is not currently in progress. As a result, viewers can watch competitive singing videos without their attention being distracted by singing videos that are not currently in progress.

[0086] Figure 8 shows an example of the screen display on the mobile terminal 3B during competitive singing. In the example in Figure 8, the first singing video 60A is in the process of singing, while the second singing video 60B is not in the process of singing. Therefore, the first singing video 60A is displayed enlarged (full screen), while the second singing video 60B is displayed reduced (windowed). The image size and display position on screen 3a when the singing video is displayed reduced may be predetermined, or the viewer may be able to change the image size and screen position as they wish.

[0087] Furthermore, the competitive singing function according to this embodiment distributes the singing videos to the mobile terminal 3B so that, based on the alternating singing order described above, audio output of the first singing video 60A and the second singing video 60B, or screen display of the first singing video 60A and the second singing video 60B, is performed.

[0088] Specifically, in the divided area 68 where the first singing user performs, the audio of the first singing video 60A is output and the first singing video 60A is displayed enlarged, while the audio of the second singing video 60B is not output and the second singing video 60B is displayed in a reduced size. Similarly, in the divided area 68 where the second singing user performs, the audio of the second singing video 60B is output and the second singing video 60B is displayed enlarged, while the audio of the first singing video 60A is not output and the first singing video 60A is displayed in a reduced size. Furthermore, in the divided area 68 where the first and second singing users perform together, as shown in Figure 6, the first singing video 60A and the second singing video 60B are displayed on the screen at the same image size and both have audio output.

[0089] Thus, the competitive singing function according to this embodiment controls the audio output and screen display of the competitive singing video based on the alternating performance settings described above. Therefore, even when displaying singing videos simultaneously, it is possible to easily control the output of the competitive singing video on the viewer's mobile terminal 3B.

[0090] [6-3. Voting function] The video posting and viewing app has a voting function that allows viewers to input their evaluations (hereinafter referred to as "votes") for each singing video in competitive singing via their mobile device 3B.

[0091] Voting is performed by viewers clicking on an operation icon 58A provided for each singing video, as shown in Figures 6 and 8. In other words, viewers click the operation icon 58A to indicate their positive evaluation of a singing video if they find it appealing or otherwise enjoyable. An image (hereinafter referred to as the "voting result image") 66 showing the evaluation results for each singing video is then delivered and displayed on the screen 3a of the mobile device 3B along with the singing video.

[0092] As described above, the voting function according to this embodiment allows viewers to evaluate competitive singing videos by clicking, for example, the operation icon 58A. This makes it easy for viewers to determine the superiority or inferiority of the singing performances when competitive singing takes place. Furthermore, viewers can evaluate both singing videos simultaneously.

[0093] The voting function accepts score inputs as votes and derives the total score entered during the streaming of the singing video (hereinafter referred to as "total evaluation score") as the evaluation result. The total evaluation score is the sum of the scores entered by multiple viewing users. The voting function then determines the winner of the singing competition based on the total evaluation score entered by the end of the singing competition. In other words, the singing user of the singing video with a relatively high total evaluation score is declared the winner. Thus, with the voting function according to this embodiment, multiple viewing users can cooperate in voting for the singing user (singing video) they support, making their supported singing user the winner, and thus viewers can empathize more with the singing user.

[0094] In this embodiment, the voting function inputs 1 point each time the operation icon 58A is clicked. The numbers (21 and 185) in the voting result image 66 shown in Figures 6 and 8 represent the total evaluation score for each singing user (singing video), and the bar image that extends to the left and right of screen 3a and has different hatching (colors) on the left and right sides shows the total evaluation score for each singing video relatively.

[0095] Furthermore, there is an upper limit (hereinafter referred to as the "click limit") on the number of times each viewer can click the operation icon 58A, and in this embodiment, the click limit is one click. When the click limit is reached, the operation icon 58D is displayed on screen 3a in place of the operation icon 58A, as shown in Figure 8.

[0096] By clicking the operation icon 58D, viewers can overlay decorative images (hereinafter referred to as "tipping effect images") onto the singing video corresponding to the clicked operation icon 58D. Thus, the voting function has a tipping effect function that accepts requests for tipping effect images to be overlaid on the singing video from the mobile device 3B and overlays the received tipping effect images onto the singing video. In the following explanation, the instruction (selection) of the display of tipping effect images by the viewer via the mobile device 3B will be referred to as tipping input, as described above.

[0097] In other words, viewers can decorate singing videos they find appealing by overlaying the tipping effect image 69 onto them, thus the tipping effect function can enhance the audience and the singing video itself during its distribution. The tipping effect function is a function that is executed by the server 4 in response to display instructions from viewers via the video posting and viewing app.

[0098] Figure 9 shows the screen display of the mobile device 3B when a viewer clicks the operation icon 58D, displaying several different tipping effect images 69 that the viewer can select. Each tipping effect image 69 has a point value assigned to it, and its design differs according to the point value. The viewer selects one of the multiple tipping effect images 69 displayed on the screen that can be obtained with the points they possess. Note that a different design means, for example, that the shape, color, or orientation is different.

[0099] For example, points are assigned a charge for each point, and viewers purchase points. The number of available tipping effect images 69 increases or decreases depending on the number of points the viewer possesses. When a viewer selects a tipping effect image 69, the points the viewer possesses decrease according to the points of the selected tipping effect image 69. Points can be increased not only through payment but also through the use of other online services, etc.

[0100] The tipping effect images 69 exemplified in Figure 9 consist of four types of spotlight images with different orientations and a widening base, and four types of combined spotlight images, each with a different color, created by combining multiple spotlight images. By using spotlight-like images for the tipping effect images 69, viewers can get the feeling that they are participating in a concert or similar event. Note that the tipping effect images 69 are not limited to the examples in Figure 9; other images may also be used.

[0101] Figure 10 shows an example of a singing video (hereinafter referred to as "effect-supervised singing video") in which a combined spotlight image is selected by the viewer as the tipping effect image 69, and the tipping effect image 69 is superimposed. The effect-supervised singing video can be viewed not only by the viewer who selected the tipping effect image 69, but also by other viewers who are watching the competitive singing.

[0102] Furthermore, the tipping effect function according to this embodiment can be applied to a singing video in which singing is taking place, and after a tip is entered, the tipping effect image 69 is superimposed on the singing video with virtually no delay. In other words, in the example in Figure 10, the viewer can superimpose the tipping effect image 69 onto the first singing video 60A, but cannot superimpose the tipping effect image 69 onto the second singing video 60B in which the singing user is not singing. More specifically, even if the viewer clicks the operation icon 58D corresponding to a singing video in which the singing user is not singing, the tipping effect function will not accept the click.

[0103] Furthermore, when the voting function receives a superimposed tipping effect image 69, it accepts the input of points corresponding to the tipping effect image 69 as an evaluation. In this embodiment, as an example, points corresponding to the tipping effect image are input as the evaluation score. That is, each time a tip is made, points corresponding to the tipping effect image 69 selected by the viewer are added to the total evaluation score mentioned above.

[0104] Thus, the voting function according to this embodiment can encourage viewers to make donations by accepting score inputs as evaluations in accordance with the superimposition of the donation effect image 69. There is no upper limit to the number of times each viewer can make a donation. In other words, viewers can increase the total evaluation score of singing videos that they sympathize with by clicking the operation icon 58D multiple times.

[0105] Furthermore, an image (icon image 64) representing viewers who have given a relatively higher rating (vote) to the singing video than other viewers, i.e., viewers who have entered a large number of points (hereinafter referred to as "high-rated users"), is displayed on the screen 3a of the mobile device 3B. This allows viewers to make other viewers aware of the singers they are supporting. In addition, viewers can also make singers aware that they are being supported.

[0106] In this embodiment of the voting function, the top three users with the highest scores are designated as highly-rated users, and their icon images 64 are displayed on screen 3a for each singing video. However, the number of highly-rated users whose icon images 64 are displayed is not limited to these three.

[0107] Furthermore, in this embodiment, the voting function inputs a score as an evaluation when the operation icon 58A is clicked and when a donation is made. However, it is not limited to these cases; for example, a score may be input as an evaluation when a donation is made, or a score may be input as an evaluation when the operation icon 58A is clicked.

[0108] [6-4. Other Features] Server 4 may store information for each singing user (hereinafter referred to as "singing user information") on HDD 26. Singing user information includes the number of fans a singing user has, the singing user's past battle record and win rate, and their favorite songs. The battle singing function may accept battle requests from a first singing user with a similar number of fans to a second singing user. The number of fans a singing user has is thought to vary depending on the singing user's singing ability. In this way, by making the number of fans similar a condition for accepting battle singing requests, it is possible to prevent battle singing between singing users with vastly different singing abilities.

[0109] More specifically, when the first singing user requests a battle from the second singing user, the battle singing function compares the number of fans of the first singing user with the number of fans of the second singing user. If the difference in the number of fans is within a predetermined threshold (for example, within ±20%), the battle request from the first singing user to the second singing user is accepted. The number of fans increases when a viewer registers that they are a fan of the singing user through the video posting and viewing app. There is no limit to the number of singing users that a viewer can register as a fan of.

[0110] Furthermore, the competitive singing function may accept battle requests even if the number of fans is similar, as long as other conditions are met. It may also accept battle requests even if the number of fans is not similar, as long as the second singer agrees. On the other hand, the competitive singing function may only accept battle requests from users with a similar number of fans. "Only" here means, for example, that battle requests from users with a different number of fans will not be accepted, even if other conditions are met.

[0111] Furthermore, the competitive singing feature may reward the winning singer in a competitive singing battle with a score based on the total evaluation points they receive from votes cast for themselves. This reward could be money, points usable on video sharing apps (video sharing sites), or other online services. Additionally, the winning singer in a competitive singing battle may receive a score based on the combined total of their own evaluation points and their opponent's evaluation points (a so-called winner-take-all system).

[0112] [7. Functionality block for competitive singing function] Figure 11 is a functional block diagram relating to the competitive singing function according to this embodiment. The CPU 20 of the server 4 includes a battle request reception unit 70, a battle acceptance determination unit 71, a battle setting unit 72, a video evaluation unit 73, a tipping effect superimposition unit 74, and a video distribution unit 75. The processing performed by each function of the server 4 is realized by programs stored in the HDD 26.

[0113] The battle request receiving unit 70 accepts battle requests from the first singing user to the second singing user. The battle request receiving unit 70 may also accept battle requests from the first singing user to the second singing user if the number of fans is similar.

[0114] The match acceptance determination unit 71 determines whether the second singing user has accepted the match request from the first singing user.

[0115] The battle setting unit 72 performs various settings for competitive singing, such as setting the song and the singing order. The battle setting unit 72 divides the song into multiple time-series areas and sets the order in which the singing users will sing (alternating singing order) for each area. The battle setting unit 72 may also dynamically change the alternating singing order set based on the divided areas 68.

[0116] The video evaluation unit 73 receives input of evaluations (scores) for each singing video distributed to the mobile terminal 3B, as well as the superimposition of tipping effect images 69 onto the singing videos (tipping input) from the mobile terminal 3B. The video evaluation unit 73 then calculates the total evaluation score entered during the distribution of the singing videos and determines the winner or loser of the singing competition.

[0117] The tipping effect overlay unit 74, upon receiving a tipping input, overlays a tipping effect image 69 corresponding to the received tipping input onto the singing video.

[0118] The video distribution unit 75 distributes the singing video to the mobile terminal 3B. Furthermore, if the second singing user accepts a battle request from the first singing user, the video distribution unit 75 distributes the first singing video 60A by the first singing user and the second singing video 60B by the second singing user so that they are simultaneously displayed on the screen 3a of the mobile terminal 3B. Additionally, the video distribution unit 75 distributes the battle singing video to the mobile terminal 3B such that the audio of the singing video currently in progress is output, while the audio of singing videos that are not currently in progress is not output, and the singing video currently in progress is displayed larger on the screen 3a than the singing videos that are not currently in progress.

[0119] [8. Flowchart for the competitive singing process] Figure 12 is a flowchart showing the flow of the competitive singing process according to this embodiment, which is executed by the CPU 20 of the server 4. The program for executing the competitive singing process according to this embodiment is stored in advance in a predetermined area of ​​the HDD 26.

[0120] First, in step S100, the battle request receiving unit 70 determines whether the first singing user has requested a battle from the second singing user. If the determination is positive, that is, if a battle request from the first singing user has been received, the system proceeds to step S102. On the other hand, if the determination is negative, the system waits until a battle request is received.

[0121] In step S102, the battle acceptance determination unit 71 determines whether the second singing user has accepted the battle request. If the determination is positive, the process proceeds to step S104; otherwise, the process returns to step S100.

[0122] In step S104, the battle setting unit 72 performs various settings for conducting the battle singing competition.

[0123] In the next step, S106, Video Distribution Department 75 will begin distributing videos of the competitive singing performances.

[0124] In the next step, S108, the video distribution unit 75 determines whether the song for the singing competition has finished. If the determination is positive, the system proceeds to step S110. If the determination is negative, the video distribution unit 75 continues to distribute the singing competition video until the song is finished.

[0125] In the next step, S110, the video distribution unit 75 finishes distributing the competitive singing video and returns to step S100.

[0126] As described above, the server 4 (competitive singing function) according to this embodiment receives a request for a competitive singing video from the first singing user to the second singing user, and when the second singing user accepts the request, it distributes the first singing video 60A and the second singing video 60B so that they are displayed simultaneously on the screen 3a of the mobile terminal 3B. Therefore, the server 4 (competitive singing function) according to this embodiment enables singing users to compete with each other using their respective singing videos, and also enables viewers to simultaneously view multiple competing singing videos.

[0127] [9. Flowchart of the voting process] Figure 13 is a flowchart showing the flow of the voting process according to this embodiment, which is executed by the CPU 20 of the server 4. The program for executing the voting process according to this embodiment is stored in advance in a predetermined area of ​​the HDD 26.

[0128] First, in step S200, the video evaluation unit 73 determines whether or not the competitive singing has started. If the determination is positive, the process proceeds to step S202. On the other hand, if the determination is negative, the process waits until the competitive singing begins.

[0129] In step S202, the video evaluation unit 73 determines whether or not the operation icon 58A was clicked by the viewer. If the determination is positive, the process proceeds to step 204; otherwise, the process proceeds to step S206.

[0130] In step S204, the video evaluation unit 73 derives the total evaluation score, and the video distribution unit 75 updates the display of the total evaluation score.

[0131] In step S206, the video evaluation unit 73 determines whether the user has clicked the operation icon 58D. If the determination is positive, the process proceeds to step S208; otherwise, the process proceeds to step S210.

[0132] In step S208, the tipping effect overlay unit 74 overlays the tipping effect image 69 selected by the viewer onto the target singing video, the video evaluation unit 73 derives a total evaluation score by adding points corresponding to the overlaid tipping effect image 69, and the video distribution unit 75 updates the display of the total evaluation score.

[0133] In the next step, S210, the video evaluation unit 73 determines whether there has been a change in the number of users who have given high ratings to the singing video. If the determination is positive, the process proceeds to step S212; if the determination is negative, the process proceeds to step S214.

[0134] In step S212, the video distribution unit 75 updates the display of the icon image 64 of the highly-rated user.

[0135] In step S214, the video distribution unit 75 determines whether the song for the singing competition has finished. If the determination is positive, the process proceeds to step S216; otherwise, it returns to step S202.

[0136] In step S216, the video evaluation unit 73 determines the winner based on the total evaluation score for each singing video, and the video distribution unit 75 distributes an image showing the result.

[0137] In the next step, S218, the video distribution unit 75 will end the distribution of the battle singing video and terminate the voting process.

[0138] As described above, the server 4 (voting function) according to this embodiment receives evaluations of each singing video distributed to the mobile terminal 3B from the mobile terminal 3B. Therefore, the server 4 (voting function) according to this embodiment makes it possible for viewers to easily judge the quality of performance videos distributed by multiple singing users.

[0139] [10. Other Embodiments] Although the present invention has been described above using the embodiments described above, the technical scope of the present invention is not limited to the scope described in the embodiments above. Various modifications or improvements can be made to the embodiments above without departing from the spirit of the invention, and such modified or improved forms are also included in the technical scope of the present invention. Furthermore, the embodiments above may be combined as appropriate.

[0140] For example, the above embodiment described a configuration in which two singing users perform a singing battle, but the present invention is not limited thereto. For example, a configuration in which three or more singing users perform a singing battle may also be used. In this configuration, one singing user may simultaneously request a battle from two or more other singing users, and a singing user who has received a battle request may further request a battle from other singing users.

[0141] Furthermore, in the above embodiment, a form was described in which the total evaluation score for each singing video is displayed as a bar image as the voting result image 66, but the present invention is not limited thereto. For example, instead of a bar image, the total evaluation score for each singing video may be displayed relatively using a pie chart.

[0142] Furthermore, although the above embodiment describes a configuration in which the winner and loser of a singing competition are determined by votes from viewers, the present invention is not limited thereto. For example, the singing competition function may have an automatic scoring function, and the winner and loser may be determined by the result of this automatic scoring function.

[0143] Furthermore, while the above embodiment describes a configuration in which the audio output and screen display of the first singing video 60A and the second singing video 60B are performed based on alternating performance settings, the present invention is not limited thereto. For example, the server 4 may perform image analysis (face recognition processing) on ​​the singing video transmitted from the mobile terminal 3A to determine which singing video has the mouth opened wider, and based on this determination result, it may perform the audio output and screen display of the first singing video 60A and the second singing video 60B. In other words, a singing video in which the mouth is opened relatively wider is determined to be a singing video in which the singing user is currently performing a song.

[0144] Furthermore, although the above embodiment described a real-time battle format as a competitive singing competition, the present invention is not limited thereto. For example, a first singer may request a battle against a singing video already recorded by another singer, enabling battles between live singing videos and recorded singing videos, or battles between recorded singing videos.

[0145] Furthermore, while the above embodiment described a form in which the performance is singing and the video uploaded to the video sharing site is a singing video, the present invention is not limited to this. For example, the performance may be dance and the video uploaded to the video sharing site may be a dance video, so the performance may be something other than singing.

[0146] Furthermore, the processing flow described in the above embodiments is merely an example, and unnecessary steps may be deleted, new steps added, or the processing order rearranged without departing from the spirit of the present invention. [Explanation of Symbols]

[0147] 3B Mobile terminals (terminal devices) 3a screen 4. Server (Information Processing Device) 26 HDD (storage means) 66 Voting results image (image showing evaluation results) 69. Tipping Effect Image (Decorative Image) 73. Video Evaluation Section (Evaluation Method) 74. Overlay section for coin toss effect (overlay means) 75. Video Distribution Section (Distribution Methods)

Claims

1. The processor comprises, The device displays a screen that divides the video content, in which the first user and the second user compete, into two separate areas: Area 1 and Area 2. The first voting target corresponding to the first user and the second voting target corresponding to the second user are displayed on the screen. The terminal accepts votes for the first voting target or the second voting target. Based on the votes received, update the score or rating of at least one of the first user and the second user in the content. When the number of votes reaches a predetermined limit, the system accepts the superposition of decorative images onto the video and superimposes the accepted decorative images onto the video. Information processing device.

2. The processor displays a screen on the terminal showing a video related to content in which the first user and the second user compete, divided into a first area and a second area. The processor displays the first voting target corresponding to the first user and the second voting target corresponding to the second user on the screen. The processor receives a vote from the terminal for the first voting target or the second voting target, The processor updates the score or rating of at least one of the first user and the second user in the content based on the received votes. The processor, when the number of votes reaches a predetermined upper limit, accepts the superposition of a decorative image onto the video and superimposes the accepted decorative image onto the video. Information processing methods.

3. The display shows a video related to content in which the first user and the second user compete, divided into a first area and a second area. The first voting target corresponding to the first user and the second voting target corresponding to the second user are displayed on the screen. A terminal equipped with the aforementioned display accepts votes for the first voting target or the second voting target. Based on the votes received, update the score or rating of at least one of the first user and the second user in the content. When the number of votes reaches a predetermined limit, the system accepts the superposition of decorative images onto the video and superimposes the accepted decorative images onto the video. A program that instructs the processor to perform a task.

4. The system comprises a server and a terminal, and the server is, The device displays a screen that divides the video content, in which the first user and the second user compete, into two separate areas: Area 1 and Area 2. The first voting target corresponding to the first user and the second voting target corresponding to the second user are displayed on the screen. The terminal accepts votes for the first voting target or the second voting target. Based on the votes received, update the score or rating of at least one of the first user and the second user in the content. When the number of votes reaches a predetermined limit, the system accepts the superposition of decorative images onto the video and superimposes the accepted decorative images onto the video. system.

Images