Information Processing Apparatus, Video Distribution Method, and Video Distribution Program
The system addresses complex evaluation in karaoke systems by allowing simultaneous video display and viewer scoring, facilitating easy determination of superiority and enhancing user engagement in video competitions.
Patent Information
- Application Number
- JP2024001417
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2024-01-09
- Publication Date
- 2025-07-09
- Estimated Expiration
- 2038-07-25
Smart Images

Figure 0007705095000001 
Figure 0007705095000002 
Figure 0007705095000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing device, a video distribution method, and a video distribution program. [Background technology]
[0002] 2. Description of the Related Art In recent years, online services such as websites (web pages, web services), online games, and application software (hereinafter referred to as "apps") that are distributed to information processing devices such as mobile terminals via computer networks have become widespread.
[0003] One of the online services is a video posting site where users can post videos that they have taken and other users can watch those videos. Users can also post performance videos, such as singing videos, on this video posting site. In addition, online services such as a competition between performance videos of different posters are also expected.
[0004] Here, Patent Document 1 discloses a karaoke machine in which the audience listening to the singer's singing in a karaoke booth or the like can participate in evaluating the singing. The karaoke machine plays a karaoke song and scores the singing by analyzing the frequency and volume of the singing voice. The audience members who are listening to the singing input their evaluation of the singing using their mobile phones directly to the karaoke machine or by accessing a compilation center. After the performance of the karaoke song is finished, the karaoke machine calculates a final evaluation by comprehensively evaluating the score obtained by its own scoring function and the evaluation input by the audience, and displays this on a monitor. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] JP 2003-233383 A Summary of the Invention [Problem to be solved by the invention]
[0006] Although the karaoke device disclosed in Patent Document 1 allows the audience to evaluate singing according to their own feelings, it requires effort to call a predetermined telephone number when they think the singing is good, and it is also complicated as a system. Further, for example, when two singers sing simultaneously, the audience does not make a determination of superiority or inferiority.
[0007] In view of such circumstances, the present invention has been made, and an object thereof is to provide an information processing apparatus, a video distribution method, and a video distribution program that enable other users to easily determine the superiority or inferiority of videos distributed by a plurality of users.
Means for Solving the Problems
[0008] In order to solve the above problems, the information processing apparatus, video distribution method, and video distribution program of the present invention employ the following means.
[0009] In order to solve the above problems, an "information processing apparatus" which is an aspect of the present invention is an information processing apparatus that distributes a video posted by a user to a terminal device, and includes a distribution means for distributing a plurality of the videos so as to be simultaneously displayed on the screen of the terminal device, and an evaluation means for receiving an input of an evaluation for each of the videos distributed to the terminal device from the terminal device.
[0010] In order to solve the above problems, a "video distribution method" which is an aspect of the present invention is a video distribution method for distributing a video posted by a user to a terminal device, and includes a first step of distributing a plurality of the videos so as to be simultaneously displayed on the screen of the terminal device, and a second step of receiving an input of an evaluation for each of the videos distributed to the terminal device from the terminal device.
[0011] To solve the above problems, in one aspect of the present invention, a "video distribution program" causes a computer included in an information processing apparatus that distributes videos posted by users to function as distribution means for distributing a plurality of the videos to be simultaneously displayed on the screen of the terminal device, and evaluation means for receiving an input of an evaluation for each of the videos distributed to the terminal device from the terminal device.
[0012] For the above "information processing apparatus", various technical limitations may be added as exemplified below. Also, technical limitations with the same gist may be added to the processing steps executed by the "video distribution method" and the functions of the "video distribution program".
[0013] The distribution means distributes an image indicating an evaluation result for each of the videos to the terminal device together with the videos.
[0014] The evaluation means receives an input of a score as the evaluation and derives the total score input during the distribution of the video.
[0015] The evaluation means includes superimposing means for receiving the superimposition of a decorative image on the video and superimposing the received decorative image on the video.
[0016] When the evaluation means receives the superimposition of the decorative image, it receives an input of a score corresponding to the decorative image as the evaluation.
[0017] The distribution means distributes an image indicating a viewer who has given a relatively higher evaluation to the video than other viewers to be displayed on the screen of the terminal device.
Advantages of the Invention
[0018] According to the present invention, there is an effect that other users can easily determine the superiority or inferiority of videos distributed by each of a plurality of users.
Brief Description of the Drawings
[0019]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Embodiments for Carrying Out the Invention
[0020] Hereinafter, an embodiment of an information processing apparatus, a video distribution method, and a video distribution program according to the present invention will be described with reference to the drawings.
[0021] In this embodiment, a performer records his / her performance as a video using a mobile terminal and transmits it to a server, thereby uploading it to a video posting site. The video (posted video) uploaded to the video posting site can be viewed via the mobile terminal. In this embodiment, the performance is singing, the performer is a singing user, and the video uploaded to the video posting site is a singing video. Also, a user who views the singing video uploaded to the video posting site is referred to as a viewing user.
[0022] [1. Configuration of Karaoke System] FIG. 1 is a schematic configuration diagram of a karaoke system 1 according to this embodiment. The karaoke system 1 includes a communication line 2, a plurality of mobile terminals 3 (mobile terminals 3A1, 3A2, 3B), and a server 4.
[0023] The communication line 2 forms a computer network and is, for example, a wide area communication line provided by an electric utility company.
[0024] The mobile terminal 3 is an information processing terminal such as a smartphone, a tablet terminal, or a notebook personal computer, and is used for a user to use an online service. The mobile terminal 3 includes a touch panel display 3a for displaying an image, a speaker 3b for outputting sound, a microphone 3c for inputting sound, a camera 3d for photographing a subject, and an earphone terminal 3e (not shown) to which an earphone is connected. Here, the photographing means that the camera 3d functions and the subject is displayed on the touch panel display 3a regardless of whether recording is performed. The touch panel display 3a includes, for example, an LCD (Liquid Crystal Display) and a touch sensor. The LCD displays various images, and the touch sensor receives various input operations performed using an indicator such as a finger, a stylus, or a pen. In the following description, the touch panel display 3a is also referred to as the screen 3a.
[0025] Server 4 is an information processing device that provides online services to mobile terminal 3 via communication line 2. In the example of FIG. 1, the singing user uploads the singing video (singing video data) to the video posting site by transmitting it from mobile terminal 3A to server 4. Then, the viewing user accesses the video posting site using mobile terminal 3B and views the singing video. Note that the singing user can also view the singing video uploaded by himself / herself by accessing the video posting site using mobile terminal 3A. In addition, it is also possible for the user of mobile terminal 3B to become a singing user and upload a singing video to the video posting site.
[0026] [2. Configuration of Server] FIG. 2 is a block diagram showing the electrical configuration of server 4 according to the present embodiment.
[0027] Server 4 according to the present embodiment includes a CPU (Central Processing Unit) 20 which is a main control unit that controls the operation of the entire server 4, a ROM (Read Only Memory) 22, a RAM (Random Access Memory) 24 used as a work area when the CPU 20 executes various programs, and an HDD (Hard Disk Drive) 26 as a storage means for storing various programs and various data.
[0028] The HDD 26 stores the singing video data transmitted from the mobile terminal 3A, that is, the singing video data uploaded to the video posting site, and music data indicating the music that the singing user can sing. Note that the storage means is not limited to the HDD 26, and may be other storage media such as a semiconductor memory such as a flash memory.
[0029] Furthermore, the server 4 includes an operation input unit 28 composed of a keyboard, a mouse, etc. for receiving inputs of various operations, a monitor 30 such as a liquid crystal display device for displaying various images, and is connected via a communication line 2 to other information processing devices such as a mobile terminal 3, and includes an external interface 32 for transmitting and receiving various data to and from other information processing devices.
[0030] These CPU 20, ROM 22, RAM 24, HDD 26, operation input unit 28, monitor 30, and external interface 32 are electrically connected to each other via a system bus 34. Therefore, the CPU 20 can access the ROM 22, RAM 24, and HDD 26, grasp the operation state of the operation input unit 28, display images on the monitor 30, and perform various data transmissions and receptions with other information processing devices via the external interface 32.
[0031] [3. Electrical Configuration of Mobile Terminal] FIG. 3 is a functional block diagram showing the electrical configuration of the mobile terminal 3.
[0032] In addition to the configuration shown in FIG. 1, the mobile terminal 3 includes a main control unit 40, a main memory unit 42, an auxiliary storage unit 44, a communication unit 46, and operation buttons 48.
[0033] The main control unit 40 is, for example, a CPU, a microprocessor, a DSP (Digital Signal Processor), etc., and controls the overall operation of the mobile terminal 3.
[0034] The main memory unit 42 is composed of, for example, a RAM or a DRAM (Dynamic Random Access Memory), etc., and is used as a work area, etc. when executing processes based on various programs by the main control unit 40.
[0035] The auxiliary storage unit 44 is a non-volatile memory such as a flash memory, and stores various data such as images and programs used for the processing of the main control unit 40. Programs stored in the auxiliary storage unit 44 are, for example, an OS (Operating System) for realizing basic functions of the mobile terminal 3, drivers for controlling various hardware, programs for realizing functions such as e-mail, web browsing, and other various functions. Also, in the auxiliary storage unit 44, there is an application (hereinafter referred to as the "video posting viewing application") stored in advance.
[0036] The communication unit 46 is, for example, a NIC (Network Interface Controller) and has a function of connecting to the communication line 2. Note that the communication unit 46 may have a function of connecting to a wireless LAN (Local Area Network), a function of connecting to a wireless WAN (Wide Area Network), a function enabling short-range wireless communication such as Bluetooth (registered trademark), and infrared communication, instead of or together with the NIC.
[0037] The operation button 48 is provided on the side surface of the mobile terminal 3 and is a power button for starting or stopping the mobile terminal 3, a volume adjustment button for the sound output from the speaker 3b, and the like.
[0038] The main control unit 40, main memory unit 42, auxiliary storage unit 44, communication unit 46, operation buttons 48, touch panel display 3a, speaker 3b, microphone 3c, camera 3d, and earphone terminal 3e are electrically connected to each other via a system bus 49. Therefore, the main control unit 40 can access the main memory unit 42 and the auxiliary storage unit 44, display an image on the touch panel display 3a, grasp the operation state of the touch panel display 3a and the operation buttons 48 by the user, input sound to the microphone 3c, output sound from the speaker 3b or earphones connected to the earphone terminal 3e, control the camera 3d, and access various communication networks and other information processing devices via the communication unit 46, etc.
[0039] [4. Shooting of singing video by singing user] The case where the singing user shoots a singing video using the mobile terminal 3A will be described.
[0040] When shooting a singing video, the singing user activates the video posting and viewing application on the mobile terminal 3A. When the video posting and viewing application is activated, the mobile terminal 3A accesses a server 4 that stores a plurality of music data. Then, the singing user arbitrarily selects a music for singing by himself / herself from the video posting and viewing application, and downloads the music data from the server 4 to the mobile terminal 3A. Then, the singing user uses the video posting and viewing application to play the music at an arbitrary timing and sing. The video posting and viewing application starts playing the music and starts shooting the video by the camera 3d. That is, the singing video is a video shot by the mobile terminal 3A while the music is being played from the mobile terminal 3A.
[0041] Note that the music data is also associated with the lyric data, and when the music data is downloaded from the server 4 to the mobile terminal 3A, the associated lyric data is also downloaded to the mobile terminal 3A. In the following description, it is assumed that the music data includes the lyric data.
[0042] FIG. 4 is an example of a display state (hereinafter referred to as "screen display") on the screen 3a of the mobile terminal 3A when shooting a singing video.
[0043] As shown in FIG. 4, the screen 3a is divided into a lyric display area 50A and a captured image display area 50B. The lyric display area 50A includes a lyric image 52 showing the lyrics of the song that the user sings, a pitch image 54 showing the pitch of the song, and a progress bar 56 showing the progress of shooting.
[0044] The lyric image 52 and the pitch image 54 are updated according to the progress of the song. In this embodiment, as an example, the lyric image 52 and the pitch image 54 are updated by several phrases and displayed in the lyric display area 50A. Note that the update timings of the lyric image 52 and the pitch image 54 may be the same or different.
[0045] The lyric image 52, as an example, displays the lyrics in multiple lines (two lines in the example of FIG. 4), and the color of the upper-line lyrics changes from the left end to the right end according to the progress of the song so that the singing user can grasp the lyrics that should be sung currently. When the color change of the upper-line lyrics reaches the right end, the lower-line lyrics rise and are displayed in the upper line, and new lyrics are displayed in the lower line. Then, the color of the upper-line lyrics changes from the left end to the right end again according to the progress of the song.
[0046] The pitch image 54, as an example, has a plurality of pitch bars 54A displayed in a stepped manner in the left-right direction according to the strength of the pitch. And so that the singing user can grasp the pitch of the lyrics that should be sung currently, the color of the pitch bar 54A changes from the left end to the right end according to the progress of the song, and the pointer 54B moves from the left end to the right end. When the color change of the pitch bar 54A and the pointer 54B reach the right end, a pitch image 54 showing the next pitch is updated and displayed.
[0047] The progress bar 56, as an example, has a length from the left end to the right end that indicates the length of the entire piece of music. When the playback of the music starts, a pointer 56A indicating the playback position of the music moves from the left end to the right end, and when the pointer 56A reaches the right end, the music ends. Note that the progress bar 56 through which the pointer 56A has passed is displayed thicker than its previous position.
[0048] The recording of the singing video starts after a predetermined time (for example, 10 seconds later) after the singing user clicks a recording start button (not shown) displayed on the screen 3a after selecting a piece of music. Also, the start and end of the video recording may coincide with the start and end of the music, but it is not limited to this. The video recording may start a predetermined time before the start of the music (for example, 5 seconds before), or the video recording may end a predetermined time after the end of the music (for example, 5 seconds later).
[0049] The singing user connects earphones to the earphone terminal 3e and listens to the music played through the earphones and sings along with the music. The mobile terminal 3A captures the singing user with the camera 3d and records the singing of the singing user with the microphone 3c. That is, the microphone 3c does not acquire the sound of the music being played. Then, the mobile terminal 3A records the singing voice of the singing user acquired by the microphone 3c as singing data.
[0050] Note that the singing data may be obtained by extracting the frequency band of the human voice through filtering processing. Due to this filtering processing, noise caused by the surrounding environment of the singing user is removed from the singing data, so that the singing voice of the recorded singing user becomes clearer.
[0051] Then, the video submission viewing application combines the music data and the singing data with the recording data to obtain singing video data that can be transmitted to the server 4. Note that the user can select one of the following two types as the timing of transmitting the singing video data to the server 4, that is, the timing of uploading to the video submission site.
[0052] One is a live stream where a singing user uploads singing video data to a video sharing site in real time while singing. In a live stream, viewing users will watch the singing by the singing user in real time. The other is a non-live stream where, after the singing of a song is completed, the singing user uploads the singing video data to the video sharing site at an arbitrary timing.
[0053] When the singing user conducts a live stream, settings for conducting the live stream are made before recording the singing video, so that the singing video data is uploaded to the video sharing site along with the start of video recording. In the case of a live stream, the singing video data may be uploaded to the video sharing site without being stored in the mobile terminal 3A.
[0054] As settings for a live stream, the singing user can set either a first live stream setting that enables viewing users to view the singing video during the live stream or a second live stream setting that enables viewing users to view the singing video even after the live stream. That is, in the first live stream setting, the singing video data is deleted from the server 4 when the live stream ends, and viewing users cannot view the singing video live-streamed after the end of the live stream. On the other hand, in the second live stream setting, the server 4 continues to store the singing video data even after the live stream ends, so viewing users can view the singing video as a non-live stream even after the end of the live stream.
[0055] When conducting a non-live stream, the singing video data is temporarily stored in the mobile terminal 3A, and the singing user uploads the singing video to the video sharing site at an arbitrary timing by operating the video posting and viewing application.
[0056] [5. Viewing of Singing Video by Viewing User] The case where a viewing user views a singing video using the mobile terminal 3B will be described.
[0057] When a viewing user watches a singing video, the user launches a video posting and viewing app on the mobile terminal 3B. When the video posting and viewing app is launched, the mobile terminal 3B accesses a server 4 that stores a plurality of singing video data, that is, a video posting site. Then, the viewing user selects a singing video to be viewed via the video posting and viewing app and displays it on the screen 3a. As an example of the method of delivering the singing video from the server 4 to the mobile terminal 3B, it is streaming delivery.
[0058] FIG. 5 is an example of the screen display of the mobile terminal 3B when watching a singing video, and shows the screen display when live delivery is being performed.
[0059] On the screen 3a, a singing video is displayed, and a singing user display area 50C, a lyrics display area 50D, and a comment input display area 50E are provided. The singing user display area 50C, the lyrics display area 50D, and the comment input display area 50E may be displayed superimposed on the singing video.
[0060] In the singing user display area 50C, the user name of the singing user who posted the singing video, a display indicating whether it is a live delivery, and the name of the song being sung are displayed.
[0061] In the lyrics display area 50D, the lyrics of the singing video are displayed. As an example, the displayed lyrics are in multiple phrases, and the color of the lyrics changes from the left end to the right end in accordance with the progress of the song. As an example, the lyrics display area 50D may display the lyrics in multiple lines. In this case, when the color change of the lyrics in the upper line reaches the right end, the lyrics in the lower line rise and are displayed in the upper line, and new lyrics are displayed in the lower line, and the color of the lyrics in the upper line changes from the left end to the right end again in accordance with the progress of the song.
[0062] In the comment input display area 50E, an input field for comments is displayed, and the comments of the viewing users watching the singing video are displayed together with the user names. As an example, every time a comment is input from a viewing user, the comment is additionally displayed at the uppermost row of the comment input display area 50E, and the comments displayed until then are scrolled downwards. When the comments cannot be fully displayed in the comment input display area 50E, a scroll bar (not shown) is displayed on the right side of the comment display area, and by operating the scroll bar by the viewing user, comments that have not been displayed on the screen 3a until then are displayed.
[0063] Furthermore, on the screen 3a, operation icons 58A to 58D for the viewing user to perform various operations are displayed.
[0064] The operation icon 58A is an icon that is clicked when the viewing user empathizes with the singing video being watched. The total number of clicks of the operation icon 58A for the singing video is displayed above the operation icon 58A.
[0065] The operation icon 58B is an icon that is clicked when the viewing user applies for a battle (hereinafter referred to as "battle singing") against the singing user who is live-streaming the singing video displayed on the screen 3a. Battle singing simultaneously displays a plurality of singing videos (the first singing video, the second singing video) by different singing users on the screen 3a of the viewing user's mobile terminal 3B, and the singing videos sing the same song alternately. That is, the viewing user who clicks the operation icon 58B becomes the singing user who performs battle singing.
[0066] The operation icon 58C is an icon that is clicked when the viewing user makes various settings for the video posting viewing application.
[0067] The operation icon 58D is an icon that is clicked by the viewing user when a decorative image is to be superimposed on the singing video displayed on the screen 3a. Note that the decorative images according to this embodiment are priced according to their type, and can be purchased by the viewing user for a fee. The viewing user then superimposes the decorative image on the singing video that he or she is viewing by clicking the operation icon 58D. The singing user of the singing video on which the decorative image is superimposed receives money according to the superimposed decorative image from the operator of the video posting site. In other words, the superimposition (display instruction) of a decorative image on a singing video by the viewing user corresponds to a so-called tipping to the singing user.
[0068] [6. Overview of the singing competition function] The video posting and viewing application according to this embodiment has a battle function in which multiple users, who are performers, compete with each other to see who can show the best performance video of their own. The battle function according to this embodiment is a kind of so-called karaoke battle, and is a singing battle function that simultaneously displays multiple singing videos (first singing video 60A, second singing video 60B) by different singing users on the screen 3a of the mobile terminal 3B of the viewing user, as exemplified in FIG. 6. The singing battle function is executed by the server 4.
[0069] Fig. 6 shows a screen display of the mobile terminal 3B of the viewing user in a singing battle. The "VS" display shown in Fig. 6 is displayed at the start of the singing battle, and is stopped a predetermined time after the singing battle starts (e.g., 3 seconds). The screen display of the singing user's mobile terminal 3A may be the same as that shown in Fig. 6, or may show other singing users who will be competing in the singing battle in a reduced size (see Fig. 8 described later) compared to the screen display shown in Fig. 4.
[0070] In order for a singing competition to take place, a singing user (hereinafter referred to as the "first singing user") makes a request (hereinafter referred to as a "match request") to another singing user (hereinafter referred to as the "second singing user") to simultaneously distribute a singing video, and the second singing user must agree to the match request.
[0071] More specifically, the first singing user starts a video submission viewing app on their mobile terminal 3A1, and uses the video submission viewing app to send a challenge request to the second singing user who is live streaming a singing video. The sending of the challenge request is done by the first singing user clicking on the operation icon 58B. The song to be sung in the challenge singing is selected by the first singing user. The information (title, singer name, etc.) indicating the selected song (hereinafter referred to as the "challenge song") is sent to the second singing user together with the challenge request.
[0072] The challenge request sent from the mobile terminal 3A1 is sent to the mobile terminal 3A2 of the second singing user via the server 4. An image corresponding to the received challenge request is displayed on the screen 3a of the mobile terminal 3A2, and when the second singing user approves the challenge request, the second singing user clicks on a predetermined image displayed on the screen 3a.
[0073] When the second singing user approves the challenge request from the first singing user, the server 4 starts the challenge singing by distributing the first singing video 60A by the first singing user and the second singing video 60B by the second singing user so that they are simultaneously displayed on the screen 3a of the mobile terminal 3B. As a result, the viewing user can view the challenge singing (real-time battle) by the first singing user and the second singing user in real time. In the following description, the first singing video 60A and the second singing video 60B distributed in the challenge singing are also collectively referred to as the challenge singing videos.
[0074] In this way, the challenge singing function accepts a challenge request for a singing video from the first singing user to the second singing user, and when the second singing user approves the challenge request, distributes the first singing video 60A and the second singing video 60B so that they are simultaneously displayed on the screen 3a of the mobile terminal 3B. Therefore, the challenge singing function enables singing users to compete with each other using their respective singing videos, and also enables viewing users to simultaneously view a plurality of competing singing videos.
[0075] In addition, it is also assumed that the second singing user accepts the battle request but does not accept the battle song. For such a case, the battle singing function may have a function of transmitting information indicating the change of the battle song and the battle song selected by the second singing user from the mobile terminal 3A2 of the second singing user to the mobile terminal 3A1 of the first singing user and requesting the acceptance of the first singing user.
[0076] [6-1. Alternate Singing in Battle Singing] In the battle singing function according to the present embodiment, the first singing user and the second singing user sing the same song alternately (hereinafter referred to as "alternate singing").
[0077] For example, alternate singing may be in a form in which the second singing user sings the entire same song after the first singing user finishes singing the entire song. However, in the battle singing function according to the present embodiment, as shown in FIG. 7, the song is virtually divided into a plurality of regions, and the order of the singing users who sing for each divided region 68 is set (hereinafter referred to as "alternate performance setting"). Thereby, since the first singing user and the second singing user sing the same song alternately according to the alternate performance setting, the viewing user can clearly recognize the difference in singing ability between the first singing user and the second singing user, and can enjoy the battle singing more. In the following description, the order of the singing users who sing is referred to as the alternate singing order.
[0078] As an example, the battle singing function causes the singing user himself / herself to recognize the divided region 68 in which he / she sings by highlighting the lyric part that the singing user sings himself / herself. The highlighting is a change in the color or thickness of the lyrics.
[0079] In the example of FIG. 7, the divided region 68 is set so that the first singing user and the second singing user sing alternately, and the divided region 68 in which the first singing user and the second singing user sing together is also set. The divided region 68 is preset based on, for example, the phrase, chorus, or measure of the song, and the time lengths of the respective divided regions 68 do not necessarily have to be the same.
[0080] The order of alternating singing is determined along with the decision to execute the competitive singing. For example, it is set such that the first singing user who made the competitive request sings first, and the second singing user sings later. Note that the split area 68 where the first singing user and the second singing user sing together may be preset for each piece of music.
[0081] Also, the order of alternating singing set based on the split area may change dynamically. For example, the more split areas 68 for a singing user with a relatively higher total score obtained by the voting function described later may increase. More specifically, the total scores for each singing user (singing video) are compared at each predetermined timing of the music, and the singing user with a relatively higher total score sings continuously in a plurality of subsequent split areas 68. In this case, the maximum number of consecutive split areas 68 in which singing is possible is predetermined.
[0082] As a result, the singing user with a relatively higher total score has more split areas 68 for singing, while the singing user with a relatively lower total score has fewer split areas 68 for singing. Therefore, the singing user with a relatively higher total score can better appeal their singing ability to the viewing users and attract the viewing users more.
[0083] 0 [6-2. Screen Display and Audio Output in Alternating Singing] As described above, FIG. 6 is the display screen of the mobile terminal 3B of the viewing user in the competitive singing, and both the first singing video 60A and the second singing video 60B are displayed in the same image size. And for the singing video during singing execution, a display recognizable to the viewing user ("NOW PLAYING" in FIG. 6) is performed.
[0084] Here, the singing video not in the execution of singing and its audio are not attractive to the viewing user, and may only distract the attention of the viewing user who is watching the singing in progress.
[0085] Therefore, the battle singing function according to the present embodiment distributes the singing videos to the mobile terminal 3B such that the sound of the singing video during singing is output, and the sound of the singing video not during singing is not output. Further, the server 4 distributes the singing videos to the mobile terminal 3B such that the singing video during singing is displayed larger on the screen 3a of the mobile terminal 3B than the singing video not during singing. By these means, the viewing user can view the battle singing video without being distracted by the singing video not during singing.
[0086] FIG. 8 is an example of the screen display of the mobile terminal 3B in battle singing. In the example of FIG. 8, since the first singing video 60A is in the middle of singing and the second singing video 60B is not in the middle of singing, the first singing video 60A is enlarged (full-screen display), while the second singing video 60B is reduced (window display). The image size and the display position on the screen 3a when the singing video is reduced may be determined in advance, or the viewing user may be able to change them to any image size and screen position.
[0087] Note that the battle singing function according to the present embodiment distributes the singing videos to the mobile terminal 3B such that the sound output of the first singing video 60A and the second singing video 60B, or the screen display of the first singing video 60A and the second singing video 60B, is performed based on the above-described alternating singing order.
[0088] That is, in the divided area 68 where the first singing user sings, the sound of the first singing video 60A is output and the first singing video 60A is enlarged, while the sound of the second singing video 60B is not output and the second singing video 60B is reduced. Also, in the divided area 68 where the second singing user sings, the sound of the second singing video 60B is output and the second singing video 60B is enlarged, while the sound of the first singing video 60A is not output and the first singing video 60A is reduced. Further, in the divided area 68 where the first singing user and the second singing user sing together, as shown in FIG. 6, the first singing video 60A and the second singing video 60B are displayed on the screen with the same image size and both are output with sound.
[0089] In this way, the battle singing function according to this embodiment controls the audio output and screen display of the battle singing video based on the above-described alternating performance setting. Therefore, even when simultaneously displaying singing videos, it is possible to easily control the output of the battle singing video on the mobile terminal 3B of the viewing user.
[0090] [6-3. Voting function] The video submission viewing application has a voting function that accepts input of an evaluation (hereinafter referred to as "voting") for each singing video in a battle singing from the mobile terminal 3B of the viewing user.
[0091] As shown in FIGS. 6 and 8, the voting is input by the viewer clicking on the operation icon 58A provided for each singing video. That is, when the viewing user empathizes with a singing video or the like, the viewing user clicks on the operation icon 58A as an indication of a favorable evaluation of the singing video. Then, an image (hereinafter referred to as a "voting result image") 66 showing the evaluation result for each received singing video is distributed so as to be displayed on the screen 3a of the mobile terminal 3B together with the singing video.
[0092] In this way, the voting function according to this embodiment enables the viewing user to evaluate the battle singing video by clicking on the operation icon 58A as an example. Therefore, when a battle singing is performed, it becomes possible for the viewing user to easily determine the superiority or inferiority of the singing. Note that the viewing user can evaluate one singing video and also evaluate the other singing video.
[0093] Note that the voting function accepts the input of points as votes and derives the total points (hereinafter referred to as "total evaluation score") input during the distribution of the singing video as the evaluation result. The total evaluation score is the sum of the points input by multiple viewing users. Then, the voting function determines the winner of the singing competition based on the total evaluation score input before the end of the singing competition. That is, the singing user of the singing video with a relatively high total evaluation score is regarded as the winner. Thus, according to the voting function according to this embodiment, multiple viewing users can cooperate to vote for the singing user (singing video) they support, so that the singing user they support can be the winner, and the viewing users can have more empathy for the singing user.
[0094] For the voting function according to this embodiment, 1 point is input each time the operation icon 58A is clicked once. The numbers (21 and 185) in the voting result image 66 shown in FIGS. 6 and 8 are the total evaluation scores for each singing user (singing video), and the bar images that extend to the left and right of the screen 3a and have different hatching (colors) on the left and right relatively show the total evaluation scores for each singing video.
[0095] In addition, an upper limit (hereinafter referred to as "click upper limit") is provided for the number of times each viewing user can click the operation icon 58A, and the click upper limit according to this embodiment is once. When the click upper limit is reached, as shown in FIG. 8, the operation icon 58D is displayed on the screen 3a instead of the operation icon 58A.
[0096] The viewing user can superimpose a decoration image (hereinafter referred to as "coin - input effect image") on the singing video corresponding to the clicked operation icon 58D by clicking the operation icon 58D. Thus, the voting function has a coin - input effect function that accepts the superimposition of the coin - input effect image on the singing video from the mobile terminal 3B and superimposes the received coin - input effect image on the singing video. Note that in the following description, the display instruction (selection) of the coin - input effect image by the viewing user via the mobile terminal 3B is referred to as coin - input as described above.
[0097] That is, the viewing user decorates the singing video by superimposing the coin effect image 69 on the singing video with which the user empathizes. Therefore, the coin effect function can liven up the viewers and the singing video itself during the distribution of the singing video. The coin effect function is a function executed by the server 4 in response to a display instruction from the viewing user via the video posting and viewing application.
[0098] FIG. 9 is a screen display of the mobile terminal 3B that transitions when the viewing user clicks the operation icon 58D, and a plurality of different coin effect images 69 that can be selected by the viewing user are displayed. Points are set for each of the coin effect images 69, and the designs are different according to the points. The viewing user selects one of the plurality of coin effect images 69 displayed on the screen that can be obtained with the points the user owns. Note that different designs mean, for example, different shapes, colors, or orientations.
[0099] As an example, the charge amount is determined for each point, and the viewing user purchases points, and the types of coin effect images 69 that can be selected increase or decrease according to the points the user owns. When a coin effect image 69 is selected by the viewing user, the points the viewing user owns decrease according to the points of the selected coin effect image 69. Note that the points may increase not only by purchase by charging but also by using other online services or the like.
[0100] The coin effect images 69 illustrated in FIG. 9 are four types of spotlight images with different spreads in the direction imitating a spotlight and four types of combined spotlight images with different colors by combining a plurality of spotlight images. By using an image imitating a spotlight as the coin effect image 69, the viewing user can feel as if participating in a concert or the like. Note that the coin effect image 69 is not limited to the example of FIG. 9, and other images may be used.
[0101] FIG. 10 shows an example of a singing video (hereinafter referred to as "effect-overlaid singing video") in which a combined spotlight image is selected by a viewing user as the coin-in effect image 69 and the coin-in effect image 69 is superimposed. The effect-overlaid singing video can be viewed not only by the viewing user who selected the coin-in effect image 69 but also by other viewing users who are watching the battle singing.
[0102] Note that the coin-in effect function according to the present embodiment can be performed on a singing video in which singing is being executed. After a coin-in input is made, the coin-in effect image 69 is superimposed on the singing video with a substantially time delay. That is, in the example of FIG. 10, the viewing user can superimpose the coin-in effect image 69 on the first singing video 60A, but cannot superimpose the coin-in effect image 69 on the second singing video 60B in which the singing user is not singing. More specifically, even if the viewing user clicks on the operation icon 58D corresponding to a singing video in which the singing user is not singing, the coin-in effect function does not accept the click.
[0103] In addition, when the voting function receives the superimposition of the coin-in effect image 69, it accepts the input of points corresponding to the coin-in effect image 69 as an evaluation. In the present embodiment, as an example, points corresponding to the coin-in effect image are input as the points of the evaluation. That is, every time a coin-in input is made, the points corresponding to the coin-in effect image 69 selected by the viewing user are added to the above-described total evaluation score.
[0104] As described above, the voting function according to the present embodiment can prompt the viewing user to make a coin-in input by accepting the input of points as an evaluation in response to the superimposition of the coin-in effect image 69. Note that there is no upper limit on the number of coin-in inputs possible for each viewing user. That is, the viewing user can increase the total evaluation score of the singing video with which he or she empathizes by clicking on the operation icon 58D many times.
[0105] Furthermore, an image (icon image 64) indicating a viewer who has given a relatively higher evaluation (vote) to a singing video compared to other viewers, that is, a viewer who has entered a large number of points (hereinafter referred to as a "high-evaluation user"), is displayed on the screen 3a of the mobile terminal 3B. As a result, a viewer can make other viewers recognize the singing user they are supporting. Also, a viewer can make the singing user recognize that they are being supported.
[0106] In the voting function according to this embodiment, the top three users with the largest number of entered points are regarded as high-evaluation users, and the icon images 64 of the high-evaluation users are displayed on the screen 3a for each singing video. However, the number of high-evaluation users whose icon images 64 are displayed is not limited to this.
[0107] Also, in the voting function according to this embodiment, points are entered as an evaluation when the operation icon 58A is clicked or when coin input is performed. However, this is not limited to this. For example, points may be entered as an evaluation when coin input is performed three times, or points may be entered as an evaluation when the operation icon 58A is clicked.
[0108] [6-4. Other functions] The server 4 may store information for each singing user (hereinafter referred to as "singing user information") in the HDD 26. The singing user information includes the number of fans the singing user has, the past battle results and winning rates of the singing user, and the songs the singing user is good at. And the battle singing function may accept a battle request from a first singing user to a second singing user whose number of fans is about the same. It is considered that the number of fans a singing user has also varies depending on the singing ability of the singing user. In this way, by setting the condition for accepting battle singing to be that the number of fans is about the same, it is possible to prevent battle singing between singing users with significantly different singing abilities.
[0109] More specifically, when the first singing user makes a challenge request to the second singing user, the battle singing function compares the number of fans of the first singing user and the number of fans of the second singing user, and when the difference in the number of fans is within a predetermined reference value (for example, within ±20%), the challenge request from the first singing user to the second singing user is accepted. Note that the number of fans increases when a viewing user registers via the video posting viewing app that they are a fan of the singing user. There is no limit to the number of singing users that a viewing user can register as a fan.
[0110] Note that even if the number of fans is similar, the battle singing function may accept a challenge request if other conditions are met, or may accept a challenge request even if the number of fans is not similar if the second singing user gives consent. On the other hand, the battle singing function may only accept challenge requests where the number of fans is similar. The "only" here means that, for example, even if other conditions are met, challenge requests where the number of fans is not similar are not accepted.
[0111] In addition, the battle singing function may give a singing user a reward according to the total evaluation score obtained by the singing user who won the battle singing through voting for themselves. The reward here may be money, points that can be used in the video posting viewing app (video posting site) or other online services, etc. Also, the singing user who won the battle singing may obtain a reward according to the score obtained by adding not only their own total evaluation score but also the total evaluation score of the battle opponent (so-called total take).
[0112] [7. Functional Blocks of the Battle Singing Function] FIG. 11 is a functional block diagram related to the battle singing function according to the present embodiment. The CPU 20 provided in the server 4 includes a challenge request reception unit 70, a challenge acceptance determination unit 71, a battle setting unit 72, a video evaluation unit 73, a coin effect superimposing unit 74, and a video distribution unit 75. The processing executed by each function provided in the server 4 is realized by a program stored in the HDD 26.
[0113] The battle request reception unit 70 receives a battle request from the first singing user to the second singing user. Note that the battle request reception unit 70 may receive a battle request from the first singing user to the second singing user where the number of fans is about the same.
[0114] The battle approval determination unit 71 determines whether the second singing user has approved the battle request from the first singing user.
[0115] The battle setting unit 72 performs various settings such as music settings and singing order settings for performing battle singing. The battle setting unit 72 divides a plurality of regions in time series for the music and sets the order of singing users (alternate singing order) to sing for each region. Further, the battle setting unit 72 may dynamically change the alternate singing order set based on the divided regions 68.
[0116] The video evaluation unit 73 receives the input of the evaluation (score) for each singing video distributed to the mobile terminal 3B and the superimposition (coin input) of the coin effect image 69 on the singing video from the mobile terminal 3B. Then, the video evaluation unit 73 derives the total evaluation score input during the distribution of the singing video and determines the victory or defeat of the battle singing.
[0117] When the coin effect superimposition unit 74 receives a coin input, it superimposes the coin effect image 69 corresponding to the received coin input on the singing video.
[0118] The video distribution unit 75 distributes the singing video to the mobile terminal 3B. Also, when the second singing user approves the battle request from the first singing user, the video distribution unit 75 distributes the first singing video 60A by the first singing user and the second singing video 60B by the second singing user to be simultaneously displayed on the screen 3a of the mobile terminal 3B. Further, the video distribution unit 75 distributes the battle singing video to the mobile terminal 3B such that the sound of the singing video during singing is output, the sound of the singing video not during singing is not output, and the singing video during singing is displayed larger on the screen 3a than the singing video not during singing.
[0119] [8. Flowchart of Battle Singing Process] FIG. 12 is a flowchart showing the flow of the battle singing process according to the present embodiment executed by the CPU 20 included in the server 4. A program for executing the battle singing process according to the present embodiment is stored in advance in a predetermined area of the HDD 26.
[0120] First, in step S100, the battle request reception unit 70 determines whether there is a battle request from the first singing user to the second singing user. If the determination is affirmative, that is, if a battle request from the first singing user is received, the process proceeds to step S102. On the other hand, if the determination is negative, the system waits until a battle request is received.
[0121] In step S102, the battle acceptance determination unit 71 determines whether the second singing user has accepted the battle request. If the determination is affirmative, the process proceeds to step S104. If the determination is negative, the process returns to step S100.
[0122] In step S104, the battle setting unit 72 performs various settings for the battle singing.
[0123] In the next step S106, the video distribution unit 75 starts distributing the battle singing video.
[0124] In the next step S108, the video distribution unit 75 determines whether the music of the battle singing has ended. If the determination is affirmative, the process proceeds to step S110. On the other hand, if the determination is negative, the video distribution unit 75 continues to distribute the battle singing video until the music ends.
[0125] In the next step S110, the video distribution unit 75 ends the distribution of the battle singing video and returns to step S100.
[0126] As described above, the server 4 (duel singing function) according to the present embodiment receives a duel request for a singing video from a first singing user to a second singing user, and when the second singing user accepts the duel request, the first singing video 60A and the second singing video 60B are distributed so as to be simultaneously displayed on the screen 3a of the mobile terminal 3B. Therefore, the server 4 (duel singing function) according to the present embodiment enables singing users to compete with each other's singing through their respective singing videos, and enables viewing users to simultaneously view a plurality of competing singing videos.
[0127] [9. Flowchart of Voting Process] FIG. 13 is a flowchart showing the flow of the voting process according to the present embodiment executed by the CPU 20 provided in the server 4. A program for executing the voting process according to the present embodiment is stored in advance in a predetermined area of the HDD 26.
[0128] First, in step S200, the video evaluation unit 73 determines whether or not the duel singing has started. If the determination is affirmative, the process proceeds to step S202. On the other hand, if the determination is negative, the process waits until the duel singing starts.
[0129] In step S202, the video evaluation unit 73 determines whether or not the operation icon 58A has been clicked by the viewing user. If the determination is affirmative, the process proceeds to step 204, and if the determination is negative, the process proceeds to step S206.
[0130] In step S204, the video evaluation unit 73 derives the total evaluation score, and the video distribution unit 75 updates the display of the total evaluation score.
[0131] In step S206, the video evaluation unit 73 determines whether or not the operation icon 58D has been clicked by the viewing user. If the determination is affirmative, the process proceeds to step S208, and if the determination is negative, the process proceeds to step S210.
[0132] In step S208, the coin - effect image 69 selected by the viewing user is superimposed on the target singing video by the coin - effect superimposing unit 74, and the video evaluation unit 73 derives the total evaluation score obtained by adding the score corresponding to the superimposed coin - effect image 69, and the video distribution unit 75 updates the display of the total evaluation score.
[0133] In the next step S210, the video evaluation unit 73 determines whether there has been a change in the highly - evaluated users for the singing video. If the determination is affirmative, the process proceeds to step S212; if the determination is negative, the process proceeds to step S214.
[0134] In step S212, the video distribution unit 75 updates the display of the icon image 64 of the highly - evaluated users.
[0135] In step S214, the video distribution unit 75 determines whether the song for the battle singing has ended. If the determination is affirmative, the process proceeds to step S216; if the determination is negative, the process returns to step S202.
[0136] In step S216, the video evaluation unit 73 determines the win - loss based on the total evaluation score for each singing video, and the video distribution unit 75 distributes an image showing the result.
[0137] In the next step S218, the video distribution unit 75 ends the distribution of the battle - singing video and ends this voting process.
[0138] As described above, the server 4 (voting function) according to this embodiment accepts the evaluation of each singing video distributed to the mobile terminal 3B from the mobile terminal 3B. Therefore, the server 4 (voting function) according to this embodiment enables the viewing user to easily determine the superiority or inferiority of the performance videos distributed by each of a plurality of singing users.
[0139] [10. Other Embodiments] As described above, the present invention has been explained using the above-described embodiments. However, the technical scope of the present invention is not limited to the scope described in the above embodiments. Various changes or improvements can be made to the above embodiments without departing from the gist of the invention, and the forms with such changes or improvements are also included in the technical scope of the present invention. Further, the above embodiments may be combined as appropriate.
[0140] For example, in the above embodiment, the form in which the battle singing is performed by two singing users has been described. However, the present invention is not limited to this. For example, the battle singing may be performed by three or more singing users. In the case of this form, a certain singing user may make a battle request to two or more other singing users at the same time, or the singing user who has received the battle request may further make a battle request to other singing users.
[0141] Further, in the above embodiment, the form in which the total evaluation score for each singing video is displayed as a bar image in the voting result image 66 has been described. However, the present invention is not limited to this. For example, instead of the bar image, the total evaluation score for each singing video may be relatively displayed as a pie chart.
[0142] Also, in the above embodiment, the form in which the victory or defeat of the battle singing is determined by the vote of the viewing users has been described. However, the present invention is not limited to this. For example, the battle singing function may have an automatic scoring function, and the victory or defeat may be determined based on the determination result by this automatic scoring function.
[0143] Also, in the above embodiment, the form in which the audio output and the screen display of the first singing video 60A and the second singing video 60B are performed based on the alternating performance setting has been described. However, the present invention is not limited to this. For example, the server 4 performs image analysis (face recognition processing) on the singing video transmitted from the mobile terminal 3A and determines the singing video in which the mouth is opened wider. Based on this determination result, the audio output and the screen display of the first singing video 60A and the second singing video 60B may be performed. That is, the singing video in which the mouth is relatively wide open is determined to be the singing video in which the singing user is performing singing.
[0144] Also, in the above-described embodiment, the form of real-time battle has been described as the battle singing, but the present invention is not limited thereto. For example, a first singing user may make a battle request for a singing video of another singing user that has already been recorded, and battles using a live singing video and a recorded singing video, or battles between recorded singing videos may be possible.
[0145] Also, in the above-described embodiment, the form in which the performance is singing and the video uploaded to the video posting site is a singing video has been described, but the present invention is not limited thereto. For example, the performance may be other than singing, such as making the performance a dance and making the video uploaded to the video posting site a dance video.
[0146] Also, the flow of each process described in the above embodiment is also an example, and unnecessary steps may be deleted, new steps may be added, or the processing order may be changed within the scope not departing from the gist of the present invention.
Explanation of Reference Numerals
[0147] 3B Mobile terminal (terminal device) 3a Screen 4 Server (information processing device) 26 HDD (storage means) 66 Voting result image (image showing evaluation result) 69 Coin insertion effect image (decoration image) 73 Video evaluation unit (evaluation means) 74 Coin insertion effect superimposing unit (superimposing means) 75 Video distribution unit (distribution means)
Claims
1. An information processing apparatus comprising a processor, wherein the processor distributes a distribution video including a first video by a first user and a second video by a second user to a terminal device, during the distribution of the distribution video, receives an input of a predetermined point for at least one of the first video and the second video from the terminal device, displays information indicating at least one user who has input a predetermined point for the target video among the first video and the second video together with the target video, when there is a second user who has input a higher point for the target video than the first user, preferentially displays the information indicating the second user together with the target video rather than the information indicating the first user, outputs the first video in a first mode and the second video in a second mode in a first period, and outputs the first video in the second mode and the second video in the first mode in a second period, An information processing apparatus.
2. When receiving an input of a predetermined point from the terminal device during the first period, specifying the first video as the target video, and when receiving an input of a predetermined point from the terminal device during the second period, specifying the second video as the target video, The information processing apparatus according to Claim 1.
3. A processor distributes a distribution video including a first video by a first user and a second video by a second user to a terminal device, the processor receives an input of a predetermined point for at least one of the first video and the second video from the terminal device during the distribution of the distribution video, the processor displays information indicating at least one user who has input a predetermined point for the target video among the first video and the second video together with the target video, the processor preferentially displays the information indicating the second user together with the target video rather than the information indicating the first user when there is a second user who has input a higher point for the target video than the first user, the processor outputs the first video in a first mode and the second video in a second mode in a first period, and outputs the first video in the second mode and the second video in the first mode in a second period, An information processing method.
4. Display a distribution video including a first video by a first user and a second video by a second user on a display During the display of the distribution video, accept an input of a predetermined point for at least one of the first video and the second video. Display information indicating at least one user who has input a predetermined point for the target video among the first video and the second video together with the target video. When there is a second user who has input a higher point for the target video than the first user, preferentially display the information indicating the second user together with the target video over the information indicating the first user. In the first period, output the first video in the first mode and the second video in the second mode, and in the second period, output the first video in the second mode and the second video in the first mode. A program for causing a processor to execute the process.
5. Comprising a server and a terminal device. The server is Distribute a distribution video including a first video by a first user and a second video by a second user to the terminal device. During the distribution of the distribution video, accept an input of a predetermined point for at least one of the first video and the second video from the terminal device. Display information indicating at least one user who has input a predetermined point for the target video among the first video and the second video together with the target video. When there is a second user who has input a higher point for the target video than the first user, preferentially display the information indicating the second user together with the target video over the information indicating the first user. In the first period, output the first video in the first mode and the second video in the second mode, and in the second period, output the first video in the second mode and the second video in the first mode. System.
Citation Information
Patent Citations
Karaoke device
JP2003233383A
Display controller
JP2012198305A
Distribution system for fighting
JP2019211845A