Information processing device, information processing system, and information processing program

Abstract

To provide an information processing device, an information processing system, and an information processing program that allow a transmitting-side terminal device to recognize an image displayed on a receiving-side terminal device.SOLUTION: A mobile terminal 3A, which is a transmitting-side terminal device, is an information processing device that includes a first display control unit 75 and a first communication unit 77 and can communicate with a mobile terminal 3B, which is a receiving-side terminal device. The first display control unit 75 displays at least part of singing video on a display. The first communication unit 77 transmits at least part of the singing video to the mobile terminal 3B. The first display control unit 75 causes a display area of the singing video of the mobile terminal 3B to be displayed together with the singing video on a screen 3a.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing system, and an information processing program. [Background technology]

[0002] 2. Description of the Related Art Online services such as websites (web pages, web services), online games, and application software (hereinafter referred to as "apps") that are distributed to information processing devices such as mobile terminals via computer networks have become widespread.

[0003] One of the online services is a video posting site where users can post videos that they have taken and other users can watch those videos. Users can also post performance videos, such as singing videos, on the video posting site. There are also online services where users can compete against each other in performance videos of different posters.

[0004] Various proposals have been made regarding image capture techniques. For example, Patent Document 1 discloses a display control device equipped with a setting means for setting the type of auxiliary display related to the composition to be displayed on the display unit. The setting means separately sets a first auxiliary display in a still image mode and a second auxiliary display in a video mode.

[0005] Furthermore, Patent Document 2 discloses a safe area warning device which sets a predetermined angle of view range as a safe area when the angle of view range for capturing a subject to be photographed is limited to the angle of view range of the entire captured image captured by an imaging means, and which is provided with a warning means which issues a warning to that effect if it is determined that the AF frame is in danger of moving outside the safe area. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2016-123033 A [Patent Document 2] JP 2010-152135 A Summary of the Invention [Problem to be solved by the invention]

[0007] However, since the posted video displayed on the terminal device receiving the posted video cannot be recognized by the user who posted the video, the user who posts, i.e., sends an image, may not be able to post the video that he or she wants to be viewed by other users. The techniques of Patent Documents 1 and 2 cannot solve this problem.

[0008] SUMMARY OF THE PRESENT EMBODIMENTS An object of the present invention is to provide an information processing device, an information processing system, and an information processing program that enable a sending terminal device to recognize an image displayed on a receiving terminal device. [Means for solving the problem]

[0009] The information processing device of the present invention is an information processing device capable of communicating with a receiving terminal device, and is equipped with a display control unit that displays at least a part of the captured image on a display, and a communication unit that transmits at least a part of the captured image to the receiving terminal device, and the display control unit displays the display area of ​​the captured image on the receiving terminal device together with the captured image on the display. Effect of the Invention

[0010] According to the present invention, an image displayed on a receiving terminal device can be recognized on a sending terminal device. [Brief description of the drawings]

[0011] [Figure 1] 1 is a schematic diagram of a karaoke system according to an embodiment of the present invention; [Diagram 2] FIG. 2 is an explanatory diagram of an electrical configuration of the server. [Diagram 3] FIG. 2 is an explanatory diagram of the electrical configuration of the mobile terminal. [Figure 4]FIG. 11 is an explanatory diagram of a screen display of a mobile terminal when shooting a singing video. [Diagram 5] FIG. 11 is an explanatory diagram of the screen display of a mobile terminal that shoots a singing video when the display area of ​​the mobile terminal to be viewed is changed. [Figure 6] FIG. 2 is an explanatory diagram of a screen display on a mobile terminal for viewing. [Figure 7] FIG. 2 is an explanatory diagram of a screen display on a mobile terminal for viewing. [Figure 8] This is an explanatory diagram of the screen display in the case of a singing competition, which is displayed on the mobile device used for viewing. [Figure 9] FIG. 13 is an explanatory diagram of division of battle songs. [Figure 10] This is an explanatory diagram of the screen display in the case of a singing competition, which is displayed on the mobile device used for viewing. [Figure 11] FIG. 2 is a functional block diagram of a mobile terminal that transmits a singing video. [Figure 12] 13 is a flow diagram of a singing competition process in a mobile terminal that transmits a singing video. FIG. [Figure 13] FIG. 2 is a functional block diagram of a server. [Figure 14] A flow diagram of singing competition processing in the server. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] In this embodiment, a performer records his / her own performance as a video using a mobile terminal and transmits it to a server device, thereby uploading it to a video posting site. The video uploaded to the video posting site (posted video) can be viewed via a mobile terminal. In this embodiment, the performance is referred to as singing, the performer is referred to as a singing user, and the video uploaded to the video posting site is referred to as a singing video. Furthermore, a user who views a singing video uploaded to the video posting site is referred to as a viewing user. In this example, the video is transmitted from the singing user to the viewing user via the server device, but the video may also be transmitted from the singing user to the viewing user without passing through the server device.

[0013] Karaoke system 1 shown in Fig. 1 is an example of an embodiment of an information processing system. Karaoke system 1 includes mobile terminals 3A1, 3A2, and 3B, which are connected and capable of communicating with each other via communication line 2, and a server 4, which is an example of a server device. In the following description, when there is no need to distinguish between mobile terminal 3A1 and mobile terminal 3A2, they are collectively referred to as mobile terminal 3A, and when there is no need to distinguish between mobile terminal 3A and mobile terminal 3B, they are collectively referred to as mobile terminal 3.

[0014] The communication line 2 forms a computer network, and is, for example, a wide area communication line provided by an electric utility company.

[0015] The mobile terminal 3 is an example of a terminal device used by a user to utilize online services, and is, for example, an information processing terminal such as a smartphone, a tablet terminal, or a notebook computer. The mobile terminal 3 includes a touch panel display 3a for displaying images, a speaker 3b for outputting sound, a microphone 3c for inputting sound, a camera 3d for photographing a subject, and an earphone jack 3e for connecting earphones (not shown). Note that photographing here refers to a state in which the camera 3d is operating and the subject is displayed on the touch panel display 3a regardless of whether recording is being performed or not. The touch panel display 3a includes, for example, an LCD (Liquid Crystal Display) and a touch sensor. The LCD displays various images, and the touch sensor accepts various input operations performed using a pointing object such as a finger, a stylus, or a pen.

[0016] The server 4 is an information processing device that provides online services to the mobile terminal 3 via the communication line 2. In the example of FIG. 1, the singing user transmits his / her singing video (singing video data) from the mobile terminal 3A to the server 4, where the singing video is uploaded to a video posting site and distributed to the viewing user. The viewing user accesses the video posting site using the mobile terminal 3B, acquires the singing video, and views it. In this way, the mobile terminal 3A is a transmitting terminal device used by the singing user to transmit the singing video, and the mobile terminal 3B is a receiving terminal device used by the viewing user to receive the singing video. However, the singing user can view the singing video that he / she uploaded by accessing the video posting site using the mobile terminal 3A. In addition, the user of the mobile terminal 3B can also become a singing user and upload a singing video to the video posting site.

[0017] An example of the electrical configuration of the server 4 will be described with reference to Fig. 2. The server 4 includes a CPU (Central Processing Unit) 20 which is a main control unit for controlling the entire server 4, a ROM (Read Only Memory) in which various programs and various data are stored in advance, and a memory (RAM) 22 in which the server 4 is connected to the server. The computer includes a random access memory (RAM) 22, a random access memory (RAM) 24 used as a work area when the CPU 20 executes various programs, and a hard disk drive (HDD) 26 as storage means for storing various programs and various data.

[0018] The HDD 26 stores singing video data transmitted from the mobile terminal 3A, i.e., singing video data uploaded to a video posting site, song data indicating songs that the singing user can sing, etc. The storage means is not limited to the HDD 26, and may be, for example, another storage medium such as a semiconductor memory such as a flash memory.

[0019] Furthermore, the server 4 is equipped with an operation input unit 28 composed of a keyboard, a mouse, etc. and which accepts input of various operations, a monitor 30 such as a liquid crystal display device for displaying various images, and an external interface 32 which is connected to other information processing devices such as a mobile terminal 3 via the communication line 2 and which transmits and receives various data to and from the other information processing devices.

[0020] The CPU 20, ROM 22, RAM 24, HDD 26, operation input unit 28, monitor 30, and external interface 32 are electrically connected to one another via a system bus 34. Therefore, the CPU 20 can access the ROM 22, RAM 24, and HDD 26, grasp the operation state of the operation input unit 28, display images on the monitor 30, and transmit and receive various data to and from other information processing devices, etc. via the external interface 32.

[0021] The electrical configuration of the mobile terminal 3 will be described with reference to Fig. 3. The mobile terminal 3 includes a touch panel display (hereinafter referred to as "screen") 3a, a speaker 3b, a microphone 3c, a camera 3d, an earphone jack 3e, as well as a main control unit 40, a main memory unit 42, an auxiliary memory unit 44, a communication unit 46, and an operation button 48.

[0022] The main control unit 40 is, for example, a CPU, a microprocessor, a DSP (Digital Signal Processor), or the like, and controls the entire mobile terminal 3.

[0023] The main storage unit 42 is configured with, for example, a RAM or a DRAM (Dynamic Random Access Memory), and is used as a work area when the main control unit 40 executes processes based on various programs.

[0024] The auxiliary storage unit 44 is, for example, a non-volatile memory such as a flash memory, and stores various data such as images, programs used for processing by the main control unit 40, and the like. The programs stored in the auxiliary storage unit 44 are, for example, an OS (Operating System) for implementing basic functions of the mobile terminal 3, drivers for controlling various hardware, programs for implementing e-mail, web browsing, and various other functions, and the like. In addition, the auxiliary storage unit 44 prestores an application for shooting and posting singing videos and viewing video posting sites (hereinafter referred to as a "video posting and viewing application"). The auxiliary storage unit 44 is an information processing program for executing a display control step of displaying at least a part of the shot image (singing video) on a display and a communication step of transmitting at least a part of the shot image to a receiving terminal device (mobile terminal 3B), and the display control step stores an information processing program for displaying the display area of ​​the shot image in the receiving terminal device together with the shot image on a display.

[0025] The communication unit 46 is, for example, a network interface controller (NIC), and has a function of connecting to the communication line 2. Note that the communication unit 46 may have, instead of or together with the NIC, a function of connecting to a wireless local area network (LAN), a function of connecting to a wireless wide area network (WAN), and a function of enabling short-distance wireless communication such as Bluetooth (registered trademark), infrared communication, and the like.

[0026] The operation buttons 48 are provided on the side surface of the mobile terminal 3, and include a power button for starting and stopping the mobile terminal 3, a volume adjustment button for the sound output by the speaker 3b, and the like.

[0027] The main control unit 40, the main memory unit 42, the auxiliary memory unit 44, the communication unit 46, the operation buttons 48, the screen 3a, the speaker 3b, the microphone 3c, the camera 3d, and the earphone jack 3e are electrically connected to one another via a system bus 49. This allows the main control unit 40 to access the main memory unit 42 and the auxiliary memory unit 44, display images on the screen 3a, grasp the operation state of the screen 3a and the operation buttons 48 by the user, input sound to the microphone 3c, output sound from the speaker 3b or an earphone connected to the earphone jack 3e, control the camera 3d, and access various communication networks and other information processing devices via the communication unit 46.

[0028] When a singing user shoots a singing video, the singing user launches a video posting and viewing application on the mobile terminal 3A. When the video posting and viewing application is launched, the mobile terminal 3A accesses the server 4 that stores a plurality of pieces of music data. The singing user then arbitrarily selects a piece of music to sing from the video posting and viewing application, and downloads the music data from the server 4 to the mobile terminal 3A. The singing user then plays the music at a timing of his / her choice using the video posting and viewing application, and sings. When the video posting and viewing application starts playing the music, shooting of the video using the camera 3d starts. That is, the singing video is an image (hereinafter referred to as a "shot image") shot by the mobile terminal 3A while the music is being played from the mobile terminal 3A.

[0029] Note that song data is associated with lyrics data, and when song data is downloaded from the server 4 to the mobile terminal 3A, the associated lyrics data is also downloaded to the mobile terminal 3A. In the following description, song data is assumed to include lyrics data.

[0030] FIG. 4 is an example of a display on the screen 3a of the mobile terminal 3A (hereinafter referred to as "screen display") when a singing video is being filmed.

[0031] 4, a lyrics display area 50A and a captured image display area 50B are set on the image on the screen 3a of the mobile terminal 3A. The lyrics display area 50A includes a lyrics image 52 showing the lyrics of the song being sung by the user, a pitch image 54 showing the pitch of the song, and a progress bar 56 showing the progress of playback of the song.

[0032] The lyric image 52 and the pitch image 54 are updated as the playback of the music progresses. In the present embodiment, as an example, the lyric image 52 and the pitch image 54 are updated every few phrases and displayed in the lyric display area 50A. Note that the update timing of the lyric image 52 and the pitch image 54 may be the same or different.

[0033] The lyrics image 52 displays the lyrics in multiple rows (two rows in the example of FIG. 4), for example, and the color of the lyrics in the upper row changes from the left end to the right end in accordance with the progress of the music so that the singing user can visually grasp the lyrics that should currently be sung. When the color change of the lyrics in the upper row reaches the right end, the lyrics in the lower row rises and is displayed in the upper row, and new lyrics are displayed in the lower row, and the color of the lyrics in the upper row changes again from the left end to the right end in accordance with the progress of the music.

[0034] As an example, the pitch image 54 is displayed in a stepped manner in the left-right direction of the screen 3a as a plurality of pitch bars 54A corresponding to the pitch of the note. Then, in order to allow the singing user to visually grasp the pitch and pitch of the note that he or she is currently about to sing, the color of the pitch bars 54A changes from the left end to the right end as the song progresses, and the pointer 54B moves from the left end to the right end. When the color of the pitch bar 54A changes and the pointer 54B reaches the right end, the pitch image 54 indicating the next pitch is updated and displayed.

[0035] As an example, the length of the progress bar 56 from the left end to the right end indicates the time length of the entire song. When playback of the song starts, a pointer 56A indicating the playback position of the song moves from the left end to the right end, and the point where the pointer 56A reaches the right end corresponds to the end of playback of the song. Note that the progress bar 56 that the pointer 56A has passed through is displayed thicker than the position before the progress, but the display mode is not limited to this.

[0036] Playback of a song is started, for example, by tapping a play button (not shown) displayed on the screen 3a. When playback starts, the camera 3d (see Figs. 1 and 3) is activated, that is, turned on, and shooting begins. A captured image such as a singing video is displayed as a video image in the captured image display area 50B. This allows the singing user to adjust the position, direction, attitude, etc. of at least one of himself / herself and the mobile terminal 3A while looking at the captured image display area 50B or at any time to create a desired captured image. As a result, a captured image desired by the singing user is acquired on the mobile terminal 3A.

[0037] In the captured image display area 50B, the area (hereinafter referred to as "display area") RD of the singing video displayed on the screen 3a of the mobile terminal 3B (see FIG. 1) used by the viewing user for viewing is visible. The display area RD displayed in the captured image display area 50B at the start of shooting may be preset to an initial value (default) in the video posting and viewing app, or may be set at any timing by the server 4. In this example, in the case of a singing competition in which multiple singing users compete in singing, the display area RD at the start of shooting of the singing video is set by the server 4, but in the case of non-competitive singing that is not a singing competition, the display area RD at the start of shooting of the singing video is set to an initial value in the video posting and viewing app.

[0038] The singing video except for the display area RD is displayed on the screen 3a of the mobile terminal 3A as a part (hereinafter referred to as a "non-display area") RN that is not displayed on the screen 3a of the mobile terminal 3B (see FIG. 1) with a different image quality from that of the display area RD, thereby making the display area RD visible. Examples of image quality include hue, brightness, saturation, contrast, gradation, and transparency. In this example, the display area RD is displayed in a state where the transparency of the singing video is maintained, and the non-display area RN is displayed as a semi-transparent image with a lower transparency than the display area RD (an image masked to such an extent that the singing video in the background is visible), so that the display area RD is displayed visibly. Note that FIG. 4 illustrates an example in which the non-display area RN is located on both sides of the captured image display area 50B. That is, Figure 4 shows an example in which the vertical length (the length in the up-down direction in Figure 4) L1 of the display area RD is the same as the vertical length of the singing video, and the horizontal length (the length in the horizontal direction in Figure 4) L2 is shorter than the horizontal length of the singing video.

[0039] The display method of the display area RD is not limited to this example. For example, the display area RD may be displayed visibly by displaying a line segment indicating the boundary between the display area RD and the non-display area RN in the captured image display area 50B, or by displaying the four vertices of a rectangular display area as dots.

[0040] In this way, the display area RD of the mobile terminal 3B used by the viewing user is displayed on the mobile terminal 3A used by the singing user, and the singing user can recognize the display area RD, so that the singing user can take a subject image according to the display area RD. For example, the singing user takes a picture by adjusting the position, direction, posture, etc. of at least one of himself or herself and the mobile terminal 3A so that a desired part and area of ​​his or her body fits within the display area RD. As a result, the singing video desired by the singing user is reliably and easily acquired on the mobile terminal 3A.

[0041] The display area RD is displayed in a state where it is superimposed on the singing moving image in the captured image display area 50B. This allows the singing user to intuitively grasp the image seen by the viewing user when looking at the screen 3a.

[0042] It is preferable that the mobile terminal 3A is configured to be able to change the display area RD while maintaining the aspect ratio based on the display area RD. This allows the image of the singing video displayed on the mobile terminal 3B used by the viewing user to be adjusted by the mobile terminal 3A used by the singing user. The aspect ratio based on the display area RD is an aspect ratio calculated by the vertical length L1 and the horizontal length L2, and is calculated as L2 / L1. It may also be calculated as L1 / L2.

[0043] For example, when the singing user taps on the photographed image display area 50B, as shown in FIG. 5, a line segment LD showing the outline of the display area RD is displayed superimposed on the singing video. In this example, there are non-display areas RN on both sides, and the vertical length L1 is the same as the vertical length of the singing video, so that the vertical line portion LDv of the line segment LD is displayed extending in the vertical direction from the upper end to the lower end of the photographed image display area 50B, and the horizontal line portion LDs is displayed coinciding with the upper end edge and the lower end edge of the photographed image display area 50B. Then, by sliding (for example, swiping) a pointer such as a finger touching the screen 3a in the photographed image display area 50B from one of the four vertices of the display area RD toward the center GC, the display area RD can be changed to, for example, an area shown by a two-dot chain line, and the aspect ratio of the area shown by the two-dot chain line is the same as the aspect ratio based on the display area RD. FIG. 5 illustrates an example in which the vertical line portion LDv and the horizontal line portion LDs are displaced simultaneously so as to maintain the aspect ratio, with the center GC of the captured image display region 50B as the center of change of the display region RD.

[0044] The aspect ratio to be maintained is not limited to the aspect ratio based on the display area RD, and may be, for example, the aspect ratio based on the singing video. In addition, when the aspect ratio based on the display area RD is not maintained and the display area RD is changed, the vertical line portion LDv and the horizontal line portion LDs may be displaced independently. In this case, each of the two vertical line portions LDv may be displaced independently, and similarly, each of the two horizontal line portions LDs may be displaced independently.

[0045] The display area RD may be displaced while maintaining the shape and area of ​​the display area RD by sliding the entire line segment LD within the photographed image display area 50B. The movement ranges of the line segment LD, the vertical line portion LDv, and the horizontal line portion LDs, and the movement range of the sliding movement of the display area RD may be set to be limited. For example, the line segment LD, the vertical line portion LDv, and the horizontal line portion LDs are set not to be positioned in the central area including the center GC of the photographed image display area 50B, so that a non-display area RN is not formed in the central area.

[0046] Changes to the display area RD, for example, changing the display area RD while maintaining the aspect ratio based on the display area RD, or sliding the display area RD while maintaining the shape and size of the display area RD, can be made even while recording the singing video.

[0047] Furthermore, the mobile terminal 3A may be provided with a function, such as automatically detecting the positions of the singing user's eyes in the singing video and sliding the display area RD based on the detection signal, by a video posting and viewing application.

[0048] When the display area RD is changed (for example, when the display area RD is changed while maintaining the aspect ratio based on the display area RD, or when the display area RD is slid while maintaining the shape and size of the display area RD), it is preferable that the changed display area RD is notified to the mobile terminal 3B, and this is also done in this example.

[0049] The recording of the singing video starts a predetermined time (e.g., 10 seconds) after the singing user selects a song and taps a recording start button (not shown) displayed on the screen 3a. The start and end of the video recording may coincide with the start and end of the song, but the video recording may start a predetermined time (e.g., 5 seconds) before the start of the song, or end a predetermined time (e.g., 5 seconds) after the end of the song. The image to be recorded may be the singing video displayed in the entire captured image display area 50B, or at least a part of the singing video, such as only the display area RD of the singing video. In this example, the singing video displayed in the entire captured image display area 50B is recorded, and even if the singing video is recorded in this way, only the image of the display area RD is displayed on the screen 3a of the viewing user's mobile terminal 3B.

[0050] The singing user connects earphones to the earphone jack 3e, listens to the played music using the earphones, and sings along with the music. The mobile terminal 3A takes a picture of the singing user with the camera 3d and records the singing of the singing user with the microphone 3c. In other words, the microphone 3c does not capture the sound of the played music. The mobile terminal 3A then records the singing voice of the singing user captured by the microphone 3c, and creates singing data.

[0051] The singing data may be obtained by extracting the frequency band of the human voice through a filtering process, which removes noises caused by the surrounding environment of the singing user from the singing data, thereby making the recorded singing voice of the singing user clearer.

[0052] Then, the video posting and viewing application combines the music data and singing data with the recording data to generate singing video data that can be transmitted to the server 4. Note that, as an example, the singing user can select one of the following two types of timing for transmitting the singing video data to the server 4, i.e., the timing for uploading the data to the video posting site.

[0053] One is live distribution, in which a singing user uploads singing video data to a video sharing site in real time while singing. In live distribution, a viewing user watches the singing user sing in real time. The other is non-live distribution, in which a singing user uploads singing video data to a video sharing site at a timing of their choice after singing of a song is completed.

[0054] When performing live distribution, the singing user sets up the live distribution before recording, and uploads the singing video data to the video posting site when recording starts. In the case of live distribution, the singing video data may be uploaded to the video posting site without being stored in the mobile terminal 3A.

[0055] In addition, as settings for live streaming, a singing user can set either a first live streaming setting that allows viewing users to view the singing video in live streaming, or a second live streaming setting that allows viewing users to view the singing video even after the live streaming. That is, in the first live streaming setting, when the live streaming ends, the singing video data is deleted from the server 4, and the viewing users cannot view the live-streamed singing video after the live streaming ends. On the other hand, in the second live streaming setting, the server 4 continues to store the singing video data even after the live streaming ends, so that the viewing users can view the singing video as non-live streaming even after the live streaming ends.

[0056] In addition, when performing non-live distribution, the singing video data is temporarily stored in the mobile terminal 3A, and the singing user operates the video posting and viewing application to upload the singing video to the video posting site at any time.

[0057] A case where a viewing user views a singing video using the mobile terminal 3B will be described.

[0058] When the viewing user wishes to view a singing video, the viewing user launches a video posting viewing application on the mobile terminal 3B. When the video posting viewing application is launched, the mobile terminal 3B accesses a server 4 that stores multiple singing video data, i.e., a video posting site. Then, the viewing user selects the singing video he or she wishes to view via the video posting viewing application and displays it on the screen 3a. Note that, as an example, the method by which the server 4 distributes the singing video to the mobile terminal 3B is streaming distribution.

[0059] FIG. 6 is an example of a screen display of the mobile terminal 3B when watching a singing video, showing a screen display when live distribution is being performed.

[0060] The screen 3a displays a singing video and also has a singing user display area 50C, a lyrics display area 50D, and a comment input display area 50E. The singing user display area 50C, the lyrics display area 50D, and the comment input display area 50E may be displayed superimposed on the singing video as shown in Fig. 6, or may be displayed in an area separate from the video display area (not shown) where the singing video is displayed.

[0061] The singing user display area 50C displays the username of the singing user who posted the singing video, an indication of whether or not the video is being distributed live, and the name of the song being sung.

[0062] The lyrics of the singing video are displayed in the lyrics display area 50D. As an example, the lyrics displayed are multiple phrases at a time, and the color of the lyrics changes from the left end to the right end as the music progresses. As an example, the lyrics display area 50D may display lyrics in multiple rows. In this case, when the color change of the lyrics in the upper row reaches the right end, the lyrics in the lower row rises and is displayed in the upper row, and new lyrics are displayed in the lower row, and the color of the lyrics in the upper row changes again from the left end to the right end as the music progresses.

[0063] In the comment input display area 50E, a comment input field is displayed, and comments from viewing users who are viewing the singing video are displayed together with their user names. As an example, each time a comment is input from a viewing user, the comment is additionally displayed at the top of the comment input display area 50E, and comments that were previously displayed are moved down. When the comments cannot be displayed in the comment input display area 50E, a scroll bar (not shown) is displayed on the right side of the comment display area, and comments that were not displayed on the screen 3a until then are displayed by the viewing user operating the scroll bar.

[0064] Furthermore, on the screen 3a, operation icons 58A to 58D are displayed which allow the viewing user to carry out various operations.

[0065] The operation icon 58A is an icon that is tapped when the viewing user feels empathy or the like with the singing video that the viewing user is viewing, and the total number of taps on the operation icon 58A for the singing video is displayed above the operation icon 58A.

[0066] The operation icon 58B is an icon that is tapped when the viewing user challenges a battle (hereinafter referred to as "battle singing") against a singing user who is live-streaming a singing video displayed on the screen 3a. A battle singing is when multiple singing videos (first singing video, second singing video) by different singing users are simultaneously displayed on the screen 3a of the viewing user's mobile terminal 3B, and the singing videos take turns singing the same song. That is, the viewing user who taps the operation icon 58B becomes a singing user who will engage in a battle singing, and the mobile terminal 3B that is being used functions as the mobile terminal 3A after tapping the operation icon 58B.

[0067] The operation icon 58C is an icon that is tapped when the viewing user performs various settings for the video posting / viewing application.

[0068] The operation icon 58D is an icon tapped by the viewing user when superimposing an ornamental image on the singing video displayed on the screen 3a. Note that the ornamental images according to this embodiment are priced according to their type, and can be purchased by the viewing user for a fee. The viewing user then superimposes an ornamental image on the singing video that he or she is viewing by tapping the operation icon 58D. The singing user of the singing video on which the ornamental image is superimposed receives money according to the superimposed ornamental image from the operator of the video posting site. In other words, the superimposition (display instruction) of an ornamental image on a singing video by the viewing user corresponds to a so-called tipping to the singing user.

[0069] The singing video is an image that is contained within the display area RD on the mobile terminal 3A. Since the singing user captures the image on the mobile terminal 3A while being aware of the display area RD, the viewing user can reliably view the singing video that the singing user desires. For example, if the singing user has most of the left half of his / her face outside the display area RD during recording, the singing video before displacement will not display most of the left half of the singing user's face on the screen 3a as shown in FIG. 6. However, if the mobile terminal 3A is displaced so that the singing user's face is closer to the center of the display area RD, the singing video will be displayed as an image in which the singing user's face is closer to the center of the screen 3a than in the aspect shown in FIG. 6, as shown in FIG. 7.

[0070] The singing competition function will be described. The video posting and viewing application according to this embodiment has a singing competition function that allows multiple users, who are performers, to compete with each other to see who can show the best performance video of their own. The singing competition function according to this embodiment is a type of karaoke battle, and is a singing competition function that simultaneously displays multiple singing videos (first singing video 60A, second singing video 60B) by different singing users on the screen 3a of the viewing user's mobile terminal 3B, as exemplified in FIG. 8. The singing competition function is executed by the server 4.

[0071] Fig. 8 is an example of a screen display of the mobile terminal 3B of the viewing user in a singing battle. The display "VS" shown in Fig. 8 means "versus" and is displayed at the start of the singing battle and is stopped a predetermined time (e.g., 3 seconds) after the singing battle starts. The screen display of the singing user's mobile terminal 3A after the singing battle starts may be, for example, the same as that shown in Fig. 8, or may be a screen display in which the other singing users who will be singing in the singing battle are displayed in a reduced size (see Fig. 10) compared to the screen display of the singing video as shown in Fig. 4.

[0072] In order for a singing competition to take place, a singing user (hereinafter referred to as the "first singing user") makes a request (hereinafter referred to as the "competition request") to another singing user (hereinafter referred to as the "second singing user") to simultaneously distribute singing videos. If the second singing user accepts the competition request, the singing competition begins, and if the second singing user does not accept, the singing competition does not begin.

[0073] More specifically, the first singing user starts a video posting and viewing application on his / her mobile terminal 3A1, and sends a battle request to a second singing user who is live streaming a singing video using the video posting and viewing application. The battle request is sent by the first singing user tapping the operation icon 58B. The first singing user selects the song to be sung in the battle singing. Information indicating the selected song (hereinafter referred to as the "battle song") (title and singer name) is sent to the second singing user together with the battle request.

[0074] The match request transmitted from the mobile terminal 3A1 is transmitted to the mobile terminal 3A2 of the second singing user via the server 4. An image corresponding to the received match request is displayed on the screen 3a of the mobile terminal 3A2, and if the second singing user accepts the match request, he / she taps, for example, a predetermined image displayed on the screen 3a.

[0075] Then, when the second singing user accepts the battle request from the first singing user, the server 4 starts the singing battle by distributing the first singing video 60A by the first singing user and the second singing video 60B by the second singing user so that they are simultaneously displayed on the screen 3a of the mobile terminal 3B. For example, the server 4 starts the singing battle by generating and distributing a composite image consisting of the first singing video 60A and the second singing video 60B. This allows the viewing user to watch the singing battle (real-time battle) between the first singing user and the second singing user in real time. In the following description, the first singing video 60A and the second singing video 60B distributed in the singing battle are collectively referred to as singing battle videos. The number of singing users who perform the singing battle may be three or more, and the number, arrangement, and size of the singing videos that compose the composite image may be set based on the number of singing users who perform the singing battle.

[0076] In this way, the singing competition function accepts a singing video competition request from the first singing user to the second singing user, and when the second singing user accepts the competition request, delivers the first singing video 60A and the second singing video 60B so that they are simultaneously displayed on the screen 3a of the mobile terminal 3B. Therefore, the singing competition function enables singing users to compete with each other by their own singing videos, and enables a viewing user to simultaneously view the competing singing videos.

[0077] It is also assumed that the second singing user may accept the battle request but not accept the battle song. For such a case, the battle singing function may have a function of transmitting information indicating the change in the battle song and the battle song selected by the second singing user from the mobile terminal 3A2 of the second singing user to the mobile terminal 3A1 of the first singing user, and requesting the first singing user's approval.

[0078] When a singing competition is started, the server 4 may change the display area RD of each of the first singing video 60A and the second singing video 60B in the mobile terminal 3B in order to generate a composite image, and this is also done in this example. When the server 4 changes the display area RD, it notifies the mobile terminal 3A in which the singing video that is the subject of the change was shot of the changed display area RD. The display area RD notified from the server 4 is displayed as a new display area RD in the shot image display area 50B (see FIG. 4) of the mobile terminal 3A that has received the notification. After this, the display area RD may be further changed in each mobile terminal 3A, and in this case, each mobile terminal 3A can change the display area RD to an area narrower than the display area RD notified from the server 4, and can displace (slide) the display area RD while maintaining the shape and area of ​​the display area RD.

[0079] In the singing battle function according to the present embodiment, a first singing user and a second singing user alternately sing the same piece of music (hereinafter referred to as "alternate singing").

[0080] The alternating singing may take the form of, for example, a first singing user finishing singing a song, and then a second singing user singing the same song in its entirety. However, the singing battle function according to this embodiment virtually divides a song into a number of regions on the time axis as shown in FIG. 9, and sets the order of singing users who will sing for each divided region 68 (hereinafter referred to as "alternating performance setting"). As a result, the first singing user and the second singing user will sing the same song in turn according to the alternating performance setting, so that the viewing user can clearly recognize the difference in singing ability between the first singing user and the second singing user, and can enjoy the singing battle even more. In the following description, the order of singing users who will sing will be referred to as the alternating singing order.

[0081] In addition, the singing battle function, for example, highlights the part of the lyrics that the singing user sings, thereby allowing the singing user to recognize the divided area 68 that he or she sings. The highlighting is performed by changing the color or thickness of the lyrics, or the like.

[0082] 9, divided areas 68 are set so that the first singing user and the second singing user sing alternately, and divided areas 68 are also set so that the first singing user and the second singing user sing together. The divided areas 68 are set in advance based on, for example, phrases, choruses, or bars of a song, and the time lengths of the divided areas 68 do not necessarily have to be the same.

[0083] The alternating singing order is determined when a singing battle is decided. For example, the order is set so that the first singing user who requested the battle sings first, and the second singing user sings afterwards. The divided area 68 in which the first singing user and the second singing user sing together may be set in advance for each song.

[0084] The screen display and audio output in the alternating singing will be described. Fig. 8 shows the display screen of the mobile terminal 3B of the viewing user in the singing battle, where the first singing video 60A and the second singing video 60B are displayed in the same shape and size. The singing video currently being sung is displayed in a way that allows the viewing user to recognize it (for example, the display of "NOW PLAYING" in Fig. 8).

[0085] Here, a singing video and its audio when singing is not currently being performed are not of interest to a viewing user and may distract the attention of a viewing user who is viewing singing that is currently being performed.

[0086] Therefore, the singing competition function according to the present embodiment delivers singing videos to the mobile terminal 3B so that the sound of the singing video in which singing is being performed is output and the sound of the singing video in which singing is not being performed is not output. Also, the server 4 delivers singing videos to the mobile terminal 3B so that the singing video in which singing is being performed is displayed larger on the screen 3a of the mobile terminal 3B than the singing video in which singing is not being performed. This allows the viewing user to watch the singing competition videos without being distracted by the singing video in which singing is not being performed.

[0087] FIG. 10 is an example of a screen display of the mobile terminal 3B in a singing battle. In the example of FIG. 10, the first singing video 60A is being sung and the second singing video 60B is not being sung, so the first singing video 60A is enlarged (full screen display), while the second singing video 60B is reduced (window display). The size and position on the screen 3a when the singing video is reduced may be predetermined, or the viewing user may be able to change the size and position of the singing video to any size on the mobile terminal 3B. For example, the mobile terminal 3B may be configured to display vertical line portion LDv and horizontal line portion LDs that match the outline of one of the objects to be reduced, as in the screen 3a of the mobile terminal 3A shown in FIG. 5, and to change the shape, size, and arrangement of the reduced display by displacing each of these.

[0088] In addition, the singing battle function according to this embodiment distributes singing videos to the mobile terminal 3B so that the first singing video 60A and the second singing video 60B are output as audio, or the first singing video 60A and the second singing video 60B are displayed on the screen, based on the alternating singing order described above.

[0089] That is, in the divided area 68 where the first singing user sings, the sound of the first singing video 60A is output and the first singing video 60A is displayed in an enlarged manner, while the sound of the second singing video 60B is not output and the second singing video 60B is displayed in a reduced manner. Also, in the divided area 68 where the second singing user sings, the sound of the second singing video 60B is output and the second singing video 60B is displayed in an enlarged manner, while the sound of the first singing video 60A is not output and the first singing video 60A is displayed in a reduced manner. Also, in the divided area 68 where the first singing user and the second singing user sing together, the first singing video 60A and the second singing video 60B are displayed on the screen in the same shape and size as shown in FIG. 8, and the sound of both are output.

[0090] The voting function will now be described. The video posting and viewing application has a voting function that accepts input of evaluations (hereinafter referred to as "votes") for each singing video in a singing competition from the mobile terminal 3B of the viewing user.

[0091] A vote is input by a viewer tapping an operation icon 58A provided for each singing video as shown in Figs. 8 and 10. That is, when a viewing user sympathizes with a singing video, the viewing user taps the operation icon 58A as an indication of a favorable evaluation of the singing video. Then, an image 66 showing the evaluation result for each singing video that has been received (hereinafter, referred to as a "voting result image") is delivered so as to be displayed on the screen 3a of the mobile terminal 3B together with the singing video.

[0092] In this way, the voting function according to the present embodiment allows the viewing user to evaluate the singing competition videos by tapping the operation icon 58A, for example, so that the viewing user can easily determine the superiority or inferiority of the singing competition videos when singing competition is held. Note that the viewing user can evaluate one singing video and the other singing video at the same time.

[0093] The voting function accepts input of points as votes, and derives the total points input during the distribution of the singing video (hereinafter referred to as the "total evaluation score") as the evaluation result. The total evaluation score is the sum of the points input by multiple viewing users. The voting function then determines the winner of the singing competition based on the total evaluation scores input by the time the singing competition ends. In other words, the singing user whose singing video has a relatively high total evaluation score is determined to be the winner. In this way, according to the voting function of this embodiment, multiple viewing users can vote cooperatively for the singing user (singing video) they support, thereby causing the singing user they support to be the winner, allowing the viewing users to empathize more with the singing user.

[0094] In the voting function according to the present embodiment, one point is input each time the operation icon 58A is tapped. The numbers ("21" and "185") in the voting result image 66 shown in Figs. 8 and 10 indicate the total evaluation points for each singing user (singing video), and the bar image extending to the left and right of the screen 3a and hatched (colored differently) on the left and right relatively indicates the total evaluation points for each singing video.

[0095] In addition, an upper limit is set for the number of times each viewing user can tap the operation icon 58A (hereinafter, referred to as "tap upper limit"), and the tap upper limit according to the present embodiment is one time. When the tap upper limit is reached, the operation icon 58D is displayed on the screen 3a instead of the operation icon 58A, as shown in FIG.

[0096] By tapping the operation icon 58D, the viewing user can superimpose a decorative image (hereinafter referred to as a "throwing effect image") on the singing video corresponding to the tapped operation icon 58D. In this way, the voting function has a throwing effect function that receives a request from the mobile terminal 3B to superimpose a throwing effect image on the singing video and superimposes the received throwing effect image on the singing video. In the following description, the viewing user's instruction (selection) to display the throwing effect image via the mobile terminal 3B is referred to as a throwing input, as described above.

[0097] That is, since the viewing user decorates the singing video with which he or she sympathizes by superimposing the coin tip effect image, the coin tip effect function can liven up the viewers and the singing video itself during the distribution of the singing video. The coin tip effect function is a function executed by the server 4 in response to a display instruction from the viewing user via the video posting and viewing application.

[0098] Furthermore, an image (icon image 64) showing a viewing user who has given a relatively higher rating (vote) to the singing video than other viewing users, i.e., a viewing user who has input a large number of points (hereinafter referred to as a "highly rated user"), may be displayed on the screen 3a of the mobile terminal 3B. This allows the viewing user to make other viewing users aware of the singing user whom the viewing user is supporting. The viewing user can also make the singing user aware that the viewing user is supporting the singing user.

[0099] 11, the mobile terminal 3A is composed of an input unit 71, a terminal output unit 73, a first display control unit 75, a first communication unit 77, etc. The input unit 71 inputs various commands such as an instruction to start shooting or recording a singing video, an instruction to select a song, a battle request, an acceptance of a battle request or a battle song, an instruction to change the display area RD, shooting a singing video, and a singing voice.

[0100] The terminal output unit 73 performs operations such as playing back music, displaying the singing video and the display area RD.

[0101] The first display control unit 75 causes at least a part of the singing video (the singing video in this example) to be displayed on the device output unit 73. The first display control unit 75 causes the display area RD to be displayed on the device output unit 73 together with the singing video. The first display control unit 75 preferably causes the display area RD to be displayed on the device output unit 73 in a state where it is superimposed on the singing video, and this is also done in this example. The first display control unit 75 preferably changes the display area RD while maintaining the aspect ratio based on the display area RD.

[0102] The first communication unit 77 transmits at least a part of the singing video (the singing video in this example) to the mobile terminal 3B via the server 4. When the display area RD is changed, it is preferable to notify the mobile terminal 3B of the changed display area RD, and this is also done in this example.

[0103] 3, the touch panel display (screen) 3a, the microphone 3c, the camera 3d, and the operation buttons 48. The terminal output unit 73 includes the touch panel display (screen) 3a, the speaker 3b, and the earphone jack 3e. The first display control unit 75 includes the main control unit 40, the main memory unit 42, and the auxiliary memory unit 44. The first communication unit 77 includes the communication unit 46.

[0104] The singing battle process in the portable terminal 3A will be described with reference to Fig. 12. The singing battle starts when a request for a battle is made at the input unit 71 in the portable terminal 3A1 and this request for a battle is accepted by the server 4, and when the request for a battle is accepted at the input unit 71 in the portable terminal 3A2 and this acceptance is judged as positive by the server (S11).

[0105] When the server 4 judges that the match request has been accepted, the server 4 generates a composite image 60 (see Figures 8 and 10), and the mobile terminal 3A1 receives a notification of the display area RD (see Figures 4 and 5) of the first singing video 60A in the composite image 60, and the mobile terminal 3A2 receives a notification of the display area RD of the second singing video 60B from the server 4 (S13).

[0106] After the mobile terminal 3A acquires the notification of the display area RD from the server 4, the first display control unit 75 displays the display area RD of the acquired notification on the screen 3a of the terminal output unit 73 (S14). The mobile terminal 3A judges whether an instruction to change the display area RD has been acquired by input to the input unit 71, for example, a moving operation of a line segment LD (see FIG. 5) (S15). If it is judged in step S15 that an instruction to change the display area RD has been acquired, the first display control unit 75 generates an image of the display area RD after the change based on the acquired instruction, and displays it on the screen 3a of the terminal output unit 73 (S17). In addition, the first communication unit 77 notifies the mobile terminal 3B of the viewing user of the changed display area RD (S18). Note that in this example, the mobile terminal 3B of the viewing user is notified via the server 4, but the mobile terminal 3B may be notified without the server 4.

[0107] When the mobile terminal 3A determines in step S15 that it has not acquired an instruction to change the display area RD, it distributes the battle singing video to the mobile terminal 3B via the server 4 (S19). Note that, in step S15, for example, it may be determined that there is no instruction to change the display area RD when no instruction to change the display area RD is input to the input unit 71 within a predetermined time from step S14, or it may be determined that there is no instruction to change when an instruction to start playing and recording the battle song is input to the input unit 71 regardless of the time elapsed from step S14. In this example, when an instruction to start playing and recording the battle song is input to the input unit 71, the battle singing video is distributed to the mobile terminal 3B via the server 4. In step S19, the mobile terminal 3A combines the battle singing video with the music data and singing data of the battle song to generate singing video data of the battle singing, and distributes the singing video by distributing the singing video data.

[0108] The process of changing the display area RD may be performed either before or after the start of distribution of the singing video (S19) after the notification of the display area RD is obtained from the server 4, or may be performed both before and after the start of distribution of the singing video (S19). In this example, the process of changing the display area RD, i.e., step S15 and steps S17 and S18 when it is determined in step S15 that there is an instruction to change, are also performed after step S19, and are shown as steps S21, S23, and S24 in FIG. 12. Every time the display area RD is changed, in this example, the first communication unit 77 notifies the mobile terminal 3B of the changed display area RD via the server 4. Note that, if an instruction to change the display area RD is not input to the input unit 71 in step S21, it is determined that there is no instruction, and the reproduction of the battle song is continued.

[0109] Step S21 is repeated while the reproduction of the battle song has not ended (S25). After the reproduction of the battle song has ended (S25), the mobile terminal 3A ends the distribution of the battle singing video (S27).

[0110] In addition, when distributing a non-competitive singing video, the mobile terminal 3A performs a process of changing the display area RD (S15, S17, S18) after starting to shoot the singing video. The display area RD can also be changed (S21, S23, S24) after starting to record or distribute the singing video.

[0111] 13, the server 4 includes a match request receiving unit 80, a match approval determination unit 81, a match setting unit 82, a video evaluation unit 83, a coin tip effect superimposition unit 84, a second display control unit 87, and a second communication unit 88. The processes executed by each function of the server 4 are realized by an information processing program stored in the HDD 26.

[0112] The match request receiving unit 80, the match approval determination unit 81, the match setting unit 82, the video evaluation unit 83, the coin tip effect superimposition unit 84, and the second display control unit 87 are configured to include the CPU 20, the ROM 22, the RAM 24, and the HDD 26 shown in FIG. 2. The second communication unit 88 is configured to include the external interface 32.

[0113] The match request receiving unit 80 receives a match request from a first singing user to a second singing user. The match acceptance determination unit 81 determines whether or not the second singing user has accepted the match request from the first singing user.

[0114] The battle setting unit 82 performs various settings such as battle song settings and singing order settings for the battle singing. The battle setting unit 82 divides the song into a plurality of divided areas 68 (see FIG. 9) on the time axis, i.e., in chronological order, and sets the order of singing users who will sing for each divided area 68 (alternate singing order).

[0115] The video evaluation unit 83 receives input of evaluations (scores) for each singing video distributed to the mobile terminal 3B, and superimposition (tipping input) of a tip effect image (not shown) on the singing video from the mobile terminal 3B. Then, the video evaluation unit 83 derives the total evaluation points input during distribution of the singing videos, and determines the winner of the singing competition.

[0116] When a tip input is received, the tip effect superimposing unit 84 superimposes a tip effect image (not shown) corresponding to the received tip input on the singing video.

[0117] The second display control unit 87, the second communication unit 88, etc. constitute a video distribution module (not shown) that distributes the singing video to the mobile terminal 3B. When the battle approval determination unit 81 makes a positive determination that the second singing user has approved the battle request from the first singing user, the second display control unit 87 generates a composite image 60 (see Figs. 8 and 10) based on the first singing video 60A from the mobile terminal 3A1 and the second singing video 60B from the mobile terminal 3A2. When generating the composite image 60, the second display control unit 87 sets (including changes) the display areas RD of the first singing video 60A and the second singing video 60B.

[0118] The second communication unit 88 transmits the composite image 60 to the mobile terminal 3B. As a result, the composite image 60 is displayed on the mobile terminal 3B. The second communication unit 88 also notifies the mobile terminal 3A1 of the display area RD of the first singing video 60A displayed in the composite image 60, and notifies the mobile terminal 3A2 of the display area RD of the second singing image 60B displayed in the composite image 60.

[0119] The mobile terminal 3A1 receives a notification of the display area RD from the second communication unit 88 via the first communication unit 77, and causes the notified display area RD to be displayed on the screen 3a together with the first singing video via the first display control unit 75. Similarly, the mobile terminal 3A2 receives a notification of the display area RD from the second communication unit 88 via the first communication unit 77, and causes the notified display area RD to be displayed on the screen 3a together with the second singing video via the first display control unit 75.

[0120] The singing battle processing in the server 4 will be described with reference to Fig. 14. An information processing program for executing the singing battle processing according to this embodiment is pre-stored in a predetermined area of ​​the HDD 26. The HDD 26 of the server 4 performing the singing battle processing stores an information processing program for executing a display control step of displaying at least a part of the captured image (singing video) on a display and a communication step of transmitting at least a part of the captured image to a receiving terminal device (mobile terminal 3B), and the display control step stores an information processing program for displaying the display area of ​​the captured image in the receiving terminal device together with the captured image on a display.

[0121] First, in step S31, the match request receiving unit 80 determines whether or not a match request from the first singing user to the second singing user has been made, and if the determination is affirmative, that is, if a match request from the first singing user has been received, the process proceeds to step S33. On the other hand, if the determination is negative, the process enters a waiting state until a match request is received.

[0122] In step S33, the competition approval determination unit 81 determines whether the second singing user has approved the competition request or not, and if the determination is affirmative, the process proceeds to step S37, and if the determination is negative, the process returns to step S31.

[0123] In step S37, the second display control unit 87 sets the display area RD of each of the first singing video 60A and the second singing video 60B. The setting of the display area RD is performed, for example, based on the number of mobile terminals 3A performing the singing battle. After step S37, the second display control unit 87 generates a composite image 60 by the first singing video 60A and the second singing video 60B corresponding to the display area RD (S38). When the second display control unit 87 sets the display area RD of each of the first singing video 60A and the second singing video 60B, it notifies the mobile terminal 3A1 of the display area RD set for the first singing video 60A and notifies the mobile terminal 3A2 of the display area RD set for the second singing video 60B (S39). The notification in step S39 corresponds to the notification in step S13 in FIG. 12. As a result, the display area RD is displayed on the mobile terminal 3A1 and the mobile terminal 3A2 together with each of the first singing video and the second singing video. After the notification in step S39, the battle setting unit 82 performs various settings for the singing battle (S40).

[0124] In step S42, the second communication unit 88 of the server 4 judges whether or not it has received a notification of a change in the display area RD from the mobile terminal 3A1 or the mobile terminal 3A2 (simply written as "notification of the display area" in FIG. 14). If the second communication unit 88 has received a notification of a change in the display area RD, a positive judgment is made in step S42, and the second display control unit 87 regenerates the composite image 60 based on the first singing video and the second singing video corresponding to the display area RD changed based on the received notification (S43). If the second communication unit 88 has not received a notification, a negative judgment is made in step S42, and the second communication unit 88 starts distribution of the battle singing video (S45). The battle singing video to be distributed includes the composite image 60 generated (including regeneration) by the second display control unit 87. As a result, at least a part of the first singing video and at least a part of the second singing video are displayed on the screen 3a of the mobile terminal 3B as the composite image 60. Note that step S42 may be performed before step S40.

[0125] After the start of distribution of the battle singing videos in step S45, if the server 4 acquires (S48) the notification in step S24 (FIG. 12) by the second communication unit 88, it regenerates (S49) and distributes the composite image 60 based on the first singing video and the second singing video corresponding to the acquired display area RD, and if not, it continues distribution of the composite image 60 being distributed to progress the song. Step S48 is repeated while the playback of the battle song has not ended (S51).

[0126] In this example, the server 4 generates the composite image 60 in step S38, and regenerates the composite image 60 in step S49. However, at least one of the generation and regeneration of the composite image 60 may be performed by the mobile terminal 3B used by the viewing user. When the mobile terminal 3B generates and regenerates the composite image 60, the mobile terminal 3B may include a third display control unit (not shown) configured similarly to the second display control unit 87 of the server 4. When the mobile terminal 3B generates the composite image 60, the server 4 notifies the mobile terminal 3B of the display area RD set in step S37, for example, in step S45 together with the transmission of the first singing video and the second singing video, and the mobile terminal 3B generates the composite image 60 corresponding to the notified display area RD. When the mobile terminal 3B regenerates the composite image 60, the server 4, having received the notification in step S24 of FIG. 12, may send the received notification to the mobile terminal 3B together with the transmission of the singing video obtained from the mobile terminal 3A. 12. Furthermore, when the composite moving image 60 is reproduced by the mobile terminal 3B, the notification in step S24 in FIG.

[0127] In step S51, the video distribution module (not shown) judges whether the song of the singing competition has ended, and if the judgment is affirmative, the second communication unit 88 ends the distribution of the singing competition video (S53). On the other hand, if the judgment is negative in step S51, the second communication unit 88 continues the distribution of the singing competition video until the song ends.

[0128] In the case of non-competitive singing, the server 4 may acquire the singing video data distributed from the mobile terminal 3A and store it in a predetermined area of ​​the HDD 26 (see FIG. 2). In the case of non-competitive singing, the singing video data may be transmitted to the mobile terminal 3B without going through the server 4.

[0129] The outcome of the singing competition is not limited to being determined by the votes of the viewing users. For example, the singing competition function may have an automatic scoring function, and the outcome may be determined by the judgment result of this automatic scoring function.

[0130] In the above embodiment, the performance is singing and the video uploaded to the video sharing site is a singing video, but the present invention is not limited to this. For example, the performance may be something other than singing, such as dancing and the video uploaded to the video sharing site is a dance video.

[0131] <Additional Notes> The information processing device of the present invention is an information processing device capable of communicating with a receiving terminal device, and is equipped with a display control unit that displays at least a part of the captured image on a display, and a communication unit that transmits at least a part of the captured image to the receiving terminal device, and the display control unit displays the display area of ​​the captured image on the receiving terminal device together with the captured image on the display. This allows the image displayed on the receiving terminal device to be recognized on the sending terminal device.

[0132] It is preferable that the display control unit causes the display to display an area display image indicating the display area superimposed on the captured image. This allows the image to be displayed on the receiving terminal device to be intuitively understood on the transmitting terminal device.

[0133] It is further preferable that the display control unit changes the display area while maintaining the aspect ratio based on the display area, and the communication unit notifies the receiving terminal device of the changed display area. This allows the image displayed on the receiving terminal device to be adjusted by the transmitting terminal device.

[0134] The information processing system of the present invention is an information processing system capable of communication between a transmitting terminal device and a receiving terminal device, and is equipped with a display control unit that displays at least a portion of a captured image on a display of the transmitting terminal device, and a communication unit that transmits at least a portion of the captured image to the receiving terminal device, and the display control unit causes the display area of ​​the captured image on the receiving terminal device to be displayed on the display together with the captured image. This allows the image displayed on the receiving terminal device to be recognized on the sending terminal device.

[0135] It is preferable that the information processing system further includes a server device that communicates with a plurality of transmitting terminal devices including a first transmitting terminal device and a second transmitting terminal device and a receiving terminal device, and the server device transmits to the receiving terminal device a composite image generated based on a first captured image from the first transmitting terminal device and a second captured image from the second transmitting terminal device, notifies the first transmitting terminal device of a first display area to be displayed in the composite image of the first captured image, and notifies the second transmitting terminal of a second display area to be displayed in the composite image of the second captured image, and the first transmitting terminal device displays the first display area together with the first captured image on the display of the first transmitting terminal device, and the second transmitting terminal device displays the second display area together with the second captured image on the display of the second transmitting terminal device. As a result, even if there are a plurality of transmitting terminal devices, the image displayed on the receiving terminal device can be recognized at the transmitting terminal device.

[0136] The information processing program of the present invention is an information processing program that causes a computer of an information processing device capable of communicating with a receiving terminal device to execute a display control step of displaying at least a portion of the captured image on a display, and a communication step of transmitting at least a portion of the captured image to the receiving terminal device, and the display control step causes the display area of ​​the captured image on the receiving terminal device to be displayed on the display together with the captured image. The information processing method of the present invention is an information processing method for communicating with a receiving terminal device, and includes a display control step of displaying at least a part of the captured image on a display, and a communication step of transmitting at least a part of the captured image to the receiving terminal device, and the display control step causes the display area of ​​the captured image on the receiving terminal device to be displayed on the display together with the captured image. By using each of these information processing programs and information processing methods, an image displayed on a receiving terminal device is recognized on a transmitting terminal device. [Explanation of symbols]

[0137] 1 Karaoke system 3A, 3B Mobile terminals 3a screen 4 Server 50B Photographed image display area 60 Composite Images 60A 1st singing video 60B 2nd singing video 75 First display control unit 77 First Communications Department 87 Second display control unit 88 2nd Communications Department RD display area

Claims

[Claim 1] An information processing device capable of communicating with a receiving terminal device, a display control unit that displays at least a part of a captured image on a display; and a communication unit that transmits at least a part of the captured image to the receiving-side terminal device, The display control unit causes a display area of ​​the captured image in the receiving terminal device to be displayed on the display together with the captured image.

Images