Information processing device, information processing system, and information processing program

Abstract

To provide an information processing device, an information processing system, and an information processing program that allow a transmitting-side terminal device to recognize an image displayed on a receiving-side terminal device.SOLUTION: A mobile terminal 3A, which is a transmitting-side terminal device, is an information processing device that includes a first display control unit 75 and a first communication unit 77 and can communicate with a mobile terminal 3B, which is a receiving-side terminal device. The first display control unit 75 displays at least part of singing video on a display. The first communication unit 77 transmits at least part of the singing video to the mobile terminal 3B. The first display control unit 75 causes a display area of the singing video of the mobile terminal 3B to be displayed together with the singing video on a screen 3a.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an information processing system, and an information processing program.

Background Art

[0002] Online services such as websites (Web pages, Web services), online games, and application software (hereinafter referred to as "apps") distributed to information processing apparatuses such as mobile terminals via a computer network have become widespread.

[0003] One of the online services is a video posting site where users can post videos they have taken themselves and enable other users to view the videos. On the video posting site, users also post performance videos such as singing videos. There are also online services such as battles between performance videos by different posters.

[0004] Regarding image capturing techniques, various proposals have been made so far. For example, Patent Document 1 discloses a display control apparatus including setting means for setting types of auxiliary displays related to a composition to be displayed on a display unit. The setting means separately sets a first auxiliary display in a still image mode and a second auxiliary display in a video mode.

[0005] Further, Patent Document 2 discloses a safe area warning apparatus including warning means for setting, as a safe area, a predetermined angle-of-view range for shooting a subject of a shooting purpose with respect to an entire angle-of-view range of a captured image captured by imaging means, and for warning when it is determined that there is a possibility that an AF frame moves outside the safe area.

Prior Art Documents

Patent Documents

[0006]

Patent Document 1

[0007] However, since the posted video displayed on the terminal device receiving the posted video is not recognizable to the user who posted it, the user who posts, i.e., sends the image, may not be able to post the video they want as an image that other users can view. The technologies in Patent Documents 1 and 2 cannot solve this problem.

[0008] Therefore, the present invention aims to provide an information processing device, an information processing system, and an information processing program that enable an image displayed on a receiving terminal device to be recognized by a transmitting terminal device. [Means for solving the problem]

[0009] The present invention provides an information processing device capable of communicating with a receiving terminal device, comprising: a display control unit that displays at least a portion of a captured image on a display; and a communication unit that transmits at least a portion of the captured image to the receiving terminal device, wherein the display control unit causes the display area of ​​the captured image on the receiving terminal device to be displayed on the display together with the captured image. [Effects of the Invention]

[0010] According to the present invention, an image displayed on the receiving terminal device can be recognized by the transmitting terminal device. [Brief explanation of the drawing]

[0011] [Figure 1] This is a schematic diagram of a karaoke system, which is one embodiment of the present invention. [Figure 2] This is a diagram illustrating the electrical configuration of the server. [Figure 3] This is a diagram illustrating the electrical configuration of a mobile device. [Figure 4]This is an explanatory diagram of the screen display on a mobile device when recording a singing video. [Figure 5] This is an explanatory diagram of the screen display of a mobile device used to record a singing video, when the display area on the mobile device being viewed is changed. [Figure 6] This is an explanatory diagram of the screen display on the mobile device used for viewing. [Figure 7] This is an explanatory diagram of the screen display on the mobile device used for viewing. [Figure 8] This is an explanatory diagram of the screen display used on the mobile device for viewing, specifically for competitive singing performances. [Figure 9] This is a diagram explaining the division of the battle songs. [Figure 10] This is an explanatory diagram of the screen display used on the mobile device for viewing, in the case of a competitive singing performance. [Figure 11] This is a functional block diagram of a mobile device that sends singing videos. [Figure 12] This is a flowchart illustrating the competitive singing process on a mobile device that transmits singing videos. [Figure 13] This is a functional block diagram of the server. [Figure 14] This is a flowchart illustrating the server's battle singing processing. [Modes for carrying out the invention]

[0012] In this embodiment, the performer records their performance as a video using a mobile device and sends it to a server device, thereby uploading it to a video sharing site. The video uploaded to the video sharing site (posted video) can be viewed via a mobile device. In this embodiment, the performance is referred to as singing, the performer as the singing user, and the video uploaded to the video sharing site as the singing video. Furthermore, the user who views the singing video uploaded to the video sharing site is referred to as the viewing user. In this example, the video is sent from the singing user to the viewing user via the server device, but the video may also be sent from the singing user to the viewing user without going through the server device.

[0013] The karaoke system 1 shown in FIG. 1 is an example of an embodiment of an information processing system. The karaoke system 1 includes mobile terminals 3A1, 3A2, 3B and a server 4 which is an example of a server device and can communicate with each other by being connected via a communication line 2. In the following description, when the mobile terminals 3A1 and 3A2 are not distinguished, they are collectively referred to as the mobile terminal 3A, and when the mobile terminal 3A and the mobile terminal 3B are not distinguished, they are collectively referred to as the mobile terminal 3.

[0014] The communication line 2 forms a computer network and is, for example, a wide area communication line provided by an electric utility company.

[0015] The mobile terminal 3 is an example of a terminal device used for a user to use an online service, and is, for example, an information processing terminal such as a smartphone, a tablet terminal, or a notebook personal computer. The mobile terminal 3 includes a touch panel display 3a for displaying an image, a speaker 3b for outputting sound, a microphone 3c for inputting sound, a camera 3d for photographing a subject, and an earphone jack 3e (not shown) to which an earphone is connected. Here, the photographing means that the camera 3d is operating and the subject is displayed on the touch panel display 3a regardless of whether recording is performed. The touch panel display 3a includes, for example, an LCD (Liquid Crystal Display) and a touch sensor. The LCD displays various images, and the touch sensor receives various input operations performed using an indicator such as a finger, a stylus, or a pen.

[0016] Server 4 is an information processing device that provides online services to mobile terminal 3 via communication line 2. In the example shown in Figure 1, the singing user sends their singing video (singing video data) from mobile terminal 3A to server 4, whereupon the singing video is uploaded to a video sharing site and distributed to viewers. Viewers access the video sharing site using mobile terminal 3B, retrieve the singing video, and watch it. Thus, mobile terminal 3A is the transmitting terminal device used by the singing user to send the singing video, and mobile terminal 3B is the receiving terminal device used by the viewers to receive the singing video. However, the singing user can also watch the singing video they uploaded by accessing the video sharing site using mobile terminal 3A. Furthermore, the user of mobile terminal 3B can also become the singing user and upload a singing video to the video sharing site.

[0017] An example of the electrical configuration of Server 4 will be explained with reference to Figure 2. Server 4 consists of a CPU (Central Processing Unit) 20, which is the main control unit that controls the entire Server 4, and a ROM (Read Only) which stores various programs and data in advance. It includes Memory 22, RAM (Random Access Memory) 24 used as a work area when various programs are executed by the CPU 20, and HDD (Hard Disk Drive) 26 as a storage means for storing various programs and data.

[0018] The HDD26 stores singing video data transmitted from the mobile terminal 3A, i.e., singing video data uploaded to video sharing sites, as well as song data indicating songs that the singing user can sing. The storage means is not limited to the HDD26; other storage media such as semiconductor memory like flash memory may also be used.

[0019] Furthermore, the server 4 includes an input unit 28 consisting of a keyboard and mouse, etc., which accepts input for various operations; a monitor 30 such as a liquid crystal display device that displays various images; and an external interface 32 that is connected to other information processing devices such as a mobile terminal 3 via a communication line 2 and transmits and receives various data with other information processing devices.

[0020] The CPU 20, ROM 22, RAM 24, HDD 26, operation input unit 28, monitor 30, and external interface 32 are electrically connected to each other via the system bus 34. Therefore, the CPU 20 can access the ROM 22, RAM 24, and HDD 26, understand the operation status of the operation input unit 28, display images on the monitor 30, and send and receive various types of data with other information processing devices via the external interface 32.

[0021] The electrical configuration of the mobile terminal 3 will be explained with reference to Figure 3. The mobile terminal 3 includes a touch panel display (hereinafter referred to as "screen") 3a, a speaker 3b, a microphone 3c, a camera 3d, and an earphone jack 3e, as well as a main control unit 40, a main memory unit 42, an auxiliary memory unit 44, a communication unit 46, and operation buttons 48.

[0022] The main control unit 40 is, for example, a CPU, microprocessor, or DSP (Digital Signal Processor), and controls the entire mobile terminal 3.

[0023] The main memory unit 42 is composed of, for example, RAM or DRAM (Dynamic Random Access Memory), and is used as a work area when the main control unit 40 executes processing based on various programs.

[0024] The auxiliary storage unit 44 is a non-volatile memory such as flash memory, and stores various data such as images and programs used for processing by the main control unit 40. The programs stored in the auxiliary storage unit 44 include, for example, an OS (Operating System) for realizing the basic functions of the mobile terminal 3, drivers for controlling various hardware, programs for realizing email, web browsing, and various other functions. The auxiliary storage unit 44 also has pre-stored applications for shooting and posting singing videos and viewing video posting sites (hereinafter referred to as "video posting and viewing applications"). The auxiliary storage unit 44 stores an information processing program that executes a display control step for displaying at least a portion of the captured image (singing video) on the display and a communication step for transmitting at least a portion of the captured image to the receiving terminal device (mobile terminal 3B). The display control step stores an information processing program that displays the display area of ​​the captured image on the receiving terminal device together with the captured image on the display.

[0025] The communication unit 46 is, for example, a NIC (Network Interface Controller) and has the function of connecting to the communication line 2. Alternatively, the communication unit 46 may have functions to connect to a wireless LAN (Local Area Network), a wireless WAN (Wide Area Network), short-range wireless communication such as Bluetooth®, and infrared communication, either in place of or together with the NIC.

[0026] The operation buttons 48 are located on the side of the mobile terminal 3 and include a power button for starting or stopping the mobile terminal 3, and a volume control button for the sound output by the speaker 3b.

[0027] The main control unit 40, main memory unit 42, auxiliary memory unit 44, communication unit 46, operation buttons 48, screen 3a, speaker 3b, microphone 3c, camera 3d, and earphone jack 3e are electrically connected to each other via a system bus 49. This allows the main control unit 40 to access the main memory unit 42 and auxiliary memory unit 44, display images on screen 3a, understand the user's operation status on screen 3a and operation buttons 48, input sound to microphone 3c, output sound from speaker 3b or earphones connected to earphone jack 3e, control camera 3d, and access various communication networks and other information processing devices via the communication unit 46.

[0028] When a singing user records a singing video, they launch a video posting and viewing app on their mobile device 3A. When the video posting and viewing app is launched, the mobile device 3A accesses server 4, which stores multiple song data files. The singing user then selects a song to sing from the video posting and viewing app and downloads the song data from server 4 to the mobile device 3A. The singing user then uses the video posting and viewing app to play the song at any time and sings. The video posting and viewing app starts recording a video using the camera 3D at the same time as the song starts playing. In other words, the singing video is an image (hereinafter referred to as "recorded image") captured by the mobile device 3A while the song is playing from the mobile device 3A.

[0029] Furthermore, song data is associated with lyric data, and when song data is downloaded from server 4 to mobile device 3A, the associated lyric data is also downloaded to mobile device 3A. In the following explanation, it will be assumed that song data includes lyric data.

[0030] Figure 4 shows an example of the display on screen 3a of the mobile device 3A (hereinafter referred to as "screen display") when recording a singing video.

[0031] As shown in Figure 4, the image on the screen 3a of the mobile terminal 3A is configured with a lyrics display area 50A and a captured image display area 50B. The lyrics display area 50A includes a lyrics image 52 showing the lyrics of the song the user is singing, a pitch image 54 showing the pitch of the song, and a progress bar 56 showing the progress of song playback.

[0032] The lyrics image 52 and the pitch image 54 are updated in accordance with the progress of music playback. In this embodiment, as an example, the lyrics image 52 and the pitch image 54 are updated every few phrases and displayed in the lyrics display area 50A. The update timing of the lyrics image 52 and the pitch image 54 may be the same or different.

[0033] Lyrics image 52 displays the lyrics in multiple lines, for example (two lines in the example in Figure 4), and the color of the lyrics in the upper line changes from left to right in accordance with the progress of the song, allowing the singing user to visually understand which lyrics they should be singing at any given moment. When the color change of the lyrics in the upper line reaches the right edge, the lyrics in the lower line rise and are displayed in the upper line, and new lyrics are displayed in the lower line, and the color of the lyrics in the upper line changes again from left to right in accordance with the progress of the song.

[0034] As an example, the pitch image 54 displays multiple pitch bars 54A corresponding to different pitches in a staircase-like pattern from left to right on screen 3a. To allow the singing user to visually grasp the pitch and range of the note they are currently trying to sing, the color of the pitch bars 54A changes from left to right as the song progresses, and the pointer 54B moves from left to right. When the color of the pitch bars 54A changes and the pointer 54B reaches the right end, the pitch image 54 indicating the next pitch is updated and displayed.

[0035] The progress bar 56, for example, shows the total length of the song from left to right. When playback of the song begins, the pointer 56A, which indicates the playback position of the song, moves from left to right, and when pointer 56A reaches the right end, it corresponds to the end of song playback. Note that the progress bar 56 that pointer 56A has passed over is displayed thicker than its previous position, but this is not the only display method.

[0036] Music playback begins, for example, when the play button (not shown) displayed on screen 3a is tapped. When playback begins, the camera 3d (see Figures 1 and 3) activates, i.e., turns on, and recording begins. The recorded images, such as singing videos, are displayed as video images in the recorded image display area 50B. This allows the singing user to adjust the position, orientation, posture, etc., of at least one of themselves and the mobile terminal 3A by looking at the recorded image display area 50B, or by looking at it at any time, to obtain the desired recorded image. As a result, the mobile terminal 3A acquires the recorded image desired by the singing user.

[0037] In the captured image display area 50B, the area RD of the singing video (hereinafter referred to as the "display area") displayed on the screen 3a of the mobile terminal 3B (see Figure 1) used by the viewing user for viewing is visible. The display area RD displayed in the captured image display area 50B at the start of recording may have an initial value (default) pre-set in the video posting and viewing application, or it may be set at any time by the server 4. In this example, in the case of competitive singing where multiple singing users compete in singing, the display area RD at the start of recording will be set by the server 4, but in the case of non-competitive singing that is not competitive singing, the display area RD at the start of recording of the singing video will have an initial value pre-set in the video posting and viewing application.

[0038] In the singing video, the portion excluding the display area RD is displayed on the screen 3a of the mobile terminal 3A as the portion not displayed on the screen 3a of the mobile terminal 3B (see Figure 1) (hereinafter referred to as the "non-display area") RN, with a different image quality than the display area RD, thereby making the display area RD visible. Image quality includes, for example, hue, brightness, saturation, contrast, gradation, and transparency. In this example, the display area RD is displayed while maintaining the transparency of the singing video, and the non-display area RN is displayed as a semi-transparent image with lower transparency than the display area RD (an image masked to the extent that the background singing video is visible), thereby making the display area RD visible. Figure 4 shows an example where the non-display area RN is located on both sides of the captured image display area 50B. In other words, Figure 4 shows an example where the display area RD has a vertical length (length in the vertical direction in Figure 4) L1 that is the same as the vertical length of the singing video, and a horizontal length (length in the horizontal direction in Figure 4) L2 that is shorter than the horizontal length of the singing video.

[0039] The method for displaying the display area RD is not limited to this example. For example, the display area RD may be made visible by displaying a line segment indicating the boundary between the display area RD and the non-display area RN in the captured image display area 50B, or by displaying the four vertices of the rectangular display area as points.

[0040] In this way, the mobile terminal 3A used by the singing user displays the display area RD on the mobile terminal 3B used by the viewing user, and the singing user can recognize the display area RD, so that the singing user can capture subject images corresponding to the display area RD. For example, the singing user adjusts the position, orientation, posture, etc. of at least one of themselves and the mobile terminal 3A so that the desired part and range of their body fits within the display area RD, and then takes a picture. As a result, the singing video desired by the singing user is reliably and easily acquired on the mobile terminal 3A.

[0041] The display area RD is displayed overlaid on the singing video in the captured image display area 50B. This allows the singing user to intuitively grasp the image that the viewing user will see when looking at screen 3a.

[0042] It is preferable that the mobile terminal 3A is configured to change the display area RD while maintaining the aspect ratio based on the display area RD. This allows the image of the singing video displayed on the mobile terminal 3B used by the viewer to be adjusted on the mobile terminal 3A used by the singer. The aspect ratio based on the display area RD is the aspect ratio obtained by the vertical length L1 and the horizontal length L2, and is calculated as L2 / L1. Alternatively, it may be calculated as L1 / L2.

[0043] For example, when a singing user taps on the captured image display area 50B, a line segment LD representing the outline of the display area RD is superimposed on the singing video, as shown in Figure 5. In this example, there are non-display areas RN on both sides, and the vertical length L1 is the same as the vertical length of the singing video. Therefore, the vertical line portion LDv of the line segment LD extends vertically from the top to the bottom edge of the captured image display area 50B, and the horizontal line portions LDs are displayed coinciding with the top and bottom edges of the captured image display area 50B. Then, by sliding (swiping, for example) an object such as a finger touching the screen 3a within the captured image display area 50B from one of the four vertices of the display area RD toward the center GC, the display area RD can be changed to an area indicated by, for example, a dashed line, and the aspect ratio of the area indicated by the dashed line is the same as the aspect ratio based on the display area RD. In Figure 5, an example is shown where the vertical line section LDv and the horizontal line section LDs are simultaneously displaced, maintaining the aspect ratio, with the central GC of the captured image display area 50B as the center of change for the display area RD.

[0044] The aspect ratio to be maintained is not limited to the aspect ratio based on the display area RD; for example, it may be the aspect ratio based on the singing video. Also, if the display area RD is changed without maintaining the aspect ratio based on the display area RD, it is preferable to displace the vertical line section LDv and the horizontal line section LDs independently. In this case, each of the two vertical line sections LDv may be displaced independently, and similarly, each of the two horizontal line sections LDs may be displaced independently.

[0045] The entire line segment LD may be slid within the captured image display area 50B to displace the display area RD while maintaining its shape and area. Furthermore, the movement ranges of the line segment LD, the vertical line section LDv, and the horizontal line section LDs, as well as the movement range of the sliding movement of the display area RD, may be restricted. For example, the line segment LD, the vertical line section LDv, and the horizontal line section LDs may be prevented from being located in the central region including the central GC of the captured image display area 50B, thereby preventing the formation of a non-display area RN in that central region.

[0046] Changes to the display area RD, such as changing the display area RD while maintaining the aspect ratio based on the display area RD, or sliding the display area RD while maintaining its shape and size, can be performed even while recording a singing video.

[0047] Furthermore, the mobile device 3A may be equipped with a video posting and viewing application that can automatically detect, for example, the position of the singing user's eyes in a singing video, and slide the display area RD based on the detected signal.

[0048] When the display area RD is changed (for example, when the display area RD is changed while maintaining the aspect ratio based on the display area RD, or when the display area RD is slid while maintaining the shape and size of the display area RD), it is preferable that the changed display area RD is notified to the mobile terminal 3B, and this is done in this example as well.

[0049] Recording of the singing video begins after the singing user selects a song and taps the recording start button (not shown) displayed on screen 3a, after a predetermined time (e.g., 10 seconds). The start and end of the video recording may coincide with the start and end of the song, but it may also start a predetermined time before the start of the song (e.g., 5 seconds before) or end a predetermined time after the end of the song (e.g., 5 seconds after). The recorded image may be the singing video displayed in the entire area of ​​the captured image display area 50B, or it may be at least a part of the singing video, such as only the display area RD. In this example, the singing video displayed in the entire area of ​​the captured image display area 50B is recorded, and even when the singing video is recorded in this way, only the image of the display area RD is displayed on screen 3a of the viewing user's mobile terminal 3B.

[0050] The singing user connects earphones to the earphone jack 3e and listens to the music being played using the earphones, singing along to the music. The mobile terminal 3A photographs the singing user with the camera 3d and records the singing user's singing with the microphone 3c. In other words, the microphone 3c does not capture the sound of the music being played. The mobile terminal 3A then records the singing user's voice captured by the microphone 3c and uses it as singing data.

[0051] Furthermore, the singing data may be filtered to extract the frequency range of the human voice. This filtering process removes noise originating from the singing user's surrounding environment, resulting in a clearer recording of the user's voice.

[0052] The video posting and viewing app then combines the music data, singing data, and recording data to create singing video data that can be sent to server 4. The singing user can, for example, choose one of the following two timings for sending the singing video data to server 4, i.e., uploading it to the video posting site.

[0053] One method is live streaming, where the singing user uploads the singing video data to a video sharing site in real time while singing. In live streaming, viewers watch the singing user's performance in real time. The other method is non-live streaming, where the singing user uploads the singing video data to a video sharing site at a time of their choosing after the song has been sung.

[0054] When a singing user is performing a live stream, they should configure the settings for live streaming before recording, so that the singing video data is uploaded to the video sharing site as soon as recording begins. In the case of live streaming, the singing video data may be uploaded to the video sharing site without being stored on the mobile device 3A.

[0055] Furthermore, when conducting a live stream, the singer can choose between two settings: a first live stream setting that allows viewers to watch the singing video during the live stream, and a second live stream setting that allows viewers to watch the singing video even after the live stream has ended. In other words, with the first live stream setting, the singing video data is deleted from server 4 when the live stream ends, and viewers cannot watch the live-streamed singing video after the live stream has ended. On the other hand, with the second live stream setting, server 4 continues to store the singing video data even after the live stream has ended, so viewers can watch the singing video as a non-live stream even after the live stream has ended.

[0056] In the case of non-live streaming, the singing video data is temporarily stored on the mobile device 3A, and the singing user can upload the singing video to a video sharing site at any time by operating the video posting and viewing app.

[0057] This section explains how viewers can watch singing videos using a mobile device (3B).

[0058] When a user wants to watch a singing video, they launch a video posting and viewing app on their mobile device 3B. When the video posting and viewing app is launched, the mobile device 3B accesses server 4, which stores data on multiple singing videos, i.e., a video posting site. The user then selects the singing video they want to watch via the video posting and viewing app and displays it on screen 3a. One example of the method used by server 4 to deliver singing videos to mobile device 3B is streaming.

[0059] Figure 6 shows an example of the screen display on mobile device 3B when viewing a singing video, specifically when a live stream is taking place.

[0060] Screen 3a displays a singing video and also includes a singing user display area 50C, a lyrics display area 50D, and a comment input display area 50E. The singing user display area 50C, lyrics display area 50D, and comment input display area 50E may be displayed superimposed on the singing video as shown in Figure 6, or they may be displayed in a separate area from the video display area (not shown) on which the singing video is displayed.

[0061] The singing user display area 50C displays the username of the singing user who posted the singing video, whether or not it is a live stream, and the name of the song being sung.

[0062] The lyrics display area 50D displays the lyrics of the singing video. For example, the displayed lyrics are shown in multiple phrases, and the color of the lyrics changes from left to right in accordance with the progress of the song. For example, the lyrics display area 50D may also display the lyrics in multiple lines. In this case, when the color change of the lyrics in the upper line reaches the right edge, the lyrics in the lower line move up and are displayed in the upper line, and new lyrics are displayed in the lower line, and the color of the lyrics in the upper line changes again from left to right in accordance with the progress of the song.

[0063] The comment input display area 50E displays a comment input field, along with comments from viewers watching the singing video, along with their usernames. For example, each time a viewer enters a comment, that comment is added to the top of the comment input display area 50E, and the previously displayed comments are shifted down. If the comments can no longer be displayed in the comment input display area 50E, a scroll bar (not shown) will appear on the right side of the comment display area, and viewers can use this scroll bar to display comments that were not previously shown on screen 3a.

[0064] Furthermore, screen 3a displays operation icons 58A to 58D for the viewer to perform various operations.

[0065] Operation icon 58A is an icon that viewers tap when they feel a connection to or empathize with a singing video they are watching, and the total number of taps on operation icon 58A for that singing video is displayed above operation icon 58A.

[0066] Operation icon 58B is tapped when a viewer requests a battle (hereinafter referred to as "battle singing") with a singing user who is live-streaming a singing video displayed on screen 3a. In a battle singing, multiple singing videos (first singing video, second singing video) by different singing users are simultaneously displayed on screen 3a of the viewer's mobile device 3B, and the singing videos alternately sing the same song. In other words, a viewer who taps operation icon 58B becomes a singing user participating in a battle singing, and the mobile device 3B being used functions as mobile device 3A after the operation icon 58B is tapped.

[0067] Operation icon 58C is the icon that users tap to access various settings for the video posting and viewing app.

[0068] Operation icon 58D is an icon that viewers tap when they want to overlay a decorative image onto the singing video displayed on screen 3a. In this embodiment, the decorative images have a price determined by their type and can be purchased by viewers through payment. By tapping operation icon 58D, viewers can overlay a decorative image onto the singing video they are watching. The singer of the singing video on which the decorative image has been overlaid receives money from the video sharing site operator corresponding to the overlaid decorative image. In other words, the overlaying (display instruction) of a decorative image onto a singing video by a viewer is equivalent to a tip to the singer.

[0069] The singing video is an image contained within the display area RD on the mobile terminal 3A. Since the singing user captures the image while being aware of the display area RD on the mobile terminal 3A, the viewing user is guaranteed to see the singing video that the singing user desires. For example, if, during recording, much of the left half of the singing user's face is outside the display area RD, the singing video before displacement will not show much of the left half of the singing user's face on screen 3a, as shown in Figure 6. However, if the mobile terminal 3A is displaced so that the user's face is closer to the center of the display area RD, the singing video will be displayed as an image where the singing user's face is closer to the center of screen 3a than in the configuration shown in Figure 6, as shown in Figure 7.

[0070] The competitive singing function will now be explained. The video posting and viewing application according to this embodiment has a competitive function in which multiple users, who are performers, compete against each other to determine the superiority of their performance videos. The competitive function according to this embodiment is a type of so-called karaoke battle, and as illustrated in Figure 8, it is a competitive singing function that simultaneously displays multiple singing videos (first singing video 60A, second singing video 60B) by different singing users on the screen 3a of the viewing user's mobile terminal 3B. The competitive singing function is a function executed by the server 4.

[0071] Figure 8 shows an example of the screen display on a viewer's mobile device 3B during a competitive singing session. The "VS" displayed in Figure 8 stands for "versus" and is displayed at the start of the competitive singing session. The display is removed after a predetermined time has elapsed since the start of the competitive singing session (for example, after 3 seconds). The screen display on the singing user's mobile device 3A after the competitive singing session has started may be the same as in Figure 8, or it may be a screen display showing the singing video as shown in Figure 4 with the other singing users participating in the competitive singing session displayed in a reduced size (see Figure 10).

[0072] For a singing battle to take place, one singing user (hereinafter referred to as "First Singing User") requests another singing user (hereinafter referred to as "Second Singing User") to simultaneously stream their singing video (hereinafter referred to as "Battle Request"). If the Second Singing User accepts the Battle Request, the singing battle will begin; otherwise, the battle will not begin.

[0073] More specifically, the first singing user launches the video posting and viewing app on their mobile device 3A1 and sends a battle request to the second singing user who is live streaming a singing video using the video posting and viewing app. The battle request is sent by the first singing user tapping the operation icon 58B. The first singing user selects the song to be sung in the battle. Information indicating the selected song (hereinafter referred to as the "battle song") (title and artist name) is sent to the second singing user along with the battle request.

[0074] A battle request sent from mobile terminal 3A1 is transmitted to the second singing user's mobile terminal 3A2 via server 4. An image corresponding to the received battle request is displayed on screen 3a of mobile terminal 3A2, and the second singing user, if accepting the battle request, taps the predetermined image displayed on screen 3a, for example.

[0075] Then, when the second singing user accepts the battle request from the first singing user, the server 4 starts the battle singing by distributing the first singing video 60A by the first singing user and the second singing video 60B by the second singing user so that they are displayed simultaneously on the screen 3a of the mobile terminal 3B. For example, the server 4 starts the battle singing by generating and distributing a composite image composed of the first singing video 60A and the second singing video 60B. This allows the viewing user to watch the battle singing (real-time battle) between the first and second singing users in real time. In the following explanation, the first singing video 60A and the second singing video 60B distributed in the battle singing will be collectively referred to as the battle singing video. The number of singing users participating in the battle singing may be three or more, and the number, arrangement, and size of the singing videos that make up the composite image should be set based on the number of singing users participating in the battle singing.

[0076] Thus, the competitive singing function accepts a request for a singing video battle from the first singing user to the second singing user, and when the second singing user accepts the battle request, it distributes the first singing video 60A and the second singing video 60B so that they are displayed simultaneously on the screen 3a of the mobile terminal 3B. Therefore, the competitive singing function enables singing users to compete with each other using their respective singing videos, and also enables viewers to simultaneously watch multiple competing singing videos.

[0077] Furthermore, it is conceivable that the second singing user may accept the battle request but not the battle song. In such cases, the battle singing function may have a function to send information indicating the change of battle song and the battle song selected by the second singing user from the second singing user's mobile terminal 3A2 to the first singing user's mobile terminal 3A1, and to request the first singing user's consent.

[0078] When a competitive singing session begins, Server 4 may modify the display areas RD of the first singing video 60A and the second singing video 60B on the mobile terminal 3B in order to generate a composite image, and this is done in this example. When Server 4 modifies the display area RD, it notifies the mobile terminal 3A on which the singing video subject to the modification was filmed of the modified display area RD. The display area RD notified by Server 4 is displayed as the new display area RD in the filmed image display area 50B (see Figure 4) of the mobile terminal 3A that has received the notification. After this, each mobile terminal 3A may further modify the display area RD, in which case each mobile terminal 3A can change to a narrower area than the display area RD notified by Server 4, and can also displace (slide) the display area RD while maintaining its shape and area.

[0079] In the competitive singing function according to this embodiment, the first singing user and the second singing user take turns singing the same song (hereinafter referred to as "alternating singing").

[0080] Alternating singing may take the form of, for example, a first singer finishing an entire song before a second singer singing the same song in its entirety. However, as shown in Figure 9, the competitive singing function according to this embodiment virtually divides the song into multiple regions on the time axis and sets the order in which the singing users will perform in each of these divided regions 68 (hereinafter referred to as "alternating performance setting"). As a result, the first and second singers will alternately sing the same song according to the alternating performance setting, allowing viewers to clearly recognize the difference in singing ability between the first and second singers and enjoy competitive singing more. In the following explanation, the order in which the singing users perform will be referred to as the alternating singing order.

[0081] Furthermore, the competitive singing function, as an example, highlights the lyrics that the singing user is singing, thereby allowing the singing user to recognize the divided area 68 that they are singing. The highlighting can be achieved through changes in the color or thickness of the lyrics.

[0082] In the example shown in Figure 9, the divided regions 68 are set up so that the first and second singing users sing alternately, and a divided region 68 is also set up so that the first and second singing users sing together. The divided regions 68 are set in advance based on, for example, phrases, choruses, or measures of a song, and the duration of each divided region 68 does not necessarily have to be the same.

[0083] The alternating singing order is determined when the decision is made to perform a singing battle. For example, the first singing user who initiated the battle request sings first, and the second singing user sings afterward. The divided area 68 in which the first and second singing users sing together may be pre-set for each song.

[0084] This section describes the screen display and audio output in alternating singing. Figure 8 shows the display screen of the viewer's mobile device 3B in competitive singing, where the first singing video 60A and the second singing video 60B are displayed with the same shape and size. For singing videos that are currently being performed, a display that the viewer can recognize (for example, the "NOW PLAYING" display in Figure 8) is shown.

[0085] In this context, singing videos or audio recordings that do not show actual singing are unlikely to be of interest to viewers and may distract viewers who are watching live singing.

[0086] Therefore, the competitive singing function according to this embodiment distributes singing videos to the mobile terminal 3B in such a way that the audio of the singing video in progress is output, while the audio of singing videos that are not currently in progress is not output. Furthermore, the server 4 distributes singing videos to the mobile terminal 3B in such a way that the singing video in progress is displayed larger on the screen 3a of the mobile terminal 3B than the singing video that is not currently in progress. As a result, viewers can watch competitive singing videos without their attention being distracted by singing videos that are not currently in progress.

[0087] Figure 10 shows an example of the screen display on the mobile terminal 3B during a competitive singing session. In the example in Figure 10, the first singing video 60A is in the process of singing, while the second singing video 60B is not. Therefore, the first singing video 60A is displayed in a magnified (full-screen) view, while the second singing video 60B is displayed in a reduced (windowed) view. The size and position of the reduced singing video on screen 3a may be predetermined, or the viewer may be able to change its size and position arbitrarily on the mobile terminal 3B. For example, on the mobile terminal 3B, similar to screen 3a of the mobile terminal 3A shown in Figure 5, vertical lines LDv and horizontal lines LDs that correspond to the outer frame of one of the videos to be reduced may be displayed, and the shape, size, and position of the reduced display may be changed by displacing each of these lines.

[0088] Furthermore, the competitive singing function according to this embodiment distributes the singing videos to the mobile terminal 3B so that, based on the alternating singing order described above, audio output of the first singing video 60A and the second singing video 60B, or screen display of the first singing video 60A and the second singing video 60B, is performed.

[0089] Specifically, in the divided area 68 where the first singing user performs, the audio of the first singing video 60A is output and the first singing video 60A is displayed enlarged, while the audio of the second singing video 60B is not output and the second singing video 60B is displayed in a reduced size. Similarly, in the divided area 68 where the second singing user performs, the audio of the second singing video 60B is output and the second singing video 60B is displayed enlarged, while the audio of the first singing video 60A is not output and the first singing video 60A is displayed in a reduced size. Furthermore, in the divided area 68 where the first and second singing users perform together, as shown in Figure 8, the first singing video 60A and the second singing video 60B are displayed on the screen with the same shape and size, and both have audio output.

[0090] Let me explain the voting function. The video posting and viewing app has a voting function that accepts evaluations (hereinafter referred to as "votes") for each singing video in competitive singing from the viewing user's mobile device 3B.

[0091] Voting is performed by viewers tapping an operation icon 58A provided for each singing video, as shown in Figures 8 and 10. In other words, viewers tap the operation icon 58A to indicate their positive evaluation of a singing video if they find it appealing or otherwise enjoyable. An image (hereinafter referred to as the "voting result image") 66 showing the evaluation results for each singing video is then delivered and displayed on the screen 3a of the mobile device 3B along with the singing video.

[0092] As described above, the voting function according to this embodiment allows viewers to evaluate competitive singing videos by, for example, tapping the operation icon 58A. This makes it easy for viewers to determine the superiority or inferiority of the singing performances when competitive singing takes place. Viewers can also evaluate both singing videos simultaneously.

[0093] The voting function accepts score inputs as votes and derives the total score entered during the streaming of the singing video (hereinafter referred to as "total evaluation score") as the evaluation result. The total evaluation score is the sum of the scores entered by multiple viewing users. The voting function then determines the winner of the singing competition based on the total evaluation score entered by the end of the singing competition. In other words, the singing user of the singing video with a relatively high total evaluation score is declared the winner. Thus, with the voting function according to this embodiment, multiple viewing users can cooperate in voting for the singing user (singing video) they support, making their supported singing user the winner, and thus viewers can empathize more with the singing user.

[0094] In this embodiment, the voting function inputs 1 point each time the operation icon 58A is tapped. The numbers ("21" and "185") in the voting result image 66 shown in Figures 8 and 10 represent the total evaluation score for each singing user (singing video), and the bar image that extends to the left and right of screen 3a and has different hatching (color) on the left and right sides shows the total evaluation score for each singing video relatively.

[0095] Furthermore, there is an upper limit (hereinafter referred to as the "tap limit") on the number of times each viewer can tap the operation icon 58A, and in this embodiment, the tap limit is one tap. When the tap limit is reached, the operation icon 58D is displayed on screen 3a in place of the operation icon 58A, as shown in Figure 10.

[0096] By tapping the operation icon 58D, viewers can overlay decorative images (hereinafter referred to as "tipping effect images") onto the singing video corresponding to the tapped operation icon 58D. Thus, the voting function has a tipping effect function that accepts requests for tipping effect images to be overlaid on the singing video from the mobile device 3B and overlays the received tipping effect images onto the singing video. In the following explanation, the instruction (selection) of a tipping effect image to be displayed by a viewer via the mobile device 3B will be referred to as tipping input, as described above.

[0097] In other words, viewers can decorate singing videos they find appealing by overlaying a tipping effect image onto them, thus the tipping effect function can enhance the viewing experience and the singing video itself during its distribution. The tipping effect function is executed by server 4 in response to display instructions from viewers via the video posting and viewing app.

[0098] Furthermore, an image (icon image 64) representing a viewer who has given a relatively higher rating (vote) to a singing video than other viewers, i.e., a viewer who has entered a large number of points (hereinafter referred to as "high-rated users"), may be displayed on the screen 3a of the mobile device 3B. This allows viewers to make other viewers aware of the singer they are supporting. In addition, viewers can also make the singer aware that they are supporting them.

[0099] As shown in Figure 11, the mobile terminal 3A consists of an input unit 71, a terminal output unit 73, a first display control unit 75, a first communication unit 77, and the like. The input unit 71 receives various inputs such as instructions to start shooting or recording a singing video, instructions to select a song, a battle request, acceptance of a battle request or battle song, instructions to change the display area RD, shooting a singing video, and singing audio.

[0100] The terminal output unit 73 performs functions such as music playback, display of singing videos and the display area RD.

[0101] The first display control unit 75 displays at least a portion of the singing video (in this example, the singing video) on the terminal output unit 73. The first display control unit 75 displays the display area RD together with the singing video on the terminal output unit 73. It is preferable that the first display control unit 75 displays the display area RD superimposed on the singing video on the terminal output unit 73, and this is done in this example as well. It is preferable that the first display control unit 75 changes the display area RD while maintaining the aspect ratio based on the display area RD.

[0102] The first communication unit 77 transmits at least a portion of the singing video (in this example, the singing video) to the mobile terminal 3B via the server 4. When the display area RD is changed, it is preferable to notify the mobile terminal 3B of the changed display area RD, and this is done in this example as well.

[0103] The input unit 71 includes a touch panel display (screen) 3a, a microphone 3c, a camera 3d, and operation buttons 48, as shown in Figure 3. The terminal output unit 73 includes a touch panel display (screen) 3a, a speaker 3b, and an earphone jack 3e. The first display control unit 75 includes a main control unit 40, a main memory unit 42, and an auxiliary memory unit 44. The first communication unit 77 includes a communication unit 46.

[0104] The competitive singing process on mobile terminal 3A will be explained with reference to Figure 12. Competitive singing begins when a competitive request is made at the input unit 71 of mobile terminal 3A1 and this competitive request is received by the server 4, and furthermore, when the competitive request is acknowledged at the input unit 71 of mobile terminal 3A2 and this acknowledgment is confirmed by the server (S11).

[0105] When server 4 confirms acceptance of the battle request, server 4 generates a composite image 60 (see Figures 8 and 10), and mobile terminal 3A1 receives notification from server 4 of the display area RD of the first singing video 60A in the composite image 60 (see Figures 4 and 5), while mobile terminal 3A2 receives notification from server 4 of the display area RD of the second singing video 60B (S13).

[0106] After receiving notification of the display area RD from the server 4, the mobile terminal 3A displays the received display area RD on the screen 3a of the terminal output unit 73 via the first display control unit 75 (S14). The mobile terminal 3A determines whether or not it has received an instruction to change the display area RD by input to the input unit 71, for example, by moving a line segment LD (see Figure 5) (S15). If it is determined in step S15 that an instruction to change the display area RD has been received, the first display control unit 75 generates an image of the changed display area RD based on the received instruction and displays it on the screen 3a of the terminal output unit 73 (S17). The first communication unit 77 also notifies the viewing user's mobile terminal 3B of the changed display area RD (S18). In this example, the notification is sent to the viewing user's mobile terminal 3B via the server 4, but it is also possible to configure the system to notify the mobile terminal 3B without going through the server 4.

[0107] If the mobile terminal 3A determines in step S15 that it has not received an instruction to change the display area RD, it distributes the battle singing video to the mobile terminal 3B via the server 4 (S19). In step S15, for example, if no instruction to change the display area RD is input to the input unit 71 within a predetermined time from step S14, it may be determined that there is no instruction to change, or if an instruction to start playback and recording of the battle song is input to the input unit 71 regardless of the elapsed time from step S14, it may be determined that there is no instruction to change. In this example, when an instruction to start playback and recording of the battle song is input to the input unit 71, the battle singing video is distributed to the mobile terminal 3B via the server 4. In step S19, the mobile terminal 3A combines the battle singing video with the song data and singing data of the battle song to create battle singing video data, and distributes the singing video by distributing this singing video data.

[0108] The process of changing the display area RD can be performed either before or after the start of the singing video distribution (S19), or both, after receiving notification of the display area RD from the server 4. In this example, the process of changing the display area RD, i.e., step S15, and steps S17 and S18 if it is determined in step S15 that there is an instruction to change, is also performed after step S19, and is shown as steps S21, S23, and S24 in Figure 12. Each time the display area RD is changed, in this example the first communication unit 77 notifies the mobile terminal 3B of the changed display area RD via the server 4. If no instruction to change the display area RD is input to the input unit 71 in step S21, it is determined that there is no instruction and playback of the battle song continues.

[0109] Step S21 is repeated as long as the playback of the battle song has not finished (S25). After the playback of the battle song has finished (S25), the mobile device 3A stops distributing the battle singing video (S27).

[0110] Furthermore, when the mobile terminal 3A distributes non-competitive singing videos, it performs the display area RD modification process (S15, S17, S18) after the recording of the singing video has started. The display area RD can also be modified (S21, S23, S24) after the recording or distribution of the singing video has started.

[0111] As shown in Figure 13, Server 4 comprises a match request reception unit 80, a match acceptance determination unit 81, a match setting unit 82, a video evaluation unit 83, a tipping effect superimposition unit 84, a second display control unit 87, and a second communication unit 88. The processing performed by each function of Server 4 is realized by information processing programs stored in HDD 26.

[0112] The match request receiving unit 80, match acceptance determination unit 81, match setting unit 82, video evaluation unit 83, tipping effect superimposition unit 84, and second display control unit 87 are configured to include the CPU 20, ROM 22, RAM 24, and HDD 26 shown in Figure 2. The second communication unit 88 is configured to include the external interface 32.

[0113] The battle request receiving unit 80 receives a battle request from the first singing user to the second singing user. The battle acceptance determination unit 81 determines whether the second singing user has accepted the battle request from the first singing user.

[0114] The battle setting unit 82 performs various settings for competitive singing, such as setting the song to be performed and setting the singing order. The battle setting unit 82 divides the song into multiple division regions 68 (see Figure 9) along the time axis, i.e., in chronological order, and sets the order in which the singing users will perform (alternating singing order) for each division region 68.

[0115] The video evaluation unit 83 receives input of evaluations (scores) for each singing video distributed to the mobile terminal 3B, as well as the superimposition of tipping effect images (not shown) onto the singing videos (tipping input) from the mobile terminal 3B. The video evaluation unit 83 then derives the total evaluation score entered during the distribution of the singing videos and determines the winner or loser of the singing competition.

[0116] The tipping effect overlay unit 84, upon receiving a tipping input, overlays a tipping effect image (not shown) corresponding to the received tipping input onto the singing video.

[0117] A video distribution module (not shown) that distributes singing videos to the mobile terminal 3B is configured by the second display control unit 87, the second communication unit 88, etc. When the battle acceptance determination unit 81 makes a positive determination that the second singing user has accepted the battle request from the first singing user, the second display control unit 87 generates a composite image 60 (see Figures 8 and 10) based on the first singing video 60A from the mobile terminal 3A1 and the second singing video 60B from the mobile terminal 3A2. When generating the composite image 60, the second display control unit 87 sets (including changes) the display areas RD of the first singing video 60A and the second singing video 60B.

[0118] The second communication unit 88 transmits the composite image 60 to the mobile terminal 3B. As a result, the composite image 60 is displayed on the mobile terminal 3B. The second communication unit 88 also notifies the mobile terminal 3A1 of the display area RD of the first singing video 60A displayed in the composite image 60, and notifies the mobile terminal 3A2 of the display area RD of the second singing image 60B displayed in the composite image 60.

[0119] Mobile terminal 3A1 receives notification of a display area RD from the second communication unit 88 via the first communication unit 77, and the first display control unit 75 displays the notified display area RD on screen 3a together with the first singing video. Similarly, mobile terminal 3A2 receives notification of a display area RD from the second communication unit 88 via the first communication unit 77, and the first display control unit 75 displays the notified display area RD on screen 3a together with the second singing video.

[0120] The competitive singing process on Server 4 will be explained with reference to Figure 14. The information processing program for executing the competitive singing process according to this embodiment is pre-stored in a predetermined area of ​​HDD 26. The HDD 26 of Server 4, which performs the competitive singing process, stores an information processing program that executes a display control step which displays at least a portion of the captured image (singing video) on the display, and a communication step which transmits at least a portion of the captured image to the receiving terminal device (mobile terminal 3B). The display control step stores an information processing program that displays the display area of ​​the captured image on the receiving terminal device together with the captured image on the display.

[0121] First, in step S31, the battle request receiving unit 80 determines whether the first singing user has requested a battle from the second singing user. If the determination is positive, that is, if a battle request from the first singing user has been received, the system proceeds to step S33. On the other hand, if the determination is negative, the system enters a waiting state until a battle request is received.

[0122] In step S33, the battle acceptance determination unit 81 determines whether the second singing user has accepted the battle request. If the determination is positive, the process proceeds to step S37; otherwise, the process returns to step S31.

[0123] In step S37, the second display control unit 87 sets the display areas RD for the first singing video 60A and the second singing video 60B. The setting of the display areas RD is done, for example, based on the number of mobile terminals 3A performing the competitive singing. After step S37, the second display control unit 87 generates a composite image 60 using the first singing video 60A and the second singing video 60B corresponding to the display areas RD (S38). When the second display control unit 87 has set the display areas RD for the first singing video 60A and the second singing video 60B, it notifies mobile terminal 3A1 of the display area RD set for the first singing video 60A and notifies mobile terminal 3A2 of the display area RD set for the second singing video 60B (S39). The notification in step S39 corresponds to the notification in step S13 in Figure 12. As a result, the display areas RD are displayed on mobile terminals 3A1 and 3A2 along with the first singing video and the second singing video, respectively. After the notification in step S39, the battle setting unit 82 performs various settings for performing the battle song (S40).

[0124] In step S42, the second communication unit 88 of the server 4 determines whether or not it has received notification of a change in the display area RD from the mobile terminal 3A1 or mobile terminal 3A2 (simply referred to as "notification of display area" in Figure 14). If the second communication unit 88 has received notification of a change in the display area RD, it makes an affirmative determination in step S42, and the second display control unit 87 regenerates the composite image 60 based on the first and second singing videos corresponding to the display area RD that is changed based on the received notification (S43). If the second communication unit 88 has not received notification, it makes a negative determination in step S42, and the second communication unit 88 starts distributing the battle singing video (S45). The battle singing video to be distributed includes the composite image 60 generated (including regenerated) by the second display control unit 87. As a result, at least a portion of the first singing video and at least a portion of the second singing video are displayed on the screen 3a of the mobile terminal 3B as the composite image 60. Step S42 may occur before step S40.

[0125] After the start of distribution of the battle singing video in step S45, if the server 4 acquires the notification in step S24 (Figure 12) via the second communication unit 88 (S48), it regenerates the composite image 60 based on the first and second singing videos corresponding to the acquired display area RD (S49) and distributes it. If it does not acquire the notification, it continues distributing the composite image 60 that is currently being distributed and the song progresses. Step S48 is repeated as long as the playback of the battle song has not finished (S51).

[0126] In this example, in step S38, the server 4 generates the composite image 60, and in step S49, the server 4 regenerates the composite image 60. However, at least one of the generation or regeneration of the composite image 60 may be performed by the mobile terminal 3B used by the viewing user. When the generation and regeneration of the composite image 60 are performed by the mobile terminal 3B, the mobile terminal 3B may be equipped with a third display control unit (not shown) configured similarly to the second display control unit 87 of the server 4. When the composite image 60 is generated by the mobile terminal 3B, the server 4 notifies the mobile terminal 3B of the display area RD set in step S37, along with the transmission of the first and second singing videos, for example in step S45, and the mobile terminal 3B generates the composite image 60 corresponding to the notified display area RD. When the composite image 60 is regenerated by the mobile terminal 3B, the server 4, having received the notification in step S24 of Figure 12, may send the received notification to the mobile terminal 3B along with the transmission of the singing video received from the mobile terminal 3A. Furthermore, if the mobile terminal 3B is responsible for regenerating the composite video 60, the notification in step S24 of Figure 12 may be sent directly from the mobile terminal 3A to the mobile terminal 3B without going through the server 4.

[0127] In step S51, the video distribution module (not shown) determines whether the song for the singing competition has finished. If the determination is positive, the second communication unit 88 terminates the distribution of the singing competition video (S53). On the other hand, if the determination in step S51 is negative, the second communication unit 88 continues to distribute the singing competition video until the song finishes.

[0128] In the case of non-competitive singing, server 4 may acquire the singing video data distributed from mobile terminal 3A and store it in a designated area of ​​HDD 26 (see Figure 2). In addition, in the case of non-competitive singing, the singing video data may be transmitted to mobile terminal 3B without going through server 4.

[0129] The outcome of a singing competition is not limited to being determined by user votes. For example, the singing competition feature could have an automatic scoring function, and the winner could be determined by the results of this automatic scoring function.

[0130] Furthermore, while the above embodiment described a form in which the performance is singing and the video uploaded to the video sharing site is a singing video, the present invention is not limited to this. For example, the performance may be dance and the video uploaded to the video sharing site may be a dance video, so the performance may be something other than singing.

[0131] <Note> The present invention provides an information processing device capable of communicating with a receiving terminal device, comprising: a display control unit that displays at least a portion of a captured image on a display; and a communication unit that transmits at least a portion of the captured image to the receiving terminal device, wherein the display control unit causes the display area of ​​the captured image on the receiving terminal device to be displayed on the display together with the captured image. This allows the transmitting terminal device to recognize the image displayed on the receiving terminal device.

[0132] The display control unit preferably displays the area display image, which indicates the display area, on the display on the screen, superimposed on the captured image. This allows the transmitting terminal device to intuitively understand the image to be displayed on the receiving terminal device.

[0133] It is even more preferable that the display control unit changes the display area while maintaining the aspect ratio based on the display area, and the communication unit notifies the receiving terminal device of the changed display area. This allows the transmitting terminal device to adjust the image displayed on the receiving terminal device.

[0134] The information processing system of the present invention is an information processing system that can communicate between a transmitting terminal device and a receiving terminal device, and comprises a display control unit that displays at least a portion of a captured image on the display of the transmitting terminal device, and a communication unit that transmits at least a portion of the captured image to the receiving terminal device, wherein the display control unit causes the display area of ​​the captured image on the receiving terminal device to be displayed on the display together with the captured image. This allows the transmitting terminal device to recognize the image displayed on the receiving terminal device.

[0135] The information processing system further comprises a server device that communicates with a plurality of transmitting terminal devices, including a first transmitting terminal device and a second transmitting terminal device, and a receiving terminal device. The server device transmits a composite image generated based on a first captured image from the first transmitting terminal device and a second captured image from the second transmitting terminal device to the receiving terminal device, notifies the first transmitting terminal device of a first display area from the first captured image that is displayed in the composite image, and notifies the second transmitting terminal of a second display area from the second captured image that is displayed in the composite image. Preferably, the first transmitting terminal device displays the first display area together with the first captured image on its display, and the second transmitting terminal device displays the second display area together with the second captured image on its display. This allows the transmitting terminal device to recognize the image displayed on the receiving terminal device, even if there are multiple transmitting terminal devices.

[0136] The information processing program of the present invention is an information processing program that causes a computer of an information processing device that can communicate with a receiving terminal device to execute a display control step of displaying at least a portion of a captured image on a display, and a communication step of transmitting at least a portion of the captured image to the receiving terminal device, wherein the display control step causes the display area of ​​the captured image on the receiving terminal device to be displayed on the display together with the captured image. The present invention is an information processing method for communicating with a receiving terminal device, and includes a display control step of displaying at least a portion of a captured image on a display, and a communication step of transmitting at least a portion of the captured image to the receiving terminal device, wherein the display control step causes the display area of ​​the captured image on the receiving terminal device to be displayed on the display together with the captured image. Through these information processing programs and methods, the image displayed on the receiving terminal device is recognized by the transmitting terminal device. [Explanation of symbols]

[0137] 1. Karaoke System 3A, 3B Mobile devices 3a screen 4 servers 50B Image display area 60 composite images 60A First Singing Video 60B Second singing video 75 First Display Control Unit 77. First Communications Department 87 Second Display Control Unit 88 Second Communications Department RD display area

Claims

1. Equipped with a first terminal device and a server, The first terminal device is At least a portion of the first captured image, including the user's performance, captured by the camera of the first terminal device, is transmitted to the server. The display area of ​​the first captured image displayed on the second terminal device is displayed on the display of the first terminal device. The aforementioned server, A composite image generated based on at least a portion of the first captured image and at least a portion of the second captured image, which includes the user's performance captured by a camera of a terminal device different from the second terminal device, is transmitted to the second terminal device. When changing the display area in the composite image where the first captured image is displayed from the display area displayed on the display of the first terminal device, the display area after the change is notified to the first terminal device. system.

2. The first terminal device transmits at least a portion of the first captured image, which includes the user's performance captured by the camera of the first terminal device, to the server. The first terminal device displays the display area of ​​the first captured image, which is displayed on the second terminal device, on the display of the first terminal device. The server transmits to the second terminal device a composite image generated based on at least a portion of the first captured image and at least a portion of the second captured image, which includes the user's performance captured by a camera of a terminal device different from the second terminal device. When the server changes the display area in the composite image where the first captured image is displayed from the display area displayed on the first terminal device's display, it notifies the first terminal device of the changed display area. method.

3. The server receives at least a portion of the first captured image, which includes the user's performance captured by the camera of the first terminal device, transmitted from the first terminal device. The server is instructed to transmit to the second terminal device a composite image generated based on at least a portion of the first captured image and at least a portion of the second captured image, which includes the user's performance captured by a camera on a terminal device different from the second terminal device. The server causes the display area of ​​the first captured image, which is displayed on the second terminal device, to be displayed on the display of the first terminal device. When the server changes the display area in the composite image where the first captured image is displayed from the display area displayed on the display of the first terminal device, it will notify the first terminal device of the changed display area. program.

4. The terminal device is instructed to transmit at least a portion of the first captured image, which includes the user's performance captured by the camera of the terminal device, to the server. The terminal device is to receive a composite image generated based on at least a portion of the first captured image and at least a portion of the second captured image, which includes the user's performance captured by a camera of a terminal device different from the second terminal device. The display area of ​​the first captured image displayed on the display of the second terminal device is then displayed on the display of the second terminal device. When changing the display area in the composite image where the first captured image is displayed from the display area shown on the display, the terminal device receives notification of the changed display area from the server. program.

5. Receiving at least a portion of a first captured image, which includes the user's performance captured by the camera of the first terminal device, transmitted from the first terminal device, A composite image is generated based on at least a portion of the first captured image and at least a portion of the second captured image, which includes the user's performance captured by a camera on a terminal device different from the second terminal device, and transmitted to the second terminal device. The display area of ​​the first captured image displayed on the second terminal device is displayed on the display of the first terminal device. When changing the display area in the composite image where the first captured image is displayed from the display area displayed on the display of the first terminal device, the display area after the change is notified to the first terminal device. Information processing device.

6. Transmit at least a portion of a first captured image, including the user's performance, captured by the camera of the terminal device, to a server. In a second terminal device to which a composite image is transmitted, generated based on at least a portion of the first captured image and at least a portion of a second captured image including the user's performance captured by a camera of a terminal device different from the second terminal device, the display area of ​​the first captured image is displayed on the display. When changing the display area in the composite image in which the first captured image is displayed from the display area displayed on the display, the server receives notification of the changed display area. Terminal device.

Images