Content distribution system and computer system

Abstract

To provide a technique for being richer a user experience by using a transmission function of a text or an image.SOLUTION: A streaming server 1100 distributes a content containing at least video image provided by a provision user to a user terminal 1500 of each viewing user. In the streaming server 1100, a transmission service management part 230 performs a control for causing a transmission content to be displayed on the transmission content display part in a viewing screen of each user terminal 1500 in response to receiving a transmission against a multimedia content during viewing from the user terminal 1500. At the time, an index value determination part 231 determines an index value for determining a display formation of the transmission content by using a user achievement of at least each viewing user. Then, a display formation setting part 233 performs the control for causing a display formation of the transmission content to be changed on the basis of the index value of the viewing user in accordance with the transmission.SELECTED DRAWING: Figure 8

Description

[Technical Field]

[0001] The present invention relates to a content distribution system that distributes content including at least video provided by a providing user to user terminals of each viewing user. [Background technology]

[0002] BACKGROUND ART Social networking services (SNS) that allow users to send text and images using functions called chat functions and text functions (see, for example, Patent Document 1), content distribution services, and the like are known.

[0003] The use of chat and text functions promotes communication between users. For example, in the case of a video distribution service, users can send and post text messages while watching a video, creating a virtual experience that makes it seem as if everyone is watching the video together.

[0004] When chat or text functions allow users to send images in addition to text, the sending of such images is sometimes called "image posting." For example, by sending (in this case, also called posting) images of characters with dialogue displayed in speech bubbles or of characters performing actions such as joy, anger, sadness, or happiness, users can succinctly express emotions and feelings that cannot be expressed in words.

[0005] The various user experiences provided by these functions for transmitting text and images can even be said to have become an indispensable standard in recent social networking services (SNS) and content distribution services. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Japanese Patent Application Laid-Open No. 2017-91393 Summary of the Invention [Problem to be solved by the invention]

[0007] The present invention aims to provide a technology for enriching the user experience by utilizing the function of transmitting text and images. [Means for solving the problem]

[0008] A first invention for solving the above problems is a content distribution system (e.g., streaming server 1100 in FIG. 1) that distributes content including at least video provided by a providing user to a user terminal of each viewing user (e.g., user terminal 1500 in FIG. 1), wherein the user terminal displays a viewing screen (e.g., viewing screen W in FIG. 3) that includes a content display unit (e.g., content display unit 32 in FIG. 3) that displays the content, an operation unit (e.g., call operation unit 33 in FIG. 3) that allows the viewing user to perform a call operation for the content being viewed, and a message content display unit (e.g., message content display unit 34 in FIG. 3) that displays the message content of each viewing user, and a transmission content display control means (e.g., the transmission service management unit 230, the display form setting unit 233, the transmission content display control unit 235 in FIG. 8) that receives a transmission for the content being viewed from the user terminal and controls the display of the transmission content on the transmission content display unit, and that controls changing the display form of the transmission content based on the index value of the viewing user related to the transmission.

[0009] According to the first aspect of the present invention, an index value is determined using the user record of each viewing user who is viewing content, and the determined index value can be used to change the display format of the content sent by the viewing user when the viewing user performs a sending operation. This makes it possible, for example, to make the content sent by a viewing user with a high user record (e.g., experience value in viewing and sending) stand out compared to others, thereby increasing their sending power. Therefore, each viewing user can be encouraged to individually improve their viewing record and sending record, thereby providing a user experience that makes it seem as if multiple viewing users are gathering together and enjoying the content, and giving the viewing users a sense of excitement and excitement.

[0010] In addition, as a second invention, the content distribution system of the first invention may be configured such that the transmission content display control means changes the degree to which the display format of the transmission content is changed based on whether or not the user terminal is that of the viewing user related to the transmission.

[0011] According to the second invention, for example, it is possible to significantly change the display format of the content sent by the sender on the sender's user terminal, while to lessen the degree of change in the display format of the content sent by the sender on other user terminals.

[0012] In addition, as a third invention, the content distribution system of the first invention may be configured such that the user terminal that changes the display format of the transmission content is the user terminal of the viewing user related to the transmission.

[0013] According to the third aspect of the present invention, the display format of the contents of a message sent by a sender can be changed only at the user terminal of the sender.

[0014] Furthermore, as a fourth invention, the content distribution system may be configured as any of the first to third inventions, in which the transmission content display control means controls to change the display format of the transmission content based on the ranking of the index value of the viewing user related to the transmission.

[0015] According to the fourth aspect of the present invention, the index values ​​of the viewing users are ranked, and the display format of the message content can be changed according to the ranking of the sender.

[0016] In addition, as a fifth invention, the index value determination means may be configured to determine the index value of each viewing user by performing statistical processing of the user performance of each viewing user based on the number of viewing users, thereby configuring a content distribution system of any of the first to fourth inventions.

[0017] According to the fifth aspect of the present invention, the index value of each viewing user can be determined by performing statistical processing of the user record of each viewing user based on the number of viewing users.

[0018] Furthermore, as a sixth invention, the content distribution system of any of the first to fifth inventions may be configured such that the operation unit is capable of selectively inputting characters and / or images as transmission elements, and the transmission content display control means controls the change of at least one of the display size, display color, and display time of the transmitted characters and / or images based on the index value.

[0019] According to the sixth aspect of the present invention, at least one of the display size, display color, and display time of the characters and / or images selected and input as the content of the message can be changed and displayed.

[0020] Furthermore, as a seventh invention, the content distribution system of the sixth invention may be configured such that the transmission content display control means variably sets the display area in the transmission content display unit for displaying the transmission content of each viewing user according to the number of viewing users, and controls the display area to adjust the display area if the display size exceeds the display area as a result of controlling the change in the display size.

[0021] According to the seventh invention, the display area for the content transmitted by each viewing user can be variably set according to the number of viewing users, and when the changed display size exceeds the display area, the display area can be adjusted.

[0022] In addition, as an eighth invention, the content distribution system of the seventh invention may be configured such that the transmission content display control means controls the display of transmission content after a given display time has elapsed, and adjusts the display area of ​​the new transmission content based on the display status of the transmission content when the new transmission content is displayed.

[0023] According to the eighth aspect of the present invention, the contents of messages from each viewing user can be displayed for a given display time. When a new message is sent and the new message is displayed, the display area for the new message can be adjusted based on the display status of other messages.

[0024] Furthermore, as a ninth invention, the content distribution system of any of the first to eighth inventions may be configured such that the index value determination means uses at least one of the viewing user's billing amount, billing frequency, number of virtual currency equivalent points consumed, and user level as the user performance.

[0025] According to the ninth aspect of the present invention, the index value can be determined using at least one of the amount charged by the viewing user, the charging frequency, the number of consumed points equivalent to virtual currency, and the user level.

[0026] As a tenth aspect of the present invention, the content distribution system of any one of the first to ninth aspects of the present invention may be configured such that the content is live broadcast content.

[0027] According to the tenth aspect, content can be distributed live.

[0028] As an eleventh invention, the content distribution system of any one of the first to ninth inventions may be configured, wherein the content is live broadcast content of gameplay video.

[0029] According to the eleventh aspect of the present invention, the game screen during game play can be broadcast live.

[0030] In addition, as a 12th invention, the content distribution system of the 11th invention may be configured such that the transmission content display control means further controls changing the display format of the transmission content depending on the game status related to the game play video being viewed.

[0031] According to the twelfth aspect, the display format of the message content can be further changed according to the game situation related to the game play video.

[0032] Furthermore, as a thirteenth invention, the content distribution system of any of the first to twelfth inventions may be configured to include an avatar display control means (e.g., avatar display control unit 220 of FIG. 8) that displays an avatar for each viewing user on the viewing screen, and the transmission content display control means controls the display of the transmission content so that it is associated with the avatar of the viewing user who transmitted the transmission content.

[0033] According to the thirteenth aspect of the present invention, the transmitted content can be displayed in association with the avatar of the viewing user.

[0034] Furthermore, as a fourteenth aspect of the present invention, a computer system (for example, the content providing system 1000 in FIG. 1) may be configured that includes a user terminal of each viewing user and the content distribution system of any one of the first to thirteenth aspects of the present invention.

[0035] The term "computer system" as used herein may refer to a system consisting of a single computer or a system consisting of multiple computers connected to each other so that they can communicate with each other. According to the fourteenth aspect of the present invention, a computer system that achieves the same effects as the first aspect of the present invention can be realized. [Brief explanation of the drawings]

[0036] [Figure 1] FIG. 1 is a diagram showing an example of the overall configuration of a content providing system. [Figure 2] FIG. 2 is a diagram showing an example of the device configuration of a user terminal. [Figure 3] FIG. 2 is a diagram showing an example of the screen configuration of a viewing screen. [Figure 4] FIG. 10 is a diagram showing an example of a correspondence relational expression between a form determination index value and a display size. [Figure 5] 10A to 10C are diagrams illustrating a display size correction process. [Figure 6] FIG. 10 is a diagram showing a display example of a call content display unit. [Figure 7] FIG. 10 is a diagram showing another example of display on the call content display unit. [Figure 8] FIG. 2 is a block diagram showing an example of the functional configuration of a streaming server. [Figure 9] FIG. 4 is a diagram showing an example of the data configuration of user management data. [Figure 10] FIG. 4 is a diagram showing an example of the data structure of distribution management data. [Figure 11] FIG. 10 is a diagram showing an example of the data configuration of call content display management data. [Figure 12] FIG. 2 is a block diagram showing an example of the functional configuration of the viewing terminal. [Figure 13] FIG. 2 is a block diagram showing an example of the functional configuration of a providing terminal. [Figure 14] 10 is a flowchart showing the flow of processing by a streaming server. [Figure 15] 15 is a flowchart showing the flow of processing of the streaming server following FIG. 14. [Figure 16] 10 is a flowchart showing the flow of processing of the viewing terminal. [Figure 17] 10 is a flowchart showing the flow of processing by a providing terminal. [Figure 18] FIG. 10 is a diagram showing an example of a chat screen display when the present invention is applied to a chat function of a social networking service. DETAILED DESCRIPTION OF THE INVENTION

[0037] Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. Note that the present invention is not limited to the embodiments described below, and the forms to which the present invention can be applied are not limited to the following embodiments. In addition, in the description of the drawings, the same parts are given the same reference numerals.

[0038] 1 is a diagram showing an example of the overall configuration of a content providing system 1000 to which the present invention is applied. The content providing system 1000 is a computer system that provides a streaming distribution service that allows an unspecified number of people to enjoy content simultaneously, and includes a streaming server 1100 and multiple user terminals 1500 (1500a, 1500b, ..., 1500T), which are connected to each other via a communication line 9 so that data can be communicated with each other.

[0039] The communication line 9 refers to a communication path that allows data communication. That is, the communication line 9 includes a dedicated line (dedicated cable) for direct connection, a LAN (Local Area Network) such as Ethernet (registered trademark), a telephone communication network, a cable network, the Internet, and other communication networks, and the communication method can be either wired or wireless.

[0040] The streaming server 1100 is a computer system that realizes a content distribution system that streams content including at least video provided from the user terminal 1500 (1500T) of the providing user 2 (2t) to the user terminals 1500 (1500a, 1500b, ...) of each viewing user 2 (2a, 2b, ...).

[0041] Specifically, the streaming server 1100 includes a main device 1101, a keyboard 1106, a touch panel 1108, and a storage 1140. The main device 1101 incorporates a control board 1150 on which are mounted electronic components such as a CPU (Central Processing Unit) 1151, various microprocessors such as a GPU (Graphics Processing Unit) and a DSP (Digital Signal Processor), various IC memories 1152 such as a VRAM, RAM and ROM, and a communication device 1153. Note that part or all of the control board 1150 may be realized by an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or an SoC (System on a Chip).

[0042] The streaming server 1100 performs calculations based on predetermined programs and data using the control board 1150, and 1) User management functions related to user registration, etc. 2) Multimedia content streaming service function, 3) A user transmission service function that distributes text and images transmitted (or posted) from the user terminal 1500; 4) An online shopping function that allows users to purchase images and other items online that can be sent using the user sending service function; Of course, it is also possible to configure the device to realize functions other than those mentioned above. For example, it may be possible to realize a social networking service function, or a chat function as part of that function.

[0043] The streaming distribution service function acquires multimedia content such as video data from the user terminal 1500T of the providing user 2t, who is a user who provides the multimedia content, and distributes the acquired multimedia content to the user terminals 1500 (1500a, 1500b, ...) of the viewing users 2 (2a, 2b, ...), who are registered viewers, in a format that allows viewing while the content file is being downloaded.

[0044] The user transmission service function is a function that distributes text and images transmitted from the user terminal 1500 (1500a, 1500b, ...) of the viewing user 2 (2a, 2b, ...) to the user terminal 1500 (1500a, 1500b, ...) of each viewing user 2 (2a, 2b, ...) and the user terminal 1500T of the providing user 2t, and displays the transmitted content at the distribution destination.

[0045] The online shopping function is a function for purchasing transmission images and the like by consuming virtual currency equivalent points (hereinafter simply referred to as "points") owned by the viewing user, and performs the point purchase procedure (billing process) in cooperation with an external electronic settlement server operated by an electronic settlement service provider or the like in response to a request from the user terminal 1500. During the billing process, the electronic settlement server responds to an inquiry from the streaming server 1100 and performs a process of settling the purchase amount of points with the user's credit card, prepaid card, or the like. Then, the streaming server 1100 grants the user points equivalent to the purchase amount settled by the electronic settlement server.

[0046] 1, the streaming server 1100 may be configured to include multiple blade servers each performing a different function, connected to each other via an internal bus for data communication. Alternatively, the streaming server 1100 may be configured to function as a whole as a streaming server 1100 by having multiple independent servers installed in remote locations communicate with each other via a communication line 9.

[0047] The user terminals 1500 (1500a, 1500b, ..., 1500T) are computer systems used by users 2 (2a, 2b, ..., 2t), and by changing the programs they run, they can function as a provider terminal that creates multimedia to be provided for streaming distribution, or as a viewing terminal that enables viewing of streaming-distributed multimedia content. In the example of FIG. 1, the user terminal 1500T corresponds to the provider terminal, and the user terminals 1500a and 1500b correspond to the viewing terminals. Note that the user terminal 1500 in this embodiment is a device known as a smartphone, but it may also be a portable game device, a personal computer, a tablet computer, a wearable computer, etc.

[0048] FIG. 2 is a diagram showing an example of the device configuration of a smartphone, which is an example of a user terminal 1500. As shown in FIG. 2, the user terminal 1500 includes a directional input key 1502, a home key 1504, a touch panel 1506 that functions as an image display device and a contact position input device, an internal battery 1509, a speaker 1510, a microphone 1512, an image sensor module 1520, a control board 1550, and a memory card reader 1542 that can read and write data from and to a memory card 1540, which is a computer-readable storage medium. Other features include a power button, a volume control button, and the like (not shown). The user terminal 1500 may also include an IC card reader that can contactlessly read and write data from IC card-type credit cards or prepaid cards that can be used to pay for game play.

[0049] The control board 1550 is equipped with various microprocessors such as a CPU 1551, a GPU, and a DSP; various IC memories 1552 such as a VRAM, a RAM, and a ROM; a wireless communication module 1553 for wireless communication with a mobile phone base station or a wireless LAN base station connected to the communication line 9; and an interface circuit 1557. The interface circuit 1557 includes a circuit for receiving signals from the direction input keys 1502 and the home key 1504, a driver circuit for the touch panel 1506, an output amplifier circuit for outputting audio signals to the speaker 1510, an audio signal generation circuit for generating an audio signal collected by the microphone 1512, a circuit for inputting image data of an image captured by the image sensor module 1520, and a signal input / output circuit for the memory card reader 1542. These elements equipped on the control board 1550 are electrically connected to each other via a bus circuit or the like, enabling data reading and writing and signal transmission and reception. Note that part or all of the control board 1550 may be configured using an ASIC, an FPGA, or an SoC.

[0050] In this control board 1550, IC memory 1552 stores a video providing program for realizing the functions of a providing terminal (for example, a providing terminal program that enables the creation and provision of multimedia content), a viewing program for realizing the functions of a viewing terminal (for example, a viewing terminal program that enables the viewing of streaming multimedia content and the transmission of text and images), and data necessary for executing these programs. CPU 1551 and the like execute the providing terminal program and the viewing terminal program to perform arithmetic processing, and control each part of user terminal 1500 in response to operational inputs to touch panel 1506, directional input keys 1502, and home key 1504, thereby enabling the user terminal 1500 to provide / view / etc. multimedia content.

[0051] In this embodiment, the user terminal 1500 is configured to download the providing terminal program, the viewing terminal program, and various setting data from the streaming server 1100, but it may also be configured to read them from a storage medium such as a memory card 1540 obtained separately.

[0052] 3 is a diagram showing an example of the screen configuration of a viewing screen W for viewing multimedia content. In a user terminal 1500 executing a viewing program, the viewing screen W shown in FIG. 3 is displayed on a touch panel 1506. The viewing screen W includes, for example, an additional information display section 31 that displays additional information about the distributed multimedia content being viewed, a content display section 32 that displays the multimedia content being viewed, a call operation section 33 for selecting and inputting text and / or images as a call element to perform a call operation, a call content display section 34 that displays the avatars 4 (4a, 4b, ...) of each viewing user 2 (2a, 2b, ...) and the text and images (call content) that have been operated to send a call, and a shopping icon 35 for purchasing a call image 8 or the like online.

[0053] The incidental information displayed on the incidental information display unit 31 may include, for example, the title, genre, shooting date and time, shooting location, information about the subject, a situation description, a message from the providing user 2t, etc. Furthermore, if the multimedia content is a gameplay video, the incidental information may include the gameplay content and the game situation (for example, information about the game stage and location being played, information about equipment, names of enemy characters, the progress of the game, the player level, the remaining time and elapsed time until the stage is cleared, the names of rare items that can be obtained, etc.). The incidental information may be set by the providing user 2t himself / herself before providing the multimedia content, or may be set by the operator of the streaming distribution service. Furthermore, in the case of a gameplay video, the incidental information may be automatically obtained and set from the play information of the game being played.

[0054] The content display unit 32 displays images of multimedia content including at least moving images (for example, live broadcasts of musical performances or entertainment by the providing user 2t, gameplay played by the providing user 2t, edited videos of live broadcasts of gameplay or recorded gameplay, video works filmed and edited by the providing user 2t, etc.).

[0055] The transmission operation unit 33 includes an input field 331 for inputting text (letters, numbers, symbols) such as comments or messages to be transmitted, a selection field 333 for selecting an image to be transmitted from among the transmission images 8, and a transmission execution operation icon 335.

[0056] The selection field 333 displays a list of images 8 for transmission owned by the viewing user 2a of the user terminal 1500a. Images 8 for transmission are images (also called stamps, etc.) such as illustrations or photographs prepared by the operator of the streaming distribution service and given to the viewing users 2 (2a, 2b, ...) free of charge or for a fee. Each viewing user 2 can obtain or purchase an image 8 for transmission and use it for transmission. Note that once an image 8 for transmission is obtained by purchasing it, it can be used any number of times, but it is also possible to have multiple images of the same type and consume one from the number of images owned each time a transmission is made.

[0057] The type of image 8 to be transmitted can be set as appropriate, and is not limited to still images, but may also be dynamic images such as animated GIFs. Essentially, the image 8 to be transmitted is designed in various ways to serve as a means of communication between viewing users 2. These include images 8 designed to convey messages evaluating the multimedia content being viewed (e.g., "good," "not good," "interesting," "not interesting," "amazing," "cool," etc.), messages of encouragement or encouragement to the providing user 2t (e.g., "do your best," "calm down," etc.), and predetermined expressions of intent from the sender (e.g., evaluation messages such as "good," "interesting," "I'm cheering for you," "do your best," etc.). Images containing words or phrases, such as the image 8A to be transmitted, may also be included. A character may be represented with a speech bubble, as if the character is speaking the words or phrases. Of course, the words or phrases may be onomatopoeia, such as sound effects used in manga. For example, an image of a surprised character with the word "Surprise!" attached to it, or an image of an excited character with the word "Exciting!" attached to it, etc. may be used.

[0058] The message content display unit 34 displays message content, which is text or an image sent by each viewing user 2 currently viewing, in association with the avatar 4 (4a, 4b, ...) of each viewing user 2 (2a, 2b, ...). In this embodiment, the avatars 4 of each viewing user 2 are arranged vertically on both sides of the message content display unit 34, and the message content is displayed for a given display time in a speech bubble 5 (5a, 5b, ...) inside the center of the message content display unit 34, indicating that the avatar 4 (4a, 4b, ...) of the corresponding viewing user 2 (2a, 2b, ...) is speaking.

[0059] When the shopping icon 35 is touched, a sales screen pops up displaying a list of transmission images 8 for sale, and the desired transmission image 8 can be purchased at the sales price in exchange for points. In addition, on the sales screen, other items such as support items for the providing user 2t can be purchased. For example, images that, when purchased, activate a support effect process according to the type, or images that, when purchased, are placed on the viewing screen W to create a gorgeous background are appropriately prepared for sale.

[0060] As shown in Figure 3, the viewing screen W configured as described above is laid out so that the avatars 4 (4a, 4b, ...) of the viewing users 2 (2a, 2b, ...) are arranged and displayed on the front (bottom) side of the content display section 32, providing users with the feeling that they are gathered together to watch multimedia content.

[0061] In addition, by displaying the text and images (transmission images 8) sent by each viewing user 2 (2a, 2b, ...) in the speech bubbles 5 (5a, 5b, ...) of the avatar 4, it creates an atmosphere as if everyone is watching multimedia content together, expressing their own thoughts and talking to their friends. Because the transmission images 8 do not need to be read one by one like text, they can instantly, symbolically, and succinctly convey what the viewing users 2 (2a, 2b, ...) are feeling and thinking. They also have a greater effect on livening up the atmosphere than text.

[0062] In this way, the viewing screen W is designed to make it easy for the providing user 2t who provides the multimedia content and the viewing users 2 (2a, 2b, ...) who watch it to get the feeling that they are working together to create a single live stage or performance.

[0063] In this embodiment, the user transmission service function of text and images is utilized to enhance the transmission ability of each viewing user 2, thereby providing new added value that further enhances the sense of unity and solidarity between viewing users 2.

[0064] [principle] In this embodiment, the display format of the transmission content displayed on the transmission content display unit 34 is changed according to the viewing record and / or transmission record (user record) of the viewing user (transmitter) related to the transmission. In addition, the degree of the change is varied between the user terminal 1500 of the sender and the user terminals 1500 of viewing users (other viewers) other than the sender. Specifically, the display format of the transmission content is changed for the user terminal 1500 of the sender to largely reflect the user record of the sender, while the degree of change is reduced for the user terminals 1500 of other viewers other than the sender.

[0065] To this end, the streaming server 1100 receives a transmission for the multimedia content being viewed from the user terminal 1500, and determines an index value (mode determination index value) that determines the display mode of the transmission content based on the user record of the sender (determination step). Then, based on the mode determination index value, the server sets display modes for the sender and other viewers (setting step), and causes the transmission content display unit 34 to display the transmission content in the corresponding display mode on the viewing screen W of each user terminal 1500.

[0066] 1. Judgment step In the determination step, an index calculation process is executed to find a behavior determination index from the sender's user record, for example, according to a predetermined function f(V1, V2, ...). The variable V1 of the function f is a variable related to the sender's viewing record, and includes, for example, the number of points consumed to purchase images for transmission 8, etc., while the sender is viewing multimedia content, the amount charged, the charging frequency, the viewing time, and other values. The variable V2 of the function f is a variable related to the sender's transmission record, and includes, for example, the number of transmission operations (number of transmissions) and frequency (frequency of transmissions) performed by the sender while viewing multimedia content. This function f finds a behavior determination index that becomes larger as the variables V1 and V2 become larger (the sender's viewing record and transmission record are higher), and becomes smaller as the variables V1 and V2 become smaller (the sender's viewing record and transmission record are lower).

[0067] The function f may be a function whose only variable is the variable V1 relating to the viewing record, or a function whose only variable is the variable V2 relating to the transmission record. Furthermore, the function may be a function that uses one of the values ​​exemplified as the variables V1 and / or V2, or a function that uses a plurality of them. Alternatively, the function may be a function whose variable is the user level of the viewing user, which is updated as needed to reflect the viewing record and / or transmission record of the user. Furthermore, the variables V1 and V2 may be the number of points consumed for the multimedia content currently being viewed, the number of transmissions, etc., or the total amount or total number up to now.

[0068] 2. Setup steps In this embodiment, the display size is set as the display format of the content of the call made by each viewing user. Specifically, in the setting step, first, the display size for the sender and the display sizes for other viewers are provisionally set from the format determination index value calculated in the index value calculation process according to a predetermined correspondence relation between the format determination index value and the display size (provisional display size setting process).

[0069] FIG. 4 is a diagram showing an example of a correspondence relation between a form determination index value and a display size, in which a correspondence relation L11 for provisionally setting a display size for a sender is shown by a solid line, and a correspondence relation L13 for provisionally setting a display size for other viewers is shown by a dashed line. As shown in FIG. 4, for example, each correspondence relation is determined as a straight line in which the correspondence relation L11 has a steeper slope than the correspondence relation L13. For example, when the form determination index value is v a If so, the caller display size is v b The display size for other viewers is v b smaller than v c The correspondence equation is not limited to a straight line, and may be set as a curve, a broken line, or the like as appropriate. Alternatively, a data table defining the correspondence between the form determination index value and the sender display size and a data table defining the correspondence between the form determination index value and the other viewer display size may be prepared, and the sender display size and the other viewer display size corresponding to the form determination index value found by referring to these tables may be temporarily set.

[0070] In this embodiment, the message content is displayed for a given display time as a speech bubble 5 of the avatar 4 in the message content display unit 34, and when there are few senders, a large display area for each message content can be secured. However, as the number of senders increases, the display area that can be secured for each message content becomes smaller, and a maximum display area equal to the number of viewing users is required.

[0071] Therefore, in this embodiment, regardless of whether there is message content to be displayed, the central portion of the message content display unit 34 is first divided into areas corresponding to the number of viewers, and a display area (hereinafter referred to as "transmission area") for displaying each message content is assigned to all viewing users. Then, for message content whose provisionally set display size (display size for the sender or display size for other viewers) exceeds the size of the message area, the display size is corrected (display size correction process). At that time, if there is free space in an adjacent message area, the message area is adjusted and then the display size is corrected. Note that a message area may be assigned only to viewing users who have message content to display, and the display size correction process may be performed. In this case, each time a call operation is received from the user terminal 1500, the central portion of the message content display unit 34 may be divided into areas corresponding to the number of viewers.

[0072] FIG. 5 is a diagram illustrating the display size correction process. FIG. 5(a) shows the sections of the origination areas 341 (341a, 341b, ...) initially assigned to each viewing user 2 (2a, 2b, ...) in the transmission content display unit 34. Assume that viewing user 2a performs a new transmission operation, and the provisionally set display size for the sender of the transmission content exceeds the size of transmission area 341a. In this case, first, the free space in the neighboring transmission areas 341b, 341d, and 341e is determined. For example, if there is no transmission content currently displayed for viewing users 2b, 2d, and 2e in each transmission area 341b, 341d, and 341e, or if there is transmission content but its display size (in this case, the display size for other viewers) is smaller than the size of transmission area 341b, 341d, and 341e, then free space exists in transmission areas 341b, 341d, and 341e. If there is such free space, as shown in FIG. 5(b), origination area 341a is enlarged accordingly, and origination areas 341b, 341d, and 341e are reduced and adjusted, thereby changing the allocation of origination areas 341a, 341b, 341d, and 341e for viewing users 2a, 2b, 2d, and 2e. If the provisionally set originator display size is larger than the adjusted size of origination area 341a, the originator display size is reduced to the adjusted size of origination area 341a and confirmed. If the size is smaller than the adjusted size of origination area 341a, the originator display size is confirmed as is. Through this processing, for example, as shown in FIG. 6, on user terminal 1500a of viewing user 2a, the content of his or her own message is displayed occupying a wider area than the origination areas of other viewing users 2 (2b, 2c, ...).

[0073] On the other hand, if there is a message being displayed for viewing users 2b and 2d in adjacent origination areas 341b and 341d and there is no available space for that message, the provisionally set display size for the sender is reduced to the size of the initially assigned origination area 341a and finalized. By this processing, even if there are many senders, the message is displayed large enough to fit within the origination area assigned to each sender, as shown in Figure 7, for example.

[0074] As explained above, in this embodiment, when a viewing user performs a call operation, the user record is reflected in the display size on the sender's user terminal 1500, with the higher the viewing record or call record, the larger the display, and the lower the record, the smaller the display. On the other hand, since displaying the content of messages from others too large can be distracting, the content of messages sent by other viewers is changed to a smaller extent than when the viewer sends the message, and the content of messages from viewing users with high user records is displayed larger and the content of messages from viewing users with low user records is displayed smaller.

[0075] Here, viewing users with a high user record, i.e., viewing users who purchase and use many transmission images 8 and support items, and who transmit many transmissions, can be said to be key players who actively try to liven up the atmosphere of the place where everyone is watching the streaming distribution. Therefore, according to this embodiment, the transmission content of such viewing users can be made conspicuous, for example by displaying it in a large size, thereby giving the viewing user apparent preferential treatment on the viewing screen W and increasing the transmission ability of the viewing user. Furthermore, preferential treatment can encourage active transmission to other viewing users. Therefore, it is easy to get a sense of a lot of support for the providing user and a sense of excitement in the atmosphere, and it is possible to bring new added value that further enhances the sense of unity and solidarity among viewing users.

[0076] [Function Configuration] 1. Streaming Server Fig. 8 is a block diagram showing an example of the functional configuration of the streaming server 1100. As shown in Fig. 8, the streaming server 1100 includes an operation input unit 100s, a server processing unit 200s, an image display unit 390s, a sound output unit 392s, a communication unit 394s, and a server storage unit 500s.

[0077] The operation input unit 100s is used to input various operations for system management, maintenance, etc., and can be realized by, for example, a keyboard, a mouse, a touch panel, etc. In FIG.

[0078] The server processing unit 200s can be realized by electronic components such as a microprocessor such as a CPU or GPU, an ASIC, or an IC memory, and controls the input and output of data between the operation input unit 100s and each unit of the device including the server storage unit 500s. The server processing unit 200s performs various arithmetic processing based on predetermined programs and data, operation input signals from the operation input unit 100s, data received from the user terminal 1500, etc., and controls the overall operation of the streaming server 1100. In FIG. 1, this corresponds to the control board 1150 and its CPU 1151.

[0079] This server processing unit 200s includes a user management unit 202, an online shopping management unit 204, a distribution service management unit 210, an avatar display control unit 220, a calling service management unit 230, a timing unit 280s, an image generation unit 290s, a sound generation unit 292s, and a communication control unit 294s.

[0080] The user management unit 202 performs processes related to user registration and manages data of each registered user linked to a user account. For example, it can perform processes such as assigning a unique user account to each registered user, registering and managing personal information for each user account, managing the ledger of electronic payment media (e.g., virtual currency or points equivalent to virtual currency) consumed for payment of billing elements (e.g., online shopping), managing usage history (e.g., login and logout history), and creating and editing avatars 4. Of course, it can also appropriately include management processes for other data linked to user accounts.

[0081] The online shopping management unit 204 is responsible for controlling online shopping, and can be realized by appropriately utilizing known online shopping technology. In this embodiment, the viewing user can purchase images to be sent and the like through online shopping.

[0082] The distribution service management unit 210 performs various processes to realize a streaming distribution service for multimedia content. For example, it can manage the distribution schedule of multimedia content, manage viewing users, acquire data of multimedia content for distribution from a provider terminal, and perform streaming distribution. Of course, it can also include other processes as appropriate.

[0083] The avatar display control unit 220 controls the display of an avatar for each viewing user on the message content display unit 34 of each viewing user's user terminal 1500 (1500a, 1500b, ...), which is a viewing terminal. In this embodiment, this includes the distribution of avatar display management data 626 that sets avatar data for each viewing user.

[0084] The outgoing service management unit 230 performs various processes to realize a user outgoing service in parallel with the streaming distribution service. Specifically, it receives from the viewing terminal a notification that an outgoing call operation has been input for the multimedia content being viewed, and controls the display of the outgoing call content related to the outgoing call operation on the outgoing call content display unit 34 of each viewing terminal. In this embodiment, this includes the distribution of outgoing call content display management data 630 that sets the outgoing call content being displayed on the outgoing call content display unit 34, its display size, display time, etc. for each viewing user.

[0085] This outgoing service management unit 230 includes an index value determination unit 231, a display format setting unit 233, and an outgoing content display control unit 235, and controls the change of the display format of the content to be displayed on the outgoing content display unit 34 at each viewing terminal, using at least the user performance of each viewing user.

[0086] The index value determining unit 231 determines the mode determination index value from the user record of the sender according to a predetermined function f(V1, V2, . . . ).

[0087] The display mode setting unit 233 sets, for example, a display size as the display mode of the message content based on the mode determination index value calculated by the index value determining unit 231 .

[0088] The call content display control unit 235 controls the call content that each viewing user has operated to make a call, so that the call content display unit 34 of each viewing terminal is displayed in the display size set by the display format setting unit 233. When the streaming server 1100 intends to distribute the image itself displayed on the call content display unit 34, the call content display control unit 235 may generate the image.

[0089] The timekeeping unit 280s uses a system clock to keep track of the current date and time, the time limit, and the like.

[0090] The image generation unit 290s generates images relating to system management of the streaming server 1100 and outputs them to the image display unit 390s.

[0091] The sound generation unit 292s is realized by executing an IC or software that generates or decodes audio data, and generates or decodes audio data such as operation sounds and background music related to system management and video distribution of the streaming server 1100. Audio signals related to system management are output to the sound output unit 392s.

[0092] The communication control unit 294s performs communication connection and data processing for data communication with an external device (for example, the user terminal 1500) via the communication unit 394s, and realizes data exchange with the external device.

[0093] The image display unit 390s displays various screens for system management and the like based on the image signals input from the image generation unit 290s. For example, this can be realized by an image display device such as a flat panel display, a cathode ray tube (CRT), a projector, or a head-mounted display. In FIG. 1, this corresponds to the touch panel 1108.

[0094] The sound output unit 392s emits the sound signal input from the sound generation unit 292s. In Fig. 1, this corresponds to a speaker (not shown) provided in the main device 1101 or the touch panel 1108.

[0095] The communication unit 394s realizes communication by connecting to the communication line 9. For example, it can be realized by a wireless communication device, a modem, a TA (terminal adapter), a jack for a wired communication cable, a control circuit, etc. In FIG. 1, this corresponds to the communication device 1153.

[0096] The server storage unit 500s stores in advance or temporarily stores each time processing is performed programs for operating the streaming server 1100 and realizing various functions of the streaming server 1100, data used during execution of these programs, etc. For example, this can be realized by an IC memory such as RAM or ROM, a magnetic disk such as a hard disk, or an optical disk such as a CD-ROM or DVD. In Fig. 1, this corresponds to the IC memory 1152.

[0097] Server storage unit 500s also stores server program 503, viewing terminal program for distribution 505, providing terminal program for distribution 507, sales product management data 509, image data for transmission 510, user management data 600, distribution management data 620, and current date and time 800. In addition, other necessary data such as image data for the background image of viewing screen W and material data for creating and editing avatars is also stored as appropriate.

[0098] The server program 503 is a program that causes the server processing unit 200s to function as the user management unit 202, the online shopping management unit 204, the delivery service management unit 210, the avatar display control unit 220, and the outgoing service management unit 230. Note that the server program 503 may also include programs that cause the server processing unit 200s to function as the image generation unit 290s, the sound generation unit 292s, and the communication control unit 294s, as appropriate.

[0099] The provider terminal program for distribution 507 is original data of an application program downloaded to the user terminal 1500 used as a provider terminal, and by executing this data, the user terminal 1500 can function as a provider terminal. Note that the provider terminal program for distribution 507 can also be configured to be included in a game program that enables the execution of a game that has a live distribution function implemented.

[0100] The distribution viewing terminal program 505 is the original data of an application program downloaded to the user terminal 1500 used as a viewing terminal, and by executing this, the user terminal 1500 can function as a viewing terminal.

[0101] The sales item management data 509 is data for defining and managing sales items (sales targets) through online shopping. For example, the sales item management data 509 stores data on items that can be purchased in association with the number of items in stock, the amount charged (corresponding to the amount deducted from the electronic payment medium), etc.

[0102] The transmission image data 510 is data that defines an image for transmission. One piece of transmission image data 510 includes, for example, the type of image for transmission (transmission image type), image data, sales price, etc.

[0103] User management data 600 is prepared for each registered user and stores various data linked to a user account, which is unique identification information. For example, as shown in Figure 9, one user management data 600 includes a unique user account 601, a user level 602, payment medium ledger data 603, avatar setting data 604, a list of retained calling images 605, calling log data 606, and user performance data 607.

[0104] The payment medium ledger data 603 stores information on the balance of the electronic payment medium (points in this embodiment) linked to the user, such as the history of the purchase date and time of points and the number of points purchased (charged amount), and the history of the consumption date and time of points and the number of points consumed.

[0105] The avatar setting data 604 stores setting data for the avatar 4 of the user.

[0106] The owned image list for transmission 605 stores a list of images for transmission 8 owned by the user.

[0107] The transmission log data 606 is created each time the user performs a transmission operation as a viewing user. One transmission log data 606 stores, for example, the transmission date and time, the distribution title of the transmission target, the user account of the providing user who provided the multimedia content of the transmission target, the transmission content, etc.

[0108] The user performance data 607 stores the number of points consumed, the billing amount, the billing frequency, the viewing time, the number of calls, the calling frequency, etc., which are variables V1 and V2 of the function f, as user performance. The number of points consumed, the billing amount, and the billing frequency are calculated as needed based on the payment medium ledger data 603, and the number of calls and the calling frequency are calculated as needed based on the call log data 606.

[0109] Distribution management data 620 is prepared for each streaming distribution and stores various data describing the distribution status. As shown in Fig. 10, one distribution management data 620 includes, for example, a distribution title 621, a distribution schedule 622, multimedia content data 623, supplementary information 624, viewing user management data 625, avatar display management data 626, transmission record data 627, and transmission content display management data 630. In addition, for example, background data defining the background of the viewing screen W is stored.

[0110] The viewer user management data 625 stores various data related to the viewer users who have registered as viewers of the multimedia content related to the streaming distribution. For example, the viewer user management data 625 stores access information (e.g., IP addresses) for connecting to the user terminals 1500 of the viewer users via the communication lines 9 in association with the user accounts of all the viewer users who have registered as viewers.

[0111] The avatar display management data 626 stores various data describing the display status of the avatar of each viewing user in the message content display unit 34. For example, the avatar data, position coordinates, display size, etc. are set in association with the user account of each viewing user.

[0112] The call history data 627 is created each time a viewing user performs a call operation on the viewing terminal. One call history data 627 includes the user account of the viewing user who is the call sender, the call timing, and call content data (input text or selected type of image for call).

[0113] 11 , one piece of call content display management data 630 stores a user account 631 of the viewer user, call area data 632 indicating the location and range of the call area assigned to the viewer user, a call display flag (yes: ON / no: OFF) 633 indicating whether or not a call content is being displayed, call content data 634 that is set when the corresponding call display flag 633 is ON, a caller display size 635 and a display size 636 for other viewers that are set for the call content, a display start date and time 637 for the call content, and a display time 638. The display time 638 is the time from when the call content is displayed until when it is hidden, and in this embodiment, a fixed value (e.g., 5 seconds) is set.

[0114] 2. Viewing device 12 is a block diagram showing an example of the functional configuration of a user terminal 1500 (1500a, 1500b, ...) serving as a viewing terminal. As shown in Fig. 12, the user terminal 1500 (1500a, 1500b, ...) serving as a viewing terminal includes an operation input unit 100, an imaging unit 102, a sound collection unit 104, a device processing unit 200, an image display unit 390, a sound output unit 392, a communication unit 394, and a device storage unit 500.

[0115] The operation input unit 100 is used by the user to input various operations, and can be realized by, for example, a button switch, a joystick, a touchpad, a trackball, an acceleration sensor, an angular velocity sensor, etc. In Fig. 2, this corresponds to the direction input keys 1502, the home key 1504, and the touch panel 1506.

[0116] The imaging unit 102 receives light from the subject to be photographed, converts it into an electrical signal, generates digital image data, and outputs it to the device processing unit 200. For example, it can be realized by a lens, a mechanical shutter, a shutter driver, a photoelectric conversion element such as a CCD image sensor module or a CMOS image sensor module, a digital signal processor (DSP) that reads the amount of charge from the photoelectric conversion element and generates image data, an IC memory, etc. In FIG. 2, this corresponds to the image sensor module 1520.

[0117] The sound collection unit 104 converts the collected sound into an electrical signal and outputs it. In FIG. 2, the microphone 1512 corresponds to this.

[0118] The device processing unit 200 can be realized by electronic components such as a microprocessor such as a CPU or GPU, an ASIC, or an IC memory, and controls the input and output of data between the device and each unit including the operation input unit 100 and the terminal storage unit 500. The device processing unit 200 performs various arithmetic processing based on predetermined programs and data, operation input signals from the operation input unit 100, data received from the streaming server 1100, etc., and controls the operation of the user terminal 1500 as a viewing terminal. In FIG. 2, this corresponds to the control board 1550 and its CPU 1551. The device processing unit 200 of the viewing terminal in this embodiment includes a viewing terminal arithmetic unit 260, a timing unit 280, a sound generation unit 292, and a communication control unit 294.

[0119] The viewing terminal calculation section 260 includes an operation signal transmission control section 262 and a viewing screen display control section 264 .

[0120] The operation signal transmission control unit 262 performs processing for transmitting various data and request information to the streaming server 1100 in response to an operation input to the operation input unit 100 .

[0121] The viewing screen display control unit 264 performs control to display the viewing screen W based on various data received from the streaming server 1100.

[0122] The sound generation unit 292 is realized by, for example, a processor such as a DSP or a voice synthesis IC, or an audio codec capable of playing audio files, and generates sound signals for sound effects, background music, and various operation sounds related to video distribution and outputs them to the sound output unit 392.

[0123] The communication control unit 294 performs communication connection and data processing for data communication with an external device (for example, the streaming server 1100) via the communication unit 394, thereby realizing data exchange with the external device.

[0124] Image display unit 390 displays various screens such as viewing screen W based on image signals input from viewing screen display control unit 264. For example, this can be realized by an image display device such as a flat panel display, a cathode ray tube (CRT), a projector, or a head-mounted display. In this embodiment, this corresponds to touch panel 1506 in FIG. 2.

[0125] The sound output unit 392 outputs sounds such as background music based on the sound signal input from the sound generation unit 292. In FIG.

[0126] The communication unit 394 realizes communication by connecting to the communication line 9. For example, it can be realized by a wireless communication device, a modem, a TA, a jack of a wired communication cable, a control circuit, etc. In FIG. 2, the wireless communication module 1553 corresponds to this.

[0127] The terminal storage unit 500 stores in advance or temporarily stores each time processing is performed programs for operating the user terminal 1500 as a viewing terminal and realizing the functions of the viewing terminal that the user terminal 1500 has. For example, this can be realized by IC memory such as RAM or ROM, a magnetic disk such as a hard disk, or an optical disk such as a CD-ROM or DVD. In FIG. 2, this corresponds to the IC memory 1552 or the memory card 1540.

[0128] The terminal storage unit 500 of the viewing terminal also stores a viewing terminal program 504, a received distribution data group 700, and a current date and time 800. Of course, other programs and data can also be stored as appropriate.

[0129] The viewing terminal program 504 is a program for causing the terminal processing unit 200 to function as the viewing terminal calculation unit 260. In this embodiment, it is a copy of the distribution viewing terminal program 505 (see FIG. 8) provided by the streaming server 1100.

[0130] The received distribution data group 700 stores various types of distribution data received from the streaming server 1100 during streaming distribution. In this embodiment, it stores avatar display management data 702, message content display management data 704, and held transmission image list 706. The held transmission image list 605 (see FIG. 8) is copied to the held transmission image list 706 when the user logs in or when a viewer registers.

[0131] 3. Provided Device Fig. 13 is a block diagram showing an example of the functional configuration of a user terminal 1500 (1500T) that serves as a providing terminal. In Fig. 13, the same components as those of the user terminals 1500 (1500a, 1500b, ...) that serve as viewing terminals are denoted by the same reference numerals.

[0132] In the user terminal 1500 (1500T) serving as a providing terminal, the device processing unit 200 performs various types of arithmetic processing based on predetermined programs and data, operation input signals from the operation input unit 100, data received from the streaming server 1100, etc., and controls the overall operation of the user terminal 1500 serving as a providing terminal. The device processing unit 200 of the providing terminal includes a providing terminal calculation unit 270, a timing unit 280, a sound generation unit 292, and a communication control unit 294.

[0133] The providing terminal calculation unit 270 includes an operation signal transmission control unit 272 , a content providing control unit 274 , and a providing screen display control unit 276 .

[0134] The operation signal transmission control unit 272 performs processing for transmitting various data and request information to the streaming server 1100 in response to an operation input to the operation input unit 100 .

[0135] The content provision control unit 274 generates data of multimedia content to be distributed and performs processing related to control of provision to the streaming server 1100. In the case of live distribution, it realizes the function of a live streaming encoder, encoding images captured by the imaging unit 102 one by one and controlling provision to the streaming server 1100.

[0136] The delivery screen display control unit 276 performs control for displaying the delivery screen. The delivery screen is an operation screen that accepts various operations for live delivery of multimedia content, and also serves as a monitor screen for monitoring the delivery status.

[0137] The terminal storage unit 500 stores in advance or temporarily stores each time processing is performed programs for operating the user terminal 1500 as a providing terminal and realizing the functions of the providing terminal that the user terminal 1500 has, as well as data used during execution of these programs. For example, this can be realized by IC memory such as RAM or ROM, a magnetic disk such as a hard disk, or an optical disk such as a CD-ROM or DVD.

[0138] The terminal storage unit 500 of the providing terminal also stores a providing terminal program 506, a received distribution data group 700, provided content data 710, and a current date and time 800. Of course, other programs and data can also be stored as appropriate.

[0139] The providing terminal program 506 is a program for causing the terminal processing unit 200 to function as the providing terminal calculation unit 270. In this embodiment, it is a copy of the distribution providing terminal program 507 (see FIG. 8) provided by the streaming server 1100.

[0140] The received distribution data group 700 stores various types of distribution data received from the streaming server 1100 when providing multimedia content.

[0141] The provided content data 710 includes a distribution title at the time of registration 711, a distribution schedule at the time of registration 713, additional information at the time of registration 715, and multimedia content data to be provided 717. The distribution title at the time of registration 711, distribution schedule at the time of registration 713, and additional information at the time of registration 715 each store setting data when the providing user performs the distribution registration procedure. The multimedia content data to be provided 717 is original data of the multimedia content to be distributed.

[0142] [Processing flow] 1. Streaming Server 14 and 15 are flowcharts showing the flow of processing related to live distribution of multimedia content in the streaming server 1100. The processing described here is realized by the server processing unit 200s reading and executing the server program 503. It is assumed that the distribution title, distribution schedule, and additional information of the multimedia content have already been set by the providing user in accordance with the distribution registration procedure. It is also assumed that a separate login procedure has been completed for the viewing terminal of the viewing user.

[0143] First, the distribution service management unit 210 performs initial settings for the distribution management data 620 (step S100). Here, the viewing user management data 625, avatar display management data 626, and message content display management data 630 are initialized. Note that the distribution title 621, distribution schedule 622, and supplementary information 624 have already been set in conjunction with the distribution registration procedure. Since the multimedia content data 623 is a live distribution, it is not stored until the start of distribution. If it is not a live distribution, pre-prepared multimedia content data will be stored.

[0144] Next, the distribution service management unit 210 starts distributing various types of distribution data, such as the avatar display management data 626, the message content display management data 630, and the held message image list 605, based on the viewing user management data 625 (step S102: distribution α). The distribution timing can be, for example, when the distribution data is added, deleted, or updated, or when a new viewing user is registered, or may be at a predetermined interval.

[0145] Thereafter, the distribution service management unit 210 monitors the reception of a viewing request (step S104). When a viewing user selects a distribution title that he or she wants to view on a user terminal 1500 (1500a, 1500b, ...) functioning as a viewing terminal and performs a predetermined viewing operation, the viewing request is transmitted to the streaming server 1100 together with information such as the user account.

[0146] When this viewing request is received (YES in step S104), the distribution service management unit 210 creates new viewing user management data 625 and registers the user of the viewing terminal as a viewing user (step S106).

[0147] Then, the avatar display control unit 220 creates new avatar display management data 626, and causes the avatar related to the viewing user to be displayed in the message content display unit 34 (step S108).

[0148] As described above, since the distribution of the avatar display management data 626 has started in step S102, the newly created avatar display management data 626 is also distributed to the viewing terminal. The viewing terminal updates the display of each avatar based on this data. As a result, on the viewing screen W, it appears as if a new virtual viewer has appeared in front of the screen.

[0149] Furthermore, since the number of viewers has increased due to viewer registration, the originating service management unit 230 creates new call content display management data 630 and reassigns call areas to all viewing users, including the viewing user, to update the call area data 632 (step S110). The newly created call content display management data 630 and the call content display management data 630 with the updated call area data 632 are also distributed to the viewing terminal.

[0150] Next, the transmission service management unit 230 monitors the reception of a transmission request (step S112). When a viewing user inputs text or selects an image on the viewing terminal to perform a transmission operation, the text transmission request is transmitted to the streaming server 1100 together with information such as the user account and the transmission content.

[0151] Upon receiving this call request (YES in step S112), the call service management unit 230 creates call history data 627 for the received new call content, and creates and updates call log data 606 for the requesting viewing user (step S114). Furthermore, the index value determination unit 231 executes an index value determination process (step S116). Then, the display form setting unit 233 executes a temporary display size setting process (step S118) and a display size correction process (step S120). Through this process, a caller display size 635 and a display size for other viewers 636 are set for the received new call content, and each value of the call content display management data 630 related to the caller is updated. Furthermore, the appropriately adjusted adjacent call area data 632 is updated.

[0152] The outgoing service management unit 230 erases each and every transmission content that has exceeded the display time 638. That is, it turns OFF the transmission display flag 633 for transmission content in the transmission content display management data 630 that has exceeded the display time 638 from the display start date and time 637, and clears the transmission content data 634, the display size for the sender 635, the display size for other viewers 636, the display start date and time 637, and the display time 638. Furthermore, if there is a transmission area that has been enlarged or reduced in conjunction with the display of the transmission content, it returns the transmission area data 632 to the original range assigned in step S110.

[0153] The delivery of this message content display management data 630 also begins in step S102, and the updated message content display management data 630 is also delivered to the viewing terminal. Based on this, the new message content is displayed in the avatar's speech bubble on the viewing terminal, making it appear as if the avatar has spoken.

[0154] The online shopping management unit 204 also monitors the receipt of a purchase request (step S122). The purchase request is transmitted to the streaming server 1100 when the viewing user performs a predetermined purchase operation (for example, an operation on the shopping icon 35 in FIG. 3) on the viewing terminal.

[0155] When this purchase request is received (YES in step S122), the online shopping management unit 204 executes processing related to online shopping, such as purchasing a transmission image or support item (step S126). With this purchase, the list of owned transmission images 605 in the user management data 600 of the viewing user who made the purchase request is updated, and this is also delivered to the viewing terminal.

[0156] In this way, even before the live broadcast, viewing users can send text and images to be transmitted, or purchase images to be transmitted, etc., and before the live broadcast begins, viewing users can freely discuss their expectations for the live broadcast and prepare images to be transmitted in preparation for the start of the live broadcast.

[0157] 15, when the scheduled start time of the live distribution arrives (YES in step S126), the distribution service management unit 210 starts live distribution of the multimedia content (step S128). This process starts reception of multimedia content data from the providing terminal and streaming distribution to the viewing terminal.

[0158] Once distribution of multimedia content has begun, the transmission service management unit 230 monitors the reception of a transmission request (step S130). If a transmission request is received (YES in step S130), transmission history data 627 is created for the received new transmission content, and transmission log data 606 of the requesting viewing user is created and updated (step S132). The index value determination unit 231 also executes index value determination processing (step S134). The display form setting unit 233 then executes temporary display size setting processing (step S136) and display size correction processing (step S138) to set the display size for the sender and the display size for other viewers for the received new transmission content.

[0159] Additionally, the online shopping management unit 204 monitors whether a purchase request has been received (step S140). If a purchase request has been received (YES in step S140), the online shopping management unit 204 executes processing related to online shopping (step S142).

[0160] Thereafter, the process returns to step S130 and repeats the above-described processing until the distribution is completed (NO in step S144). Then, when the distribution is completed (YES in step S144), the series of processing steps ends.

[0161] 2. Viewing device 16 is a flowchart showing the flow of processing related to viewing multimedia content on a user terminal 1500 (1500a, 1500b, ...) that serves as a viewing terminal. The processing described here is realized by the terminal processing unit 200 reading and executing the viewing terminal program 504.

[0162] As shown in FIG. 16, the viewing terminal first executes a login process (step S300). Thereafter, upon detecting a predetermined viewing operation (including selection of the multimedia content to be viewed) for viewing distribution of multimedia content (YES in step S310), the operation signal transmission control unit 262 transmits a viewing request to the streaming server 1100 (step S312: communication A). In response to the viewing request, the streaming server 1100 registers the user of the viewing terminal as a viewing user, and starts distribution of the avatar display management data 626, the message content display management data 630, the held message image list 605, and the like to the viewing terminal (distribution α). Then, in the viewing terminal, the viewing screen display control unit 264 receives these and stores them in the received distribution data group 700, and starts displaying the viewing screen W (step S314).

[0163] Furthermore, when a purchase operation of an item for sale such as the image for call 8 is detected (YES in step S320), the operation signal transmission control unit 262 transmits a purchase request to the streaming server 1100 (step S322: communication B). When the image for call 8 is purchased, the streaming server 1100 distributes the owned image for call list 605 to which the image for call 8 has been added, and the owned image for call list 706 is updated.

[0164] Furthermore, when the operation signal transmission control unit 262 detects a text input operation in the call operation unit 33 (YES in step S330), it executes a text input / edit process (step S332) and proceeds to step S336. Also, when the operation signal transmission control unit 262 detects a selection operation of an image for call in the call operation unit 33 (YES in step S334), it proceeds to step S336. Then, when a call operation is detected in step S336 (YES in step S336), it transmits a call request together with the input text or the selected type of image for call to the streaming server 1100 (step S338: communication C). In response to this call request, the streaming server 1100 sets the display format of the call content (in this embodiment, the display size for the caller and the display size for other viewers), updates the call content display management data 630, and distributes it.

[0165] Here, the viewing terminal starts display control of the viewing screen W based on various distribution data in step S314 as described above. Therefore, in step S338, the call content that the viewing user operated to make a call on that viewing terminal or another viewing terminal is displayed on the call content display unit 34 in a display size set according to the user's performance. More specifically, in accordance with the call content display management data 630, in the call area of ​​the viewing user whose call display flag 633 is ON, the viewing screen display control unit 264 controls the display of the call content by applying the caller display size to the call content related to the viewing user of that viewing terminal and the other viewer display size to the call content related to other viewing terminals.

[0166] Thereafter, the process returns to step S320 and repeats the above-described processing until the distribution is completed (NO in step S340). Then, when the distribution is completed (YES in step S340), the series of processing steps ends.

[0167] 3. Provided Device 17 is a flowchart showing the flow of processing related to the provision of multimedia content in the user terminal 1500 (1500T) that serves as a providing terminal. The processing described here is realized by the terminal processing unit 200 reading and executing the providing terminal program 506. Note that if the multimedia content is to be live broadcast content of game play video, it is assumed that a separate game program is being executed.

[0168] 17, the audiovisual terminal first executes a login process (step S500), after which the providing screen display control unit 276 starts display control of the providing screen (step S502).

[0169] Next, the content provision control unit 274 sets the distribution title, distribution schedule, and additional information of the multimedia content to be provided and performs registration procedure processing (step S504). Then, when the scheduled distribution time arrives, the provision of the multimedia content begins (step S506: communication D). In this embodiment, live distribution is assumed. For example, in the case of live distribution using live action, the content provision control unit 274 sequentially creates multimedia content data by adding audio collected by the audio collection unit 104 to video captured by the imaging unit 102, and performs live streaming encoding of the created multimedia content data to transmit it to the streaming server 1100. In the case of live distribution of gameplay video, the content provision control unit 274 sequentially creates multimedia content data by adding game audio to video captured from game screens. In the case of video data or the like where the multimedia content is prepared in advance, the content provision control unit 274 uploads the created multimedia content data to the streaming server 1100 without waiting for the scheduled distribution time.

[0170] Then, when the distribution of the multimedia content is completed (YES in step S508), the series of processes is completed.

[0171] As described above, according to this embodiment, in a streaming distribution service for multimedia content, by utilizing the function of transmitting text and images, it is possible to provide a more enjoyable and fulfilling user experience than conventional services, thereby improving the streaming distribution service.

[0172] [Variations] The forms to which the present invention can be applied are not limited to the above-described embodiments, and constituent elements can be added, omitted, or modified as appropriate.

[0173] For example, in the above embodiment, an example was given in which a streaming distribution service is realized in a client-server computer system, but it may also be realized in a computer system in which multiple user terminals 1500 are connected peer-to-peer. In that case, one of the user terminals 1500 is made to function as the streaming server 1100. Alternatively, a configuration may be adopted in which the functions of the distribution service management unit 210 are shared among multiple user terminals 1500.

[0174] The above embodiment can also be applied to other services as long as a plurality of users can access the service simultaneously and each user can send and receive text or images.

[0175] For example, the portion of the viewing screen W in Fig. 3 below the content display section 32 may be a screen to which the chat function of a social networking service is applied. Fig. 18 is a diagram showing a display example in that case.

[0176] On the left side of the lower chat screen 36, an avatar 4a of the viewing user 2a who uses the user terminal 1500 on which the screen is displayed is displayed, and the content of the transmission (text and images) made by the viewing user 2a is displayed in a speech bubble 5a. On the other hand, on the right side of the chat screen 36, avatars 4c and the like of other viewing users 2c and the like are displayed, and speech bubbles 5c and the like of the content of the transmissions made by them are displayed. In this modified example, when displaying the content of the transmissions made by each viewing user 2, the display size is changed and controlled according to the user record of the sender in the same manner as in the above embodiment.

[0177] In the above embodiment, a display size for the sender and a display size for other viewers are set, thereby varying the degree of change in display size between the sender's user terminal 1500 and the other viewers' user terminals 1500. However, it is also possible to set only the display size for the sender. This makes it possible to control the change in display size for each user terminal 1500 only for the content transmitted by the viewing user, depending on the user record of the viewing user using that user terminal 1500.

[0178] In the above embodiment, the form determination index value is calculated from the user record of the sender and used to set the display size. However, the display size may be set by calculating an index value related to the sender by statistically processing the user record of each viewing user. For example, form determination index values ​​for all viewing users are calculated each time a call operation is received from the user terminal 1500, and a deviation value related to the sender is calculated as an index value from the form determination index values ​​of each viewing user. The calculated deviation value may then be used to set the display size.

[0179] In the above embodiment, a form determination index value is calculated for each sender, and a display size corresponding to the form determination index value is provisionally set in accordance with a predetermined correspondence relational expression. However, the display size may be determined by ranking the form determination index values. For example, each time a call operation is received from the user terminal 1500, the form determination index values ​​of all viewing users are calculated and the sender ranking is determined by arranging them in descending order. The higher the identified ranking, the larger the display size, and the lower the identified ranking, the smaller the display size.

[0180] In the above embodiment, the display size of the message content is changed using the sender's user record, but when a gameplay video is live-streamed as multimedia content, the display format of the message content may be further controlled to change depending on the game status related to the gameplay video. For example, the line type, color, shape, background color, etc. of the frame of the speech bubble 5 (5a, 5b, ...) may be controlled to change depending on the game stage, enemy character name, game progress, player level, etc. of the gameplay video.

[0181] Furthermore, the display form of the transmitted content to be changed is not limited to the display size as exemplified, but other display forms such as the display color or display time may be changed, or two or all three of the display size, display color, and display time may be changed. Alternatively, the display form to be changed may be changed, such as by controlling the display size of the transmitted content to be changed on the sender's user terminal 1500 and changing the display color of the transmitted content on the user terminals of other viewers. [Explanation of symbols]

[0182] 1000...Content provision system 1100...Streaming server 100s...Operation input section 200s...Server processing section 202...User Management Department 204...Online Shopping Management Department 210...Distribution Service Management Department 220...Avatar display control unit 230...Outgoing Service Management Department 231...index value determination unit 233…Display format setting section 235...Call content display control unit 280s…Timekeeping section 291s...Image generation section 293s…sound generation section 295s…Communication control unit 391s...Image display section 393s...Sound output section 395s…Communications Department 500s...Server storage section 503...Server program 505...Streaming viewing terminal program 507...Distribution provision terminal program 509...Sales management data 510...Image data for transmission 600...User management data 620...Distribution management data 800...Current date and time 1500 (1500a, 1500b, ..., 1500T)...User terminal 100...Operation input section 102...imaging unit 104…Sound collection section 200...Terminal processing section 262, 272...Operation signal transmission control section 264...Viewing screen display control section 274...Content provision control unit 276...Provided screen display control unit 390...Image display unit 392...Sound output unit 394…Communications Department 500...Device memory section 504...Viewing terminal program 506...Providing terminal program 700...Received distribution data group 702...Avatar display management data 704...Message display management data 706...List of images for transmission 710...Provided content data 711... Title distributed at the time of registration 713...Delivery schedule upon registration 715...Additional information at the time of registration 717... Multimedia content data for provision 9...Communication lines 2(2a,2b,...,2t)...User W…Viewing screen 31...Additional information display section 32...Content display section 33...Call operation section 34...Message content display section 35...Shopping icon 36...Chat screen 4 (4a, 4b, ...) ... Avatar 8...Image for transmission

Claims

1. A content distribution system that distributes content including at least video provided by a providing user to a user terminal of each viewing user, In the user terminal, a viewing screen is displayed, which includes a content display unit that displays the content, an operation unit that allows the viewing user to perform a transmission operation of a transmission image for the content being viewed, and a transmission content display unit that displays the transmission image transmitted by the transmission operation of each viewing user, a message content display control means for receiving a message image to be sent in response to the content being viewed from the user terminal and controlling the message image to be displayed on the message content display unit, the message content display control means controlling the display form, including at least the color and / or shape, of the message image to be sent being changed in accordance with the status of the content being viewed; A content distribution system comprising:

2. The viewing user has a transmission image that the viewing user can transmit, the message content display control means receives a message image selected from message images owned by the viewing user as a message image to be sent for the content being viewed, and controls the message content display unit to display the message image. The content distribution system according to claim 1 .

3. The transmission content display control means controls the transmission image to be displayed on the transmission content display unit to be distinguished and displayed for each of the viewing users who transmitted the transmission image.

3. The content distribution system according to claim 1.

4. avatar display control means for displaying an avatar for each of the viewing users on the viewing screen; Equipped with the transmission content display control means controls the display of the transmission image so that it is attached to the avatar of the viewing user who transmitted the transmission image, thereby performing identification display for each of the viewing users who transmitted the transmission image. The content distribution system according to claim 3 .

5. the transmission content display control means, in controlling the change of the display form of the transmission image, changes the degree of the change based on whether the user terminal is that of a viewing user related to the transmission.

5. A content distribution system according to claim 1.

6. the message content display control means changes the display format of the message image to a user terminal of a viewing user who is involved in the message image transmission; 5. A content distribution system according to claim 1.

7. an index value determining means for determining an index value for determining the display form of the image for transmission using at least the viewing record and / or transmission record of each viewing user (hereinafter collectively referred to as "user record"); The content distribution system according to any one of claims 1 to 6, further comprising:

8. A content distribution system that distributes content including at least video provided by a providing user to a user terminal of each viewing user, In the user terminal, a viewing screen is displayed, the viewing screen including a content display unit that displays the content, an operation unit that allows the viewing user to perform a call operation for the content being viewed, and a call content display unit that displays the call content of each viewing user, an index value determining means for determining an index value for determining a display format of the transmission content using at least the viewing record and / or transmission record of each viewing user (hereinafter collectively referred to as "user record"); a message content display control means for receiving a message from the user terminal regarding the content being viewed and controlling the display of the message content on the message content display unit, the message content display control means controlling the display format of the message content to be changed in accordance with the status of the content being viewed, and further controlling the display format of the message content to be changed based on the ranking of the index value of the viewing user related to the message; A content distribution system comprising:

9. A content distribution system that distributes content including at least video provided by a providing user to a user terminal of each viewing user, In the user terminal, a viewing screen is displayed, the viewing screen including a content display unit that displays the content, an operation unit that allows the viewing user to perform a call operation for the content being viewed, and a call content display unit that displays the call content of each viewing user, an index value determination means for determining an index value that determines the display format of the transmission content using at least the viewing record and / or transmission record of each viewing user (hereinafter collectively referred to as "user record"), the index value determination means determining the index value of each viewing user by statistically processing the user record of each viewing user based on the number of viewing users; a message content display control means for receiving a message from the user terminal regarding the content being viewed and controlling the display of the message content on the message content display unit, the message content display control means controlling the display format of the message content to be changed in accordance with the status of the content being viewed; A content distribution system comprising:

10. the message content display control means controls to change at least one of the display size, display color, and display time of the transmitted message image based on the index value; The content distribution system according to claim 7 .

11. the message content display control means variably sets a display area in the message content display unit for displaying a message image of each viewing user in accordance with the number of viewing users, and controls to adjust the display area when the display size exceeds the display area as a result of controlling the change in the display size; The content distribution system according to claim 10.

12. the message content display control means controls the display of the message image after a predetermined display time has elapsed, and adjusts the display area of ​​the new message image based on the display status of the message image when the new message image is displayed. The content distribution system according to claim 11.

13. the index value determination means uses at least one of the amount of charge, the frequency of charge, the number of virtual currency equivalent points consumed, and the user level of the viewing user as the user performance; The content distribution system according to claim 7 .

14. The content is live broadcast content. A content distribution system according to any one of claims 1 to 13.

15. The content is a live broadcast content of a gameplay video. A content distribution system according to any one of claims 1 to 13.

16. A computer system comprising a user terminal of each viewing user and the content distribution system according to any one of claims 1 to 15.

Images