Content distribution system and computer system

The content distribution system dynamically adjusts transmitted content display based on viewer performance, improving user experience and community engagement by highlighting high-performing users.

JP2024161433AActive Publication Date: 2024-11-19BANDAI NAMCO ENTERTAINMENT INC
View PDF 11 Cites 0 Cited by

Patent Information

Application Number
JP2024131846
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-08-08
Publication Date
2024-11-19
Estimated Expiration
2037-10-12

AI Technical Summary

Technical Problem

Existing content distribution systems lack the ability to enhance user experience through dynamic and performance-based display of transmitted text and images, failing to create a sense of unity and engagement among viewers.

Method used

A content distribution system that determines an index value based on viewer performance, adjusting the display format of transmitted content, including size, color, and time, to highlight high-performing users and differentiate between sender and viewer terminals.

Benefits of technology

Enhances user experience by emphasizing high-performing viewers, fostering a sense of community and engagement, and encouraging active participation through preferential display treatment.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024161433000001_ABST
    Figure 2024161433000001_ABST
Patent Text Reader

Abstract

To provide a technique for being richer a user experience by using a transmission function of a text or an image.SOLUTION: A streaming server 1100 distributes a content containing at least video image provided by a provision user to a user terminal 1500 of each viewing user. In the streaming server 1100, a transmission service management part 230 performs a control for causing a transmission content to be displayed on the transmission content display part in a viewing screen of each user terminal 1500 in response to receiving a transmission against a multimedia content during viewing from the user terminal 1500. At the time, an index value determination part 231 determines an index value for determining a display formation of the transmission content by using a user achievement of at least each viewing user. Then, a display formation setting part 233 performs the control for causing a display formation of the transmission content to be changed on the basis of the index value of the viewing user in accordance with the transmission.SELECTED DRAWING: Figure 8
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a content distribution system that distributes content including at least video provided by a providing user to a user terminal of each viewing user. [Background technology]

[0002] 2. Description of the Related Art Social networking services (SNS) that allow users to send text and images using functions called chat and text functions (see, for example, Patent Document 1), content distribution services, and the like are known.

[0003] The use of chat and text functions promotes communication between users. For example, in the case of a video distribution service, users can send and post text messages while watching a video, creating a virtual experience as if they were watching the video together.

[0004] When chat or text functions allow the transmission of images in addition to text, the transmission of those images is sometimes called "image posting," etc. For example, by transmitting (in this case, also called posting) images of characters with dialogue in speech bubbles or images of characters performing actions such as joy, anger, sadness, and happiness, it is possible to succinctly transmit feelings and thoughts that cannot be expressed in words.

[0005] The various user experiences provided by these functions for transmitting text and images can even be said to have become indispensable standard features in recent years in social networking services (SNS) and content distribution services. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2017-91393 A Summary of the Invention [Problem to be solved by the invention]

[0007] The present invention aims to provide a technique for enriching the user experience by utilizing a function for transmitting text and images. [Means for solving the problem]

[0008] A first invention for solving the above problem is a content distribution system (e.g., streaming server 1100 in FIG. 1) that distributes content including at least video provided by a providing user to a user terminal of each viewing user (e.g., user terminal 1500 in FIG. 1), in which a viewing screen (e.g., viewing screen W in FIG. 3) is displayed on the user terminal, the viewing screen including a content display unit (e.g., content display unit 32 in FIG. 3) that displays the content, an operation unit (e.g., call operation unit 33 in FIG. 3) that allows the viewing user to perform a call operation for the content being viewed, and a call content display unit (e.g., call content display unit 34 in FIG. 3) that displays the call content of each viewing user, The content distribution system includes an index value determination means (e.g., the transmission service management unit 230 and the index value determination unit 231 in FIG. 8) that determines an index value that determines the display form of the content using at least the viewing history and / or transmission history of each viewing user (hereinafter collectively referred to as "user history"), and a transmission content display control means (e.g., the transmission service management unit 230, the display form setting unit 233, the transmission content display control unit 235 in FIG. 8) that accepts transmissions regarding the content being viewed from the user terminal and controls the display of the transmission content on the transmission content display unit, and controls changing the display form of the transmission content based on the index value of the viewing user related to the transmission.

[0009] According to the first invention, the index value is determined using the user record of each viewing user who is viewing the content, and the determined index value can be used to change the display form of the transmission content that the viewing user performed the transmission operation. This makes it possible to highlight the transmission content of a viewing user with a high user record (e.g., experience value of viewing and transmission) compared to others, thereby increasing the transmission power of the viewing user. Therefore, each viewing user can be encouraged to individually improve their viewing record and transmission record, thereby providing a user experience of multiple viewing users gathering together and watching the content together, giving the viewing users a sense of excitement and excitement.

[0010] In addition, as a second invention, the content distribution system of the first invention may be configured such that the transmission content display control means changes the degree to which the display format of the transmission content is changed based on whether or not the user terminal is that of a viewing user related to the transmission.

[0011] According to the second invention, for example, it is possible to significantly change the display format of the content sent by the sender on the sender's user terminal, while at other user terminals, the change in the display format of the content sent by the sender is made to a smaller extent.

[0012] In addition, as a third invention, the content distribution system of the first invention may be configured such that the user terminal that changes the display format of the transmission content is the user terminal of the viewing user related to the transmission.

[0013] According to the third aspect of the present invention, the display form of the contents of a message sent by a sender can be changed only at the user terminal of the sender.

[0014] In addition, as a fourth invention, the content distribution system may be configured as any of the first to third inventions, in which the transmission content display control means controls changing the display format of the transmission content based on the ranking of the index value of the viewing user related to the transmission.

[0015] According to the fourth aspect of the present invention, the index values ​​of the viewing users are ranked, and the display form of the message content can be changed according to the ranking of the sender.

[0016] In addition, as a fifth invention, the index value determination means may configure a content distribution system of any of the first to fourth inventions, wherein the index value determination means determines the index value of each viewing user by performing statistical processing of the user performance of each viewing user based on the number of viewing users.

[0017] According to the fifth invention, the index value of each viewing user can be determined by carrying out statistical processing of the user record of each viewing user based on the number of viewing users.

[0018] In addition, as a sixth invention, a content distribution system of any of the first to fifth inventions may be configured in which the operation unit is capable of selectively inputting characters and / or images as transmission elements, and the transmission content display control means controls changing at least one of the display size, display color and display time of the transmitted characters and / or images based on the index value.

[0019] According to the sixth aspect of the present invention, at least one of the display size, display color, and display time of the characters and / or images selectively input as the content of the transmission can be changed and displayed.

[0020] In addition, as a seventh invention, the message content display control means may configure a content distribution system of the sixth invention in which the display area for displaying the message content of each viewing user in the message content display unit is variably set according to the number of viewing users, and if the display size exceeds the display area as a result of controlling the change in the display size, the display area is adjusted.

[0021] According to the seventh invention, the display area for the content transmitted by each viewing user can be variably set according to the number of viewing users, and when the changed display size exceeds the display area, the display area can be adjusted.

[0022] In addition, as an eighth invention, the content distribution system of the seventh invention may be configured such that the transmission content display control means performs control to hide the transmission content after a given display time has elapsed, and adjusts the display area of ​​the new transmission content based on the display status of the transmission content when the new transmission content is displayed.

[0023] According to the eighth aspect of the present invention, the transmission contents of each viewing user can be displayed for a given display time. Then, when a new transmission operation is performed and the transmission contents are displayed, the display area of ​​the transmission contents can be adjusted based on the display status of other transmission contents.

[0024] In addition, as a ninth invention, the content distribution system may be configured as any of the first to eighth inventions, wherein the index value determination means uses at least one of the viewing user's charged amount, charging frequency, number of virtual currency equivalent points consumed, and user level as the user performance.

[0025] According to the ninth aspect of the present invention, the index value can be determined using at least one of the viewing user's billing amount, billing frequency, the number of virtual currency equivalent points consumed, and the user level.

[0026] As a tenth aspect of the present invention, the content distribution system of any one of the first to ninth aspects of the present invention may be configured such that the content is live broadcast content.

[0027] According to the tenth aspect, content can be distributed live.

[0028] As an eleventh aspect of the present invention, in the content distribution system of any one of the first to ninth aspects of the present invention, the content may be a live broadcast content of a gameplay video.

[0029] According to the eleventh aspect of the present invention, a game screen during game play can be live-streamed.

[0030] In addition, as a 12th invention, the transmission content display control means may further control changing the display format of the transmission content depending on the game status related to the game play video being viewed, thereby constituting a content distribution system of the 11th invention.

[0031] According to the twelfth aspect of the present invention, the display form of the message content can be further changed according to the game situation related to the game play video.

[0032] In addition, as a thirteenth invention, the content distribution system of any of the first to twelfth inventions may be configured to include an avatar display control means (e.g., avatar display control unit 220 of FIG. 8) for displaying an avatar for each viewing user on the viewing screen, and the transmission content display control means controls the display of the transmission content so that it is associated with the avatar of the viewing user who transmitted the transmission content.

[0033] According to the thirteenth aspect of the present invention, the transmitted content can be displayed in association with the avatar of the viewing user.

[0034] As a fourteenth aspect of the present invention, a computer system (for example, the content providing system 1000 in FIG. 1) may be configured that includes a user terminal of each viewing user and the content delivery system of any one of the first to thirteenth aspects of the present invention.

[0035] The term "computer system" as used herein may refer to a system using a single computer, or a system in which multiple computers are connected to each other so as to be able to communicate with each other. According to the fourteenth aspect of the present invention, a computer system having the same effects as those of the first aspect of the present invention can be realized. [Brief description of the drawings]

[0036] [Figure 1] FIG. 1 is a diagram showing an example of the overall configuration of a content providing system. [Diagram 2] FIG. 2 is a diagram showing an example of the device configuration of a user terminal. [Diagram 3] FIG. 4 is a diagram showing an example of a screen configuration of a viewing screen. [Figure 4] FIG. 13 is a diagram showing an example of a correspondence relational expression between a form determination index value and a display size. [Diagram 5] 5A to 5C are diagrams illustrating a display size correction process. [Figure 6] FIG. 4 is a diagram showing a display example of a call content display unit. [Figure 7] FIG. 11 is a diagram showing another display example of the call content display section. [Figure 8] FIG. 2 is a block diagram showing an example of the functional configuration of a streaming server. [Figure 9] FIG. 4 is a diagram showing an example of a data configuration of user management data. [Figure 10] FIG. 4 is a diagram showing an example of the data structure of distribution management data. [Figure 11] FIG. 13 is a diagram showing an example of the data configuration of call content display management data. [Figure 12] FIG. 2 is a block diagram showing an example of the functional configuration of the viewing terminal. [Figure 13] FIG. 4 is a block diagram showing an example of a functional configuration of a providing terminal. [Figure 14] 11 is a flowchart showing a processing flow of a streaming server. [Figure 15] 15 is a flowchart showing the flow of processing of the streaming server subsequent to FIG. 14; [Figure 16] 6 is a flowchart showing a processing flow of the viewing terminal. [Figure 17] 11 is a flowchart showing a processing flow of a providing terminal. [Figure 18] FIG. 13 is a diagram showing an example of a chat screen display when the present invention is applied to a chat function of a social networking service. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0037] Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. Note that the present invention is not limited to the embodiments described below, and the forms to which the present invention can be applied are not limited to the following embodiments. In addition, in the description of the drawings, the same parts are given the same reference numerals.

[0038] 1 is a diagram showing an example of the overall configuration of a content providing system 1000 to which the present invention is applied. The content providing system 1000 is a computer system that provides a streaming distribution service that allows an unspecified number of people to enjoy content simultaneously, and includes a streaming server 1100 and multiple user terminals 1500 (1500a, 1500b, ..., 1500T), which are connected to each other via a communication line 9 so that they can communicate data with each other.

[0039] The communication line 9 refers to a communication path that allows data communication. In other words, the communication line 9 includes a dedicated line (dedicated cable) for direct connection, a LAN (Local Area Network) such as Ethernet (registered trademark), a telephone communication network, a cable network, the Internet, and other communication networks, and may be either wired or wireless.

[0040] The streaming server 1100 is a computer system that realizes a content distribution system that streams content including at least video provided from a user terminal 1500 (1500T) of a providing user 2 (2t) to the user terminals 1500 (1500a, 1500b, ...) of each viewing user 2 (2a, 2b, ...).

[0041] Specifically, the streaming server 1100 includes a main device 1101, a keyboard 1106, a touch panel 1108, and a storage 1140. The main device 1101 incorporates a control board 1150 on which are mounted electronic components such as a CPU (Central Processing Unit) 1151, various microprocessors such as a GPU (Graphics Processing Unit) and a DSP (Digital Signal Processor), various IC memories 1152 such as a VRAM, RAM, and ROM, and a communication device 1153. Note that a part or the whole of the control board 1150 may be realized by an ASIC (Application Specific Integrated Circuit), an FPGA (field-programmable gate array), or a SoC (System on a Chip).

[0042] The streaming server 1100 performs calculations based on a predetermined program and data using the control board 1150, thereby: 1) User management functions related to user registration, etc.; 2) Multimedia content streaming service function; 3) A user transmission service function for distributing text and images transmitted (or posted) from a user terminal 1500; 4) An online shopping function that enables the user to purchase images and other items online that can be sent using the user sending service function; Of course, it is also possible to configure the device to realize functions other than those described above. For example, it may be possible to realize a social networking service function, a chat function as part of the social networking service function, and the like.

[0043] The streaming distribution service function is a function that acquires multimedia content such as video data from the user terminal 1500T of a providing user 2t, who is a user that provides the multimedia content, and distributes the acquired multimedia content to the user terminals 1500 (1500a, 1500b, ...) of viewing users 2 (2a, 2b, ...), who are registered viewers, in a format that allows viewing in parallel with the downloading of the content file.

[0044] The user transmission service function is a function that distributes text and images transmitted from the user terminal 1500 (1500a, 1500b, ...) of the viewing user 2 (2a, 2b, ...) to the user terminal 1500 (1500a, 1500b, ...) of each viewing user 2 (2a, 2b, ...) and the user terminal 1500T of the providing user 2t, and displays the transmitted content at the distribution destination.

[0045] The online shopping function is a function for purchasing images to be transmitted, etc., by consuming virtual currency equivalent points (hereinafter simply referred to as "points") owned by the viewing user, and performs the point purchase procedure (billing process) in cooperation with an external electronic settlement server operated by an electronic settlement company, etc. in response to a request from the user terminal 1500. During the billing process, the electronic settlement server responds to an inquiry from the streaming server 1100 and performs a process of settling the purchase amount of the points with the user's credit card, prepaid card, etc. Then, the streaming server 1100 grants the user points equivalent to the purchase amount settled by the electronic settlement server.

[0046] 1, the streaming server 1100 may be configured to include multiple blade servers each assigned to one function, and connected to each other via an internal bus for data communication. Alternatively, the streaming server 1100 may be configured to function as a whole as a streaming server 1100 by having multiple independent servers installed at different locations communicate with each other via a communication line 9.

[0047] The user terminals 1500 (1500a, 1500b, ..., 1500T) are computer systems used by users 2 (2a, 2b, ..., 2t), and by changing the programs they execute, they function as a providing terminal that creates multimedia to be provided for streaming distribution, or as a viewing terminal that enables viewing of multimedia content to be streamed. In the example of FIG. 1, the user terminal 1500T corresponds to the providing terminal, and the user terminals 1500a and 1500b correspond to the viewing terminals. The user terminal 1500 in this embodiment is a device known as a smartphone, but may also be a portable game device, a personal computer, a tablet computer, a wearable computer, or the like.

[0048] FIG. 2 is a diagram showing an example of the device configuration of a smartphone, which is an example of the user terminal 1500. As shown in FIG. 2, the user terminal 1500 includes a directional input key 1502, a home key 1504, a touch panel 1506 that functions as an image display device and a contact position input device, an internal battery 1509, a speaker 1510, a microphone 1512, an image sensor module 1520, a control board 1550, and a memory card reader 1542 that can read and write data from a memory card 1540 that is a computer-readable storage medium. In addition, a power button, a volume control button, and the like (not shown) are provided. In addition, an IC card reader or the like that can contactlessly read and write data from an IC card-type credit card or prepaid card that can be used to pay for game play may be provided.

[0049] The control board 1550 is equipped with various microprocessors such as a CPU 1551, a GPU, and a DSP, various IC memories 1552 such as a VRAM, a RAM, and a ROM, a wireless communication module 1553 for wireless communication with a mobile phone base station or a wireless LAN base station connected to the communication line 9, and an interface circuit 1557. The interface circuit 1557 includes a circuit for receiving signals from the direction input key 1502 and the home key 1504, a driver circuit for the touch panel 1506, an output amplifier circuit for outputting a sound signal to the speaker 1510, an audio signal generating circuit for generating a signal of the sound collected by the microphone 1512, a circuit for inputting image data of an image captured by the image sensor module 1520, and a signal input / output circuit for the memory card reader 1542. Each of these elements mounted on the control board 1550 is electrically connected to each other via a bus circuit or the like, and is connected so as to be able to read and write data and transmit and receive signals. Note that a part or all of the control board 1550 may be configured with an ASIC, an FPGA, or an SoC.

[0050] In this control board 1550, an IC memory 1552 stores a video providing program for realizing the function as a providing terminal (for example, a providing terminal program enabling the creation and provision of multimedia content), a viewing program for realizing the function as a viewing terminal (for example, a viewing terminal program enabling the viewing of streaming multimedia content and the transmission of text and images), and data required for executing these programs. Then, the CPU 1551 etc. executes the providing terminal program and the viewing terminal program to perform arithmetic processing, and controls each part of the user terminal 1500 in response to operational inputs to the touch panel 1506, the directional input keys 1502, and the home key 1504, thereby enabling the user terminal 1500 to provide / view / etc. multimedia content.

[0051] In this embodiment, the user terminal 1500 is configured to download the providing terminal program, the viewing terminal program, and various setting data from the streaming server 1100, but it may also be configured to read them from a storage medium such as a memory card 1540 obtained separately.

[0052] 3 is a diagram showing an example of the screen configuration of a viewing screen W for viewing multimedia content. In a user terminal 1500 executing a viewing program, the viewing screen W shown in FIG. 3 is displayed on a touch panel 1506. The viewing screen W includes, for example, an additional information display section 31 for displaying additional information of the distributed multimedia content being viewed, a content display section 32 for displaying the multimedia content being viewed, a transmission operation section 33 for selecting and inputting text and / or images as transmission elements to perform a transmission operation, a transmission content display section 34 for displaying the avatars 4 (4a, 4b, ...) of each viewing user 2 (2a, 2b, ...) and the text and image (transmission content) that have been operated to be transmitted, and a shopping icon 35 for purchasing a transmission image 8 or the like online.

[0053] The incidental information displayed on the incidental information display unit 31 may include, for example, the title, genre, shooting date and time, shooting location, information about the subject, a situation description, a message from the providing user 2t, and the like. If the multimedia content is a game play video, the incidental information may include the game play content and the game situation (for example, information about the game stage and location being played, information about equipment, the name of the enemy character, the progress of the game, the player level, the remaining time and elapsed time until the stage is cleared, the name of the rare item that can be obtained, and the like). The incidental information may be set by the providing user 2t himself before the multimedia content is provided, or may be set by the operator of the streaming distribution service. In the case of a game play video, the incidental information may be automatically obtained and set from the play information of the game being played.

[0054] The content display unit 32 displays images of multimedia content including at least moving images (for example, live broadcasts of musical performances or entertainment by the providing user 2t, gameplay played by the providing user 2t, edited videos of live broadcasts of gameplay or recorded gameplay, video works filmed and edited by the providing user 2t, etc.).

[0055] The call operation unit 33 includes an input field 331 for inputting text (letters, numbers, symbols) such as a comment or message to be sent, a selection field 333 for selecting an image to be sent from among the transmission images 8, and a call execution operation icon 335.

[0056] In the selection field 333, images 8 for transmission owned by the viewing user 2a of the user terminal 1500a are displayed side by side. Images 8 for transmission are images (also called stamps, etc.) such as illustrations and photographs prepared by the operator of the streaming distribution service and given to the viewing users 2 (2a, 2b, ...) free of charge or for a fee. Each viewing user 2 can obtain or purchase an image 8 for transmission, own it, and use it for transmission. Note that an image 8 for transmission can be used any number of times once it has been obtained by purchasing it, but it is also possible to have multiple images of the same type, and consume one from the number owned each time a transmission is made.

[0057] Here, the type of the image 8 for transmission can be set appropriately, and it is not limited to a still image, but may be an image with changes such as an animated GIF. Basically, the image 8 for transmission is designed in various ways to be an item of communication between the viewing users 2. Among them are images 8 for transmission designed to show messages evaluating the multimedia content being viewed (e.g., good, bad, interesting, not interesting, amazing, cool, ...), messages of support and encouragement to the providing user 2t (e.g., hang in there, calm down, ...), and predetermined intentions of the sender (e.g., evaluation messages such as good and interesting, I'm cheering you on, hang in there, ...). Also, images including words or phrases within the image, such as the image 8A for transmission, are included. A character may be represented with a speech bubble, and designed as if the character is speaking the word or phrase. Of course, the word or phrase may be an onomatopoeia such as a sound effect expression in a manga. For example, an image of a surprised character with the word "Surprise!" attached to it, or an image of an excited character with the word "Exciting!" attached to it, etc. may be used.

[0058] The message content display unit 34 displays the message content, which is text or an image sent by each viewing user 2 currently viewing, in association with the avatar 4 (4a, 4b, ...) of each viewing user 2 (2a, 2b, ...). In this embodiment, the avatars 4 of each viewing user 2 are vertically arranged on both sides of the message content display unit 34, and the message content is displayed for a given display time in a speech bubble 5 (5a, 5b, ...) indicating that the avatar 4 (4a, 4b, ...) of the corresponding viewing user 2 (2a, 2b, ...) is speaking, in the center of the message content display unit 34 inside them.

[0059] When the shopping icon 35 is touched, a sales screen showing a list of transmission images 8 for sale is displayed as a pop-up, and the desired transmission image 8 can be purchased at the sales price in exchange for consuming points. In addition, on the sales screen, cheering items for the providing user 2t can be purchased. For example, items that activate a cheering effect process according to the type when purchased, and images that are placed on the viewing screen W to create a gorgeous background when purchased, etc. are appropriately prepared as items for sale.

[0060] The viewing screen W configured as described above is laid out so as to display the avatars 4 (4a, 4b, ...) of the viewing users 2 (2a, 2b, ...) in front of (below) the content display section 32, as shown in FIG. 3, providing users with the feeling that they are gathered together to watch multimedia content.

[0061] In addition, by displaying the text and images (transmission images 8) sent by each viewing user 2 (2a, 2b, ...) in the speech bubbles 5 (5a, 5b, ...) of the avatar 4, it creates an atmosphere as if everyone is watching multimedia content together, expressing their own thoughts, and talking to their friends. Because the transmission images 8 do not need to be read one by one like text, they can instantly, symbolically, and succinctly convey what the viewing users 2 (2a, 2b, ...) are feeling and thinking. They also have a greater effect on livening up the atmosphere than text.

[0062] In this way, the viewing screen W is designed to make it easy for the providing user 2t who provides the multimedia content and the viewing users 2 (2a, 2b, ...) who watch it to have the feeling that they are working together to liven up a single live stage or performance.

[0063] In this embodiment, the user-generated service function of text and images is utilized to enhance the communication power of each viewing user 2, thereby providing new added value that further enhances the sense of unity and solidarity between viewing users 2.

[0064] [principle] In this embodiment, the display form of the transmission contents displayed on the transmission contents display unit 34 is changed according to the viewing record and / or transmission record (user record) of the viewing user (sender) related to the transmission. In addition, at that time, the degree of the change is changed between the user terminal 1500 of the sender and the user terminals 1500 of the viewing users (other viewers) other than the sender. Specifically, for the user terminal 1500 of the sender, the display form of the transmission contents is changed to largely reflect the user record of the sender, while the degree of change is made smaller for the user terminals 1500 of the other viewers other than the sender.

[0065] For this purpose, the streaming server 1100 accepts a transmission from the user terminal 1500 for the multimedia content being viewed, and determines an index value (mode determination index value) for determining the display mode of the transmission content based on the user record of the sender (determination step). Then, based on the mode determination index value, display modes for the sender and other viewers are set (setting step), and the transmission content is displayed in the corresponding display mode on the viewing screen W of each user terminal 1500 in the transmission content display unit 34.

[0066] 1. Judgment step In the determination step, an index calculation process is executed to obtain a mode determination index from the user record of the sender according to, for example, a predetermined function f (V1, V2, ...). The variable V1 of the function f is a variable related to the viewing record of the sender, and includes, for example, the number of points consumed to purchase the image 8 for transmission, etc., consumed by the sender while viewing multimedia content, the amount of charges, or the frequency of charges, viewing time, etc. Furthermore, the variable V2 of the function f is a variable related to the sending record of the sender, and includes, for example, the number of sending operations (number of calls) and the frequency (calling frequency) performed by the sender while viewing multimedia content. This function f obtains a mode determination index so that the larger the variables V1 and V2 are (the higher the viewing record and sending record of the sender), the larger the value becomes, and the smaller the variables V1 and V2 are (the lower the viewing record and sending record of the sender), the smaller the value becomes.

[0067] The function f may be a function whose only variable is the variable V1 relating to the viewing record, or a function whose only variable is the variable V2 relating to the transmission record. Also, the function may be a function using one of the values ​​exemplified as the variables V1 and / or V2, or a function using a plurality of them. Alternatively, the function may be a function whose variable is the user level of the viewing user, which is updated from time to time to reflect the viewing record and / or transmission record of the viewing user. Also, the variables V1 and V2 may be the number of points consumed for the multimedia content being viewed, the number of transmissions, etc., or the total amount or number up to the present time.

[0068] 2. Setup steps In this embodiment, the display size is set as the display mode of the contents of the transmission operation performed by each viewing user. Specifically, in the setting step, first, the display size for the sender and the display size for other viewers are provisionally set from the form determination index value obtained in the index value calculation process according to a predetermined correspondence relational expression between the form determination index value and the display size (display size provisional setting process).

[0069] FIG. 4 is a diagram showing an example of a correspondence relation equation between a form determination index value and a display size, in which a correspondence relation equation L11 for provisionally setting a display size for a sender is shown by a solid line, and a correspondence relation equation L13 for provisionally setting a display size for other viewers is shown by a dashed line. Each correspondence relation equation is determined as a straight line in which the correspondence relation equation L11 has a steeper slope than the correspondence relation equation L13, as shown in FIG. 4. For example, when the form determination index value is v a If so, the caller display size is v b The display size for other viewers is v b v smaller than c The correspondence equation is not limited to a straight line, and may be set as a curve, a broken line, or the like as appropriate. Alternatively, a data table defining the correspondence between the form determination index value and the sender display size and a data table defining the correspondence between the form determination index value and the display size for other viewers may be prepared, and the sender display size and the display size for other viewers may be provisionally set corresponding to the form determination index value obtained by referring to these data tables.

[0070] In this embodiment, the message contents are displayed for a given display time as speech bubbles 5 of the avatar 4 in the message contents display section 34, and when there are few senders, a wide display area for each message content can be secured. However, when there are many senders, the display area that can be secured for each message content becomes narrower, and a maximum of the number of display areas required is the number of viewing users.

[0071] Therefore, in this embodiment, regardless of whether there is a transmission content to be displayed, the central part of the transmission content display unit 34 is first divided into areas for the number of viewers, and a display area for displaying each transmission content (hereinafter referred to as "transmission area") is assigned to all viewing users. Then, for transmission content whose provisionally set display size (display size for the sender or display size for other viewers) exceeds the size of the transmission area, the display size is corrected (display size correction process). At that time, if there is free space in the adjacent transmission area, the transmission area is adjusted and then the display size is corrected. Note that a transmission area may be assigned only to viewing users who have a transmission content to be displayed, and the display size correction process may be performed. In that case, every time a transmission operation is accepted from the user terminal 1500, the central part of the transmission content display unit 34 may be divided into areas for the number of viewers.

[0072] FIG. 5 is a diagram for explaining the display size correction process, and FIG. 5(a) shows the sections of the origination area 341 (341a, 341b, ...) that are initially assigned to each viewing user 2 (2a, 2b, ...) in the origination content display unit 34. Here, assume that the viewing user 2a performs a new origination operation, and the provisionally set display size for the originator of the origination content exceeds the size of the origination area 341a. In this case, first, the free space of the neighboring origination areas 341b, 341d, 341e is determined. For example, if there is no origination content being displayed for the viewing users 2b, 2d, 2e in each origination area 341b, 341d, 341e, or if there is, but the display size (in this case, the display size for other viewers) is smaller than the size of the origination areas 341b, 341d, 341e, there is free space in the origination areas 341b, 341d, 341e. When there is such a free area, as shown in FIG. 5(b), the origination area 341a is enlarged accordingly, and the origination areas 341b, 341d, and 341e are reduced and adjusted, and the allocation of the origination areas 341a, 341b, 341d, and 341e for the viewing users 2a, 2b, 2d, and 2e is changed. Then, if the provisionally set originator display size is larger than the size of the adjusted origination area 341a, the originator display size is reduced to the size of the adjusted origination area 341a and confirmed. If it is equal to or smaller than the adjusted origination area 341a, the originator display size is confirmed as it is. By the process here, for example, as shown in FIG. 6, in the user terminal 1500a of the viewing user 2a, the contents of his / her own transmission are displayed occupying a wider range than the transmission areas of the other viewing users 2 (2b, 2c, ...).

[0073] On the other hand, if there is a message being displayed for viewing users 2b and 2d in adjacent origination areas 341b and 341d and there is no free space for it, the provisionally set display size for the sender is reduced to the size of the originally assigned origination area 341a and finalized. By this process, even if there are many senders, the message is displayed large enough to fit within the origination area assigned to each sender, for example, as shown in Fig. 7.

[0074] As described above, in this embodiment, when a viewing user performs a call operation, the user record is reflected in the display size on the sender's user terminal 1500, and the higher the viewing record or call record, the larger the display, and the lower the record, the smaller the display. On the other hand, if the message content of others is displayed too large, it becomes a nuisance, so for the message content sent by other viewers, the degree of change is suppressed compared to when the viewer sends the message, and the message content of a viewing user with a high user record is displayed larger and the message content of a viewing user with a low user record is displayed smaller.

[0075] Here, a viewing user with a high user record, that is, a viewing user who purchases and uses many transmission images 8 and support items, etc., or transmits many transmissions, can be said to be a key player who is actively trying to liven up the atmosphere of the place where everyone is watching the streaming distribution. Therefore, according to this embodiment, the transmission contents of such a viewing user can be displayed large and made noticeable, so that the viewing user can be given an apparent preferential treatment on the viewing screen W and the transmission power of the viewing user can be increased. In addition, the preferential treatment can encourage active transmission to other viewing users. Therefore, it is easy to get a sense of a lot of support for the providing user and a sense of excitement in the place, and it is possible to bring about new added value that further increases the sense of unity and solidarity among the viewing users.

[0076] [Function configuration] 1. Streaming Server Fig. 8 is a block diagram showing an example of a functional configuration of the streaming server 1100. As shown in Fig. 8, the streaming server 1100 includes an operation input unit 100s, a server processing unit 200s, an image display unit 390s, a sound output unit 392s, a communication unit 394s, and a server storage unit 500s.

[0077] The operation input unit 100s is for inputting various operations for system management, maintenance, etc., and can be realized by, for example, a keyboard, a mouse, a touch panel, etc. In FIG.

[0078] The server processing unit 200s can be realized by electronic components such as a microprocessor such as a CPU or GPU, an ASIC, and an IC memory, and controls input and output of data between each unit of the device including the operation input unit 100s and the server storage unit 500s. Then, it performs various arithmetic processing based on predetermined programs and data, operation input signals from the operation input unit 100s, data received from the user terminal 1500, and the like, and generally controls the operation of the streaming server 1100. In Fig. 1, the control board 1150 and its CPU 1151 correspond to this.

[0079] This server processing unit 200s includes a user management unit 202, an online shopping management unit 204, a distribution service management unit 210, an avatar display control unit 220, an outgoing call service management unit 230, a timing unit 280s, an image generation unit 290s, a sound generation unit 292s, and a communication control unit 294s.

[0080] The user management unit 202 performs processes related to user registration and manages data of each registered user linked to a user account. For example, it can execute processes such as granting a unique user account to a registered user, registration information management processes for registering and managing personal information for each user account, ledger management processes for electronic payment media (e.g., virtual currency and points equivalent to virtual currency) consumed for payment of billing elements (e.g., online shopping, etc.), usage history management processes for managing login and logout history, and creation and editing processes of avatars 4. Of course, it can also appropriately include management processes for other data linked to user accounts.

[0081] The online shopping management unit 204 is responsible for controlling online shopping, and can be realized by appropriately utilizing known online shopping technology. In this embodiment, the viewing user can purchase a transmission image and the like through online shopping.

[0082] The distribution service management unit 210 performs various processes for realizing a streaming distribution service of multimedia content. For example, it can execute a process for managing the distribution schedule of multimedia content, a process for managing viewing users, a process for acquiring data of multimedia content for distribution from a providing terminal, a streaming distribution process, etc. Of course, it can also include other processes as appropriate.

[0083] The avatar display control unit 220 controls the display of an avatar for each viewing user on the message content display unit 34 in the user terminal 1500 (1500a, 1500b, ...) of each viewing user, which is a viewing terminal. In this embodiment, this includes the delivery of avatar display management data 626 in which avatar data for each viewing user and the like are set.

[0084] The outgoing service management unit 230 performs various processes for realizing a user outgoing service in parallel with the streaming distribution service. Specifically, it accepts from the viewing terminal that an outgoing operation for the multimedia content being viewed has been input, and controls the outgoing content related to the outgoing operation to be displayed on the outgoing content display unit 34 of each viewing terminal. In this embodiment, this includes the distribution of the outgoing content display management data 630 that sets the outgoing content being displayed on the outgoing content display unit 34, its display size, display time, etc. for each viewing user.

[0085] This outgoing service management unit 230 includes an index value determination unit 231, a display form setting unit 233, and an outgoing content display control unit 235, and performs control to change the display form of the display content to be displayed on the outgoing content display unit 34 at each viewing terminal, using at least the user performance of each viewing user.

[0086] The index value determination unit 231 determines a mode determination index value from the user performance of the sender according to a predetermined function f(V1, V2, . . . ).

[0087] The display mode setting unit 233 sets, for example, a display size as the display mode of the message content, based on the mode determination index value obtained by the index value determining unit 231 .

[0088] The message content display control unit 235 controls the display of the message content sent by each viewing user on each viewing terminal in the message content display unit 34 in the display size set by the display format setting unit 233. When the streaming server 1100 intends to distribute the image displayed on the message content display unit 34 itself, the message content display control unit 235 may generate the image.

[0089] The timekeeping unit 280s uses a system clock to keep track of the current date and time, time limit, and the like.

[0090] The image generating unit 290s generates images relating to system management of the streaming server 1100 and outputs them to the image display unit 390s.

[0091] The sound generation unit 292s is realized by executing an IC or software that generates or decodes audio data, and generates or decodes audio data such as operation sounds and BGM related to the system management and video distribution of the streaming server 1100. Audio signals related to system management are output to the sound output unit 392s.

[0092] The communication control unit 294s performs communication connection and data processing for data communication with an external device (eg, the user terminal 1500) via the communication unit 394s, and realizes data exchange with the external device.

[0093] The image display unit 390s displays various screens for system management and the like based on the image signal input from the image generation unit 290s. For example, this can be realized by an image display device such as a flat panel display, a cathode ray tube (CRT), a projector, or a head-mounted display. In FIG. 1, the touch panel 1108 corresponds to this.

[0094] The sound output unit 392s emits the sound signal input from the sound generation unit 292s. In FIG. 1, this corresponds to a speaker (not shown) provided in the main device 1101 or the touch panel 1108.

[0095] The communication unit 394s realizes communication by connecting to the communication line 9. For example, it can be realized by a wireless communication device, a modem, a TA (terminal adapter), a jack for a wired communication cable, a control circuit, etc. In FIG. 1, the communication device 1153 corresponds to this.

[0096] The server storage unit 500s stores in advance or temporarily stores each time processing is performed programs for operating the streaming server 1100 and implementing various functions of the streaming server 1100, and data used during execution of the programs. For example, it can be implemented by IC memory such as RAM or ROM, magnetic disk such as hard disk, optical disk such as CD-ROM or DVD, etc. In Fig. 1, the IC memory 1152 corresponds to this.

[0097] Also stored in server storage unit 500s are server program 503, viewing terminal program for distribution 505, providing terminal program for distribution 507, sales item management data 509, image data for transmission 510, user management data 600, distribution management data 620, and current date and time 800. In addition, other necessary data such as image data for the background image of viewing screen W and material data for creating and editing avatars is also stored as appropriate.

[0098] The server program 503 is a program for causing the server processing unit 200s to function as the user management unit 202, the online shopping management unit 204, the delivery service management unit 210, the avatar display control unit 220, and the outgoing service management unit 230. Note that programs for causing the server processing unit 200s to function as the image generation unit 290s, the sound generation unit 292s, and the communication control unit 294s may also be included as appropriate.

[0099] The providing terminal program for distribution 507 is original data of an application program downloaded to the user terminal 1500 used as a providing terminal, and executing this enables the user terminal 1500 to function as a providing terminal. Note that the providing terminal program for distribution 507 can also be configured to be included in a game program for enabling the execution of a game with a live distribution function implemented.

[0100] The distribution viewing terminal program 505 is original data of an application program downloaded to the user terminal 1500 used as a viewing terminal, and by executing this, the user terminal 1500 becomes able to function as a viewing terminal.

[0101] The sales item management data 509 is data for defining and managing sales items (sales objects) through online shopping. For example, the sales item management data 509 stores data on purchasable items in association with the number of items in stock, the amount charged (corresponding to the amount debited from an electronic payment medium), etc.

[0102] The transmission image data 510 is data that defines an image for transmission. One piece of transmission image data 510 includes, for example, the type of the image for transmission (type of image for transmission), image data, a sales price, and the like.

[0103] User management data 600 is prepared for each registered user and stores various data associated with a user account, which is unique identification information. One user management data 600 includes, for example, a unique user account 601, a user level 602, payment medium ledger data 603, avatar setting data 604, a list of images for retained transmissions 605, transmission log data 606, and user performance data 607, as shown in FIG.

[0104] The payment medium ledger data 603 stores information on the balance of the electronic payment medium (points in this embodiment) linked to the user, such as the history of the purchase date and time of points and the number of points purchased (charged amount), the history of the consumption date and time of points and the number of points consumed, etc.

[0105] The avatar setting data 604 stores setting data for the avatar 4 of the user.

[0106] The owned image list for transmission 605 stores a list of images for transmission 8 owned by the user.

[0107] The transmission log data 606 is created each time the user performs a transmission operation as a viewing user. One transmission log data 606 stores, for example, the transmission date and time, the distribution title of the transmission target, the user account of the providing user who provided the multimedia content of the transmission target, the transmission content, and the like.

[0108] The user performance data 607 stores the number of points consumed, the billing amount, the billing frequency, the viewing time, the number of calls, the calling frequency, etc., which are variables V1 and V2 of the function f, as user performance. The number of points consumed, the billing amount, and the billing frequency are calculated as needed based on the payment medium ledger data 603, and the number of calls and the calling frequency are calculated as needed based on the call log data 606.

[0109] The distribution management data 620 is prepared for each streaming distribution, and stores various data describing the distribution status. As shown in Fig. 10, one distribution management data 620 includes, for example, a distribution title 621, a distribution schedule 622, multimedia content data 623, supplementary information 624, viewing user management data 625, avatar display management data 626, transmission record data 627, and transmission content display management data 630. In addition, for example, background data defining the background of the viewing screen W and the like are stored.

[0110] The viewing user management data 625 stores various data related to the viewing users who have registered as viewers of the multimedia content related to the streaming distribution. For example, the data stores access information (e.g., IP address) for connecting to the user terminal 1500 of each of the viewing users via the communication line 9 in association with the user accounts of all the viewing users who have registered as viewers.

[0111] The avatar display management data 626 stores various data describing the display status of the avatar of each viewing user in the message content display unit 34. For example, the avatar data, the arrangement position coordinates, the display size, and the like are set in association with the user account of each viewing user.

[0112] The transmission history data 627 is created every time the viewing user performs a transmission operation on the viewing terminal. One piece of transmission history data 627 includes the user account of the viewing user who is the sender, the transmission timing, and transmission content data (the input text or the selected type of image for transmission).

[0113] The transmission content display management data 630 is prepared for each viewing user, and stores various data describing the display status of the transmission content display unit 34 in each viewing terminal. As shown in Fig. 11, one transmission content display management data 630 stores a user account 631 of the viewing user, transmission area data 632 indicating the position and range of the transmission area assigned to the viewing user, a transmission display flag (Yes: ON / No: OFF) 633 indicating the presence or absence of a transmission content being displayed, transmission content data 634 set when the corresponding transmission display flag 633 is ON, a display size for the sender 635 and a display size for other viewers 636 set for the transmission content, a display start date and time 637 of the transmission content, and a display time 638. The display time 638 is the time from when the transmission content is displayed to when it is hidden, and in this embodiment, a fixed value (for example, 5 seconds, etc.) is set.

[0114] 2. Viewing device 12 is a block diagram showing an example of a functional configuration of a user terminal 1500 (1500a, 1500b, ...) serving as a viewing terminal. As shown in FIG. 12, the user terminal 1500 (1500a, 1500b, ...) serving as a viewing terminal includes an operation input unit 100, an imaging unit 102, a sound collection unit 104, a device processing unit 200, an image display unit 390, a sound output unit 392, a communication unit 394, and a device storage unit 500.

[0115] The operation input unit 100 is for the user to input various operations, and can be realized by, for example, a button switch, a joystick, a touch pad, a track ball, an acceleration sensor, an angular velocity sensor, etc. In Fig. 2, this corresponds to the direction input key 1502, the home key 1504, and the touch panel 1506.

[0116] The imaging unit 102 receives light from a subject to be photographed, converts it into an electrical signal, generates digital image data, and outputs it to the device processing unit 200. For example, it can be realized by a lens, a mechanical shutter, a shutter driver, a photoelectric conversion element such as a CCD image sensor module or a CMOS image sensor module, a digital signal processor (DSP) that reads the amount of charge from the photoelectric conversion element and generates image data, an IC memory, etc. In FIG. 2, this corresponds to the image sensor module 1520.

[0117] The sound collector 104 converts the collected sound into an electrical signal and outputs it. In FIG. 2, the microphone 1512 corresponds to this.

[0118] The device processing unit 200 can be realized by electronic components such as a microprocessor such as a CPU or GPU, an ASIC, or an IC memory, and controls data input / output between each unit of the device including the operation input unit 100 and the terminal storage unit 500. Then, it performs various calculation processes based on predetermined programs and data, an operation input signal from the operation input unit 100, data received from the streaming server 1100, and the like, and generally controls the operation of the user terminal 1500 as a viewing terminal. In FIG. 2, this corresponds to the control board 1550 and its CPU 1551. And, the device processing unit 200 of the viewing terminal in this embodiment includes a viewing terminal calculation unit 260, a timer unit 280, a sound generation unit 292, and a communication control unit 294.

[0119] The viewing terminal calculation section 260 includes an operation signal transmission control section 262 and a viewing screen display control section 264 .

[0120] The operation signal transmission control unit 262 performs processing for transmitting various data and request information to the streaming server 1100 in response to an operation input to the operation input unit 100 .

[0121] The viewing screen display control unit 264 performs control for displaying the viewing screen W based on various data received from the streaming server 1100.

[0122] The sound generation unit 292 is realized by, for example, a processor such as a DSP or a voice synthesis IC, or an audio codec capable of playing audio files, and generates sound signals for sound effects, background music, and various operation sounds related to video distribution, and outputs them to the sound output unit 392.

[0123] The communication control unit 294 performs communication connection and data processing for data communication with an external device (eg, the streaming server 1100) via the communication unit 394, and realizes data exchange with the external device.

[0124] Image display unit 390 displays various screens such as viewing screen W based on the image signal input from viewing screen display control unit 264. For example, this can be realized by an image display device such as a flat panel display, a cathode ray tube (CRT), a projector, or a head mounted display. In this embodiment, this corresponds to touch panel 1506 in FIG. 2.

[0125] The sound output unit 392 outputs sounds such as background music based on the sound signal input from the sound generation unit 292. In FIG.

[0126] The communication unit 394 realizes communication by connecting to the communication line 9. For example, it can be realized by a wireless communication device, a modem, a TA, a jack of a wired communication cable, a control circuit, etc. In FIG. 2, the wireless communication module 1553 corresponds to this.

[0127] The terminal storage unit 500 stores in advance or temporarily stores each time processing is performed programs for operating the user terminal 1500 as a viewing terminal and realizing the functions of the user terminal 1500 as a viewing terminal, and data used during execution of the programs. For example, it can be realized by IC memory such as RAM or ROM, magnetic disk such as hard disk, optical disk such as CD-ROM or DVD, etc. In FIG. 2, this corresponds to the IC memory 1552 and memory card 1540.

[0128] Furthermore, the terminal storage unit 500 of the viewing terminal stores a viewing terminal program 504, a received distribution data group 700, and a current date and time 800. Of course, other programs and data than these can also be stored as appropriate.

[0129] The viewing terminal program 504 is a program for causing the terminal processing unit 200 to function as the viewing terminal calculation unit 260. In this embodiment, it is a copy of the distribution viewing terminal program 505 (see FIG. 8) provided by the streaming server 1100.

[0130] The received distribution data group 700 stores various types of distribution data received from the streaming server 1100 during streaming distribution. In this embodiment, it stores avatar display management data 702, transmission content display management data 704, and owned transmission image list 706. The owned transmission image list 605 (see FIG. 8) is copied to the owned transmission image list 706 when the user logs in or when a viewer is registered.

[0131] 3. Device provided Fig. 13 is a block diagram showing an example of a functional configuration of a user terminal 1500 (1500T) serving as a providing terminal. In Fig. 13, the same components as those of the user terminals 1500 (1500a, 1500b, ...) serving as viewing terminals are denoted by the same reference numerals.

[0132] In the user terminal 1500 (1500T) serving as a providing terminal, the device processing unit 200 performs various types of arithmetic processing based on predetermined programs and data, operation input signals from the operation input unit 100, data received from the streaming server 1100, etc., and generally controls the operation of the user terminal 1500 serving as a providing terminal. The device processing unit 200 of the providing terminal includes a providing terminal arithmetic unit 270, a timing unit 280, a sound generation unit 292, and a communication control unit 294.

[0133] The providing terminal calculation unit 270 includes an operation signal transmission control unit 272 , a content providing control unit 274 , and a providing screen display control unit 276 .

[0134] The operation signal transmission control unit 272 performs processing for transmitting various data and request information to the streaming server 1100 in response to an operation input to the operation input unit 100 .

[0135] The content provision control unit 274 performs processes related to the generation of data of multimedia content for distribution and control of the provision to the streaming server 1100. In the case of live distribution, it realizes the function of a live streaming encoder that encodes images captured by the imaging unit 102 one by one and controls the provision to the streaming server 1100.

[0136] The providing screen display control unit 276 performs control for displaying the providing screen. The providing screen is an operation screen that accepts various operations for live distribution of multimedia content, and also serves as a monitor screen for monitoring the distribution status.

[0137] The terminal storage unit 500 prestores a program for operating the user terminal 1500 as a providing terminal and realizing the functions of the user terminal 1500 as a providing terminal, as well as data used during execution of the program, or temporarily stores the data each time processing is performed. For example, the terminal storage unit 500 can be realized by IC memory such as RAM or ROM, a magnetic disk such as a hard disk, or an optical disk such as a CD-ROM or DVD.

[0138] Furthermore, the terminal storage unit 500 of the providing terminal stores a providing terminal program 506, a received distribution data group 700, provided content data 710, and a current date and time 800. Of course, other programs and data can also be stored as appropriate.

[0139] The providing terminal program 506 is a program for causing the terminal processing unit 200 to function as the providing terminal computing unit 270. In this embodiment, it is a copy of the distribution providing terminal program 507 (see FIG. 8) provided by the streaming server 1100.

[0140] The received distribution data group 700 stores various types of distribution data received from the streaming server 1100 when providing multimedia content.

[0141] The provided content data 710 includes a distribution title at the time of registration 711, a distribution schedule at the time of registration 713, additional information at the time of registration 715, and multimedia content data to be provided 717. The distribution title at the time of registration 711, the distribution schedule at the time of registration 713, and the additional information at the time of registration 715 each store setting data when a distribution registration procedure is performed as a providing user. The multimedia content data to be provided 717 is original data of the multimedia content to be distributed.

[0142] [Processing flow] 1. Streaming Server 14 and 15 are flowcharts showing the flow of processing related to live distribution of multimedia content in the streaming server 1100. The processing described here is realized by the server processing unit 200s reading and executing the server program 503. It is assumed that the distribution title, distribution schedule, and additional information of the multimedia content have already been set by the providing user in accordance with the distribution registration procedure. It is also assumed that the viewing terminal of the viewing user has already completed a separate login procedure.

[0143] First, the distribution service management unit 210 performs initial settings for the distribution management data 620 (step S100). Here, the viewing user management data 625, the avatar display management data 626, and the transmission content display management data 630 are initialized. Note that the distribution title 621, the distribution schedule 622, and the supplementary information 624 have already been set in conjunction with the distribution registration procedure. Since the multimedia content data 623 is a live distribution, it is not stored until the start of distribution. If it is not a live distribution, the data of the multimedia content prepared in advance will be stored.

[0144] Next, the distribution service management unit 210 starts distribution of various distribution data such as the avatar display management data 626, the transmission content display management data 630, and the held transmission image list 605 based on the viewing user management data 625 (step S102: distribution α). The distribution timing can be, for example, when the distribution data is added, deleted, or updated, or when a new viewing user is registered, or may be at a predetermined cycle.

[0145] After that, the distribution service management unit 210 monitors the reception of a viewing request (step S104). When a viewing user selects a distribution title he or she wants to view on a user terminal 1500 (1500a, 1500b, ...) functioning as a viewing terminal and performs a predetermined viewing operation, the viewing request is transmitted to the streaming server 1100 together with information such as a user account.

[0146] When this viewing request is received (YES in step S104), the distribution service management unit 210 creates new viewing user management data 625 and registers the user of the viewing terminal as a viewing user (step S106).

[0147] Then, the avatar display control unit 220 creates new avatar display management data 626, and causes the avatar related to that viewing user to be displayed in the message content display unit 34 (step S108).

[0148] Since the distribution of the avatar display management data 626 has started in step S102 as described above, the newly created avatar display management data 626 is also distributed to the viewing terminal. The viewing terminal updates the display of each avatar based on this data. As a result, on the viewing screen W, it appears as if a new virtual viewer has appeared in front of the screen.

[0149] In addition, since the number of viewers has increased due to the viewer registration, the transmission service management unit 230 creates new transmission content display management data 630 and reassigns the transmission areas to all viewing users including the viewing user, updating the transmission area data 632 (step S110). The newly created transmission content display management data 630 and the transmission content display management data 630 with the updated transmission area data 632 are also distributed to the viewing terminal.

[0150] Next, the transmission service management unit 230 monitors the reception of a transmission request (step S112). When a viewing user inputs text or selects an image on the viewing terminal to perform a transmission operation, the text transmission request is transmitted to the streaming server 1100 together with information such as the user account and the transmission content.

[0151] When this call request is received (YES in step S112), the call service management unit 230 creates call record data 627 for the received new call content, and creates and updates call log data 606 for the requesting viewing user (step S114). The index value determination unit 231 also executes index value determination processing (step S116). Then, the display form setting unit 233 executes temporary display size setting processing (step S118) and display size correction processing (step S120). Through this processing, the caller display size 635 and the other viewer display size 636 are set for the received new call content, and each value of the call content display management data 630 related to the caller is updated. Also, the appropriately adjusted adjacent call area data 632 is updated.

[0152] The outgoing service management unit 230 erases each transmission content that has exceeded the display time 638. That is, in the transmission content display management data 630, the outgoing display flag 633 relating to the transmission content that has exceeded the display time 638 from the display start date and time 637 is turned OFF, and the transmission content data 634, the display size for the sender 635, the display size for other viewers 636, the display start date and time 637, and the display time 638 are cleared. Also, if there is a transmission area that has been expanded or reduced due to the display of the transmission content, the transmission area data 632 is returned to the initial range assigned in step S110.

[0153] The delivery of this message content display management data 630 has also started in step S102, and the updated message content display management data 630 is also delivered to the viewing terminal. Based on this, the new message content is displayed in the avatar's speech bubble on the viewing terminal, making it look as if the avatar has spoken.

[0154] In addition, the online shopping management unit 204 monitors the reception of a purchase request (step S122). The purchase request is transmitted to the streaming server 1100 when the viewing user performs a predetermined purchase operation (for example, an operation on the shopping icon 35 in FIG. 3) on the viewing terminal.

[0155] When this purchase request is received (YES in step S122), the online shopping management unit 204 executes processes related to online shopping, such as purchasing a transmission image or a support item (step S126). With this purchase, the owned transmission image list 605 in the user management data 600 of the viewing user who made the purchase request is updated, and this is also delivered to the viewing terminal.

[0156] In this way, even before the live broadcast, viewing users can send text and images to be transmitted, or purchase images to be transmitted, etc., allowing viewing users to freely discuss their expectations for the live performance before it begins, and to prepare images to be transmitted, etc., in preparation for the start of the live performance.

[0157] 15, when the scheduled start time of the live distribution arrives (YES in step S126), the distribution service management unit 210 starts the live distribution of the multimedia content (step S128). This process starts the reception of the multimedia content data from the providing terminal and the streaming distribution to the viewing terminal.

[0158] Once the distribution of multimedia content has started, the outgoing service management unit 230 monitors the reception of an outgoing request (step S130). Then, when an outgoing request is received (YES in step S130), the outgoing call record data 627 is created for the received new outgoing content, and the outgoing call log data 606 of the requesting viewing user is created and updated (step S132). The index value determination unit 231 also executes an index value determination process (step S134). Then, the display form setting unit 233 executes a temporary display size setting process (step S136), executes a display size correction process (step S138), and sets the display size for the sender and the display size for other viewers for the received new outgoing content.

[0159] Moreover, the online shopping management unit 204 monitors whether a purchase request has been received (step S140). If a purchase request has been received (YES in step S140), the online shopping management unit 204 executes a process related to online shopping (step S142).

[0160] Thereafter, the process returns to step S130 and repeats the above-described processing until the distribution is completed (NO in step S144). Then, when the distribution is completed (YES in step S144), the series of processing is terminated.

[0161] 2. Viewing device 16 is a flowchart showing the flow of processing related to viewing of multimedia content in the user terminal 1500 (1500a, 1500b, ...) serving as a viewing terminal. The processing described here is realized by the terminal processing unit 200 reading and executing the viewing terminal program 504.

[0162] As shown in FIG. 16, the viewing terminal first executes a login process (step S300). After that, when a predetermined viewing operation (including selection of the multimedia content to be viewed) for viewing the distribution of multimedia content is detected (YES in step S310), the operation signal transmission control unit 262 transmits a viewing request to the streaming server 1100 (step S312: communication A). In response to the viewing request, the streaming server 1100 registers the user of the viewing terminal as a viewing user, and starts distribution of the avatar display management data 626, the transmission content display management data 630, the held transmission image list 605, and the like to the viewing terminal (distribution α). Then, in the viewing terminal, the viewing screen display control unit 264 receives these and stores them in the received distribution data group 700, and starts displaying the viewing screen W (step S314).

[0163] Furthermore, when a purchase operation of a sales item such as the message image 8 is detected (YES in step S320), the operation signal transmission control unit 262 transmits a purchase request to the streaming server 1100 (step S322: communication B). When the message image 8 is purchased, the streaming server 1100 distributes the owned message image list 605 to which the message image 8 has been added, and the owned message image list 706 is updated.

[0164] Furthermore, when the operation signal transmission control unit 262 detects a text input operation in the call operation unit 33 (YES in step S330), it executes a text input / edit process (step S332) and proceeds to step S336. Also, when the operation signal transmission control unit 262 detects a selection operation of an image for call in the call operation unit 33 (YES in step S334), it proceeds to step S336. Then, when the call operation is detected in step S336 (YES in step S336), it transmits a call request together with the input text or the selected type of image for call to the streaming server 1100 (step S338: communication C). In response to the call request here, the streaming server 1100 sets the display form of the call content (in this embodiment, the display size for the caller and the display size for other viewers) to update the call content display management data 630 and distributes it.

[0165] Here, the viewing terminal starts display control of the viewing screen W based on various distribution data in step S314 as described above. Therefore, in step S338, the call contents that the viewing user operated to make a call on the viewing terminal or another viewing terminal are displayed on the call contents display unit 34 in a display size set according to the user's performance. More specifically, the viewing screen display control unit 264 controls the display of call contents in the call area of ​​the viewing user whose call display flag 633 is ON, in accordance with the call contents display management data 630, by applying the caller display size to the call contents related to the viewing user of the viewing terminal and the other viewer display size to the call contents related to other viewing terminals.

[0166] Thereafter, the process returns to step S320 and repeats the above-described processing until the distribution is completed (NO in step S340). Then, when the distribution is completed (YES in step S340), the series of processing is terminated.

[0167] 3. Device provided 17 is a flowchart showing the flow of processing related to the provision of multimedia content in the user terminal 1500 (1500T) which serves as a providing terminal. The processing described here is realized by the terminal processing unit 200 reading and executing the providing terminal program 506. Note that if the multimedia content is to be live broadcast content of game play video, it is assumed that a separate game program is being executed.

[0168] 17, the audiovisual terminal first executes a login process (step S500), after which the providing screen display control unit 276 starts display control of the providing screen (step S502).

[0169] Next, the content provision control unit 274 sets the distribution title, distribution schedule, and additional information of the multimedia content to be provided, and performs the registration procedure process (step S504). Then, when the scheduled distribution time arrives, the provision of the multimedia content is started (step S506: communication D). In this embodiment, since live distribution is assumed, for example, in the case of live distribution by live action, the content provision control unit 274 sequentially creates multimedia content data by adding audio collected by the audio collection unit 104 to the video captured by the imaging unit 102, and performs live streaming encoding of the multimedia content data and transmits it to the streaming server 1100. In the case of live distribution of a game play video, the multimedia content data is sequentially created by adding game audio to a video captured from a game screen. In the case of video data or the like in which the multimedia content is prepared in advance, it is uploaded to the streaming server 1100 without waiting for the scheduled distribution time.

[0170] When the distribution of the multimedia content is completed (YES in step S508), the series of processes ends.

[0171] As described above, according to this embodiment, in a streaming distribution service for multimedia content, a more enjoyable and fulfilling user experience than conventional services can be provided by utilizing the text and image transmission function, thereby improving the streaming distribution service.

[0172] [Variations] The forms to which the present invention can be applied are not limited to the above-described embodiments, and constituent elements can be added, omitted, or modified as appropriate.

[0173] For example, in the above embodiment, an example was given of implementing a streaming delivery service in a client-server type computer system, but it may be implemented in a computer system in which multiple user terminals 1500 are connected peer-to-peer. In that case, one of the user terminals 1500 is made to function as the streaming server 1100. Alternatively, the functions of the delivery service management unit 210 may be shared among multiple user terminals 1500.

[0174] The above embodiment can also be applied to other services as long as a plurality of users can access the service simultaneously and each user can send and receive text or images.

[0175] For example, the screen portion below the content display portion 32 on the viewing screen W in Fig. 3 may be a screen to which the chat function of a social networking service is applied. Fig. 18 is a diagram showing a display example in that case.

[0176] On the left side of the lower chat screen 36, an avatar 4a of the viewing user 2a who uses the user terminal 1500 on which the screen is displayed is displayed, and the contents of transmission (text and images) that the viewing user 2a has operated to transmit are displayed in a speech bubble 5a. On the other hand, on the right side of the chat screen 36, avatars 4c and the like of other viewing users 2c and the like are displayed, and speech bubbles 5c and the like of the contents of transmission that they have operated to transmit are displayed. In this modified example, when displaying the contents of transmission by each viewing user 2, the display size is changed and controlled according to the user record of the sender in the same manner as in the above embodiment.

[0177] In the above embodiment, the display size for the sender and the display size for other viewers are set, so that the degree of change in display size is different between the sender's user terminal 1500 and the other viewers' user terminals 1500. However, only the display size for the sender may be set. This makes it possible to control the change in display size for each user terminal 1500 only for the transmission content of the viewing user, depending on the user record of the viewing user using the user terminal 1500.

[0178] In the above embodiment, the form determination index value is obtained from the user record of the sender and used to set the display size. Alternatively, the user record of each viewing user may be statistically processed to obtain an index value related to the sender and set the display size. For example, form determination index values ​​of all viewing users are obtained every time a calling operation is accepted from the user terminal 1500, and a deviation value related to the sender is calculated as an index value from the form determination index value of each viewing user. The calculated deviation value may then be used to set the display size.

[0179] In the above embodiment, the form determination index value is obtained for the sender, and the display size is provisionally set according to the form determination index value according to a predetermined correspondence relational expression, but the display size may be determined by ranking the form determination index values. For example, every time a call operation is accepted from the user terminal 1500, the form determination index values ​​of all viewing users are obtained, and the sender ranking is identified by arranging them in descending order. Then, the display size may be made larger for higher identified rankings, and smaller for lower identified rankings.

[0180] In the above embodiment, the display size of the transmitted content is changed using the user record of the sender, but when a gameplay video is live-streamed as multimedia content, the display form of the transmitted content may be further changed according to the game status related to the gameplay video. For example, the line type, color, shape, background color, etc. of the frame of the speech bubble 5 (5a, 5b, ...) may be changed and controlled according to the game stage, enemy character name, game progress, player level, etc. of the gameplay video.

[0181] The display form of the transmission content to be changed is not limited to the exemplified display size, but may be other display forms such as the display color or display time, or two or all three of the display size, display color, and display time may be changed. Alternatively, the display form of the target to be changed may be changed by controlling the display size of the transmission content for the sender's user terminal 1500 and changing the display color of the transmission content for the user terminals of other viewers. [Explanation of symbols]

[0182] 1000…Content provision system 1100...Streaming server 100s…Operation input section 200s…Server processing section 202...User Management Department 204…Online Shopping Management Department 210…Distribution Service Management Department 220...Avatar display control unit 230…Outgoing Service Management Department 231...Index value determination unit 233…Display format setting section 235...Call content display control unit 280s…Timekeeping section 291s...Image generation section 293s…sound generation section 295s…Communication control section 391s...Image display section 393s…Sound output section 395s…Communications Department 500s…Server storage 503: Server program 505...Streaming viewing terminal program 507... Distribution provision terminal program 509...Sales management data 510...Image data for transmission 600...User management data 620…Distribution management data 800...Current date and time 1500 (1500a, 1500b, ..., 1500T) ... User terminal 100...Operation input section 102...imaging unit 104…Sound collection section 200...Terminal processing section 262, 272...Operation signal transmission control unit 264…Viewing screen display control section 274…Content provision control unit 276... Provision screen display control unit 390...Image display section 392…Sound output section 394…Communications Department 500…Device memory section 504... Viewing terminal program 506... Terminal program provided 700: Received distribution data set 702...Avatar display management data 704…Message display management data 706…Image list for transmission 710…Provided content data 711…Titles distributed at the time of registration 713…Registration distribution schedule 715…Additional information at the time of registration 717…Providing multimedia content data 9. Communication lines 2(2a,2b,...,2t)...User W…Viewing screen 31...Additional information display section 32…Content display section 33…Call operation section 34…Message content display section 35…Shopping icon 36…Chat screen 4(4a,4b,…)…Avatar 8…Image for transmission

Claims

1. A content distribution system that distributes content including at least video provided by a providing user to a user terminal of each viewing user, comprising: In the user terminal, a viewing screen is displayed, the viewing screen including a content display unit that displays the content, an operation unit that allows the viewing user to perform a call operation for the content being viewed, and a call content display unit that displays the call content of each viewing user, a message content display control means for receiving a message from the user terminal regarding the content being viewed and controlling the message content to be displayed on the message content display unit, the message content display control means controlling the display form of the message content to be changed in accordance with the status of the content being viewed; A content delivery system comprising:

2. the transmission content display control means changes the degree to which the display format of the transmission content is changed based on whether the transmission is a user terminal of a viewing user related to the transmission. The content distribution system according to claim 1 .

3. the transmission content display control means sets the user terminal for changing the display form of the transmission content to the user terminal of the viewing user related to the transmission; The content distribution system according to claim 1 .

4. An index value determination means for determining an index value for determining a display form of the transmission content using at least the viewing record and / or transmission record of each viewing user (hereinafter collectively referred to as "user record"); The content distribution system according to any one of claims 1 to 3, further comprising:

5. The transmission content display control means performs control to change the display form of the transmission content based on the ranking of the index value of the viewing user related to the transmission. The content distribution system according to claim 4.

6. the index value determination means determines an index value of each viewing user by performing statistical processing on the user performance of each viewing user based on the number of viewing users; 6. A content distribution system according to claim 4 or 5.

7. The operation unit is capable of selectively inputting characters and / or images as transmission elements, the transmission content display control means performs control to change at least one of a display size, a display color, and a display time of the transmitted characters and / or images based on the index value; A content distribution system according to any one of claims 4 to 6.

8. the transmission content display control means variably sets a display area in the transmission content display unit for displaying the transmission content of each viewing user in accordance with the number of the viewing users, and controls the display area to adjust the display area when the display size exceeds the display area as a result of the control of the change in the display size. The content distribution system according to claim 7.

9. the transmission content display control means performs control to hide the transmission content after a given display time has elapsed, and adjusts the display area of ​​the new transmission content based on a display state of the transmission content when the new transmission content is to be displayed. The content distribution system according to claim 8.

10. the index value determination means uses at least one of the billing amount, billing frequency, number of virtual currency equivalent points consumed, and user level of the viewing user as the user performance; The content distribution system according to claim 6.

11. The content is a live broadcast content. A content distribution system according to any one of claims 1 to 10.

12. The content is a live broadcast content of a gameplay video, the message content display control means performs control to change a display form of the message content in accordance with a game situation related to the game play video being viewed; A content distribution system according to any one of claims 1 to 3.

13. an avatar display control means for displaying an avatar for each of the viewing users on the viewing screen; Equipped with The transmission content display control means controls the display of the transmission content so that the transmission content is associated with the avatar of the viewing user who transmitted the transmission content. A content distribution system according to any one of claims 1 to 12.

14. A computer system comprising a user terminal of each viewing user and the content distribution system according to any one of claims 1 to 13.

Citation Information

Patent Citations

  • Network server, method for providing communication service and storage medium

    JP2002041430A

  • Network game system, game apparatus and program

    JP2003164669A

  • Game system, control method therefor, and program

    JP2011072735A

  • Device and system for displaying information

    JP2011113251A

  • Message switching system, control method, and program

    JP2013178723A