Content distribution system, content distribution method, and content distribution program

Abstract

To make content more appealing to viewers.SOLUTION: A content distribution system according to one embodiment is provided with at least one processor. The at least one processor displays content on multiple user terminals, acquires gaze data that indicates gaze positions of users viewing the content from two or more of the multiple user terminals, analyzes the acquired two or more pieces of gaze data, calculates a distribution of gaze positions of the two or more users in the content, and determines, on the basis of the calculated distribution, a manner in which an effect is imparted to the content displayed on at least one terminal of interest of the multiple user terminals.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] One aspect of the present disclosure relates to a content distribution system, a content distribution method, and a content distribution program. [Background technology]

[0002] There is known a technology for distributing content using information about the viewer's line of sight. For example, a video distribution system described in Patent Document 1 transmits a video based on material data for generating the video, acquires event information about the viewer's line of sight during playback of the video, and performs operations on the material data according to the event information. Patent Documents 2 and 3 also describe a technology for distributing content using information about the viewer's line of sight. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-120304 A [Patent Document 2] JP 2016-126773 A [Patent Document 3] JP 2020-202575 A Summary of the Invention [Problem to be solved by the invention]

[0004] There is a need for a mechanism that can increase the appeal of content to viewers. [Means for solving the problem]

[0005] A content delivery system according to an aspect of the present disclosure includes at least one processor, which displays content on a plurality of user terminals, acquires gaze data indicating gaze positions of users viewing the content from two or more of the plurality of user terminals, analyzes the acquired two or more gaze data, calculates a distribution of the gaze positions of the two or more users in the content, and determines a mode of applying an effect to the content displayed on at least one target terminal of the plurality of user terminals based on the calculated distribution.

[0006] In such an aspect, two or more pieces of gaze data are analyzed to obtain a distribution of gaze positions of two or more users in the content, and the manner in which the effect is applied to the content is determined based on this distribution. With this mechanism, the manner in which the effect is applied is determined based on the reactions of multiple viewers to the content, thereby increasing the appeal of the content to the viewers. Effect of the Invention

[0007] According to one aspect of the present disclosure, it is possible to increase the appeal of content to viewers. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of an application of a content delivery system according to an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of a hardware configuration related to the content delivery system according to the embodiment. [Diagram 3] FIG. 2 is a diagram illustrating an example of a functional configuration related to the content delivery system according to the embodiment. [Figure 4] FIG. 11 is a sequence diagram showing an example of a content distribution process. [Diagram 5] FIG. 13 is a diagram showing an example of content before an effect is applied. [Figure 6] FIG. 13 is a diagram showing an example of content to which an effect has been applied. [Figure 7] FIG. 13 is a diagram showing another example of content to which an effect is applied. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In the description of the drawings, the same or equivalent elements are designated by the same reference numerals, and duplicated explanations will be omitted.

[0010] [System Overview] The content delivery system according to the embodiment is a computer system that delivers content to a user. Content refers to information provided by a computer or a computer system and recognizable by a person. Electronic data indicating content is called content data. The expression format of content is not limited, and content may be expressed by an image (e.g., a photograph, a video, etc.). Content can be used for various types of information transmission or communication, and can be used in various situations or purposes, such as news, education, medical care, games, chat, business transactions, lectures, seminars, training, concerts, and questionnaires. Content delivery refers to a process executed to provide content to a user, and refers to, for example, a process of transmitting information to a user via a communication network.

[0011] A content distribution system provides content to a user by transmitting content data to a user terminal. In one example, the content is provided by a distributor. A distributor is a person who intends to provide information to a viewer through the content distribution system, and is the sender of the content. A viewer is a person who intends to obtain information through the content distribution system, and is the user of the content. The content distribution system transmits the content data provided from the distributor terminal to the viewer terminal. The viewer terminal processes the content data and displays the content on a screen. In the present disclosure, the distributor and the viewer are sometimes collectively referred to as users, and the distributor terminal and the viewer terminal are sometimes collectively referred to as user terminals.

[0012] The content distribution method is not limited. For example, the content distribution system may perform real-time distribution. In this case, for example, the distributor terminal processes the captured video to generate content data, and transmits the content data to the content distribution system in real time. The content distribution system transmits the received content data to the viewer terminal in real time. This is one aspect of live Internet broadcasting. The content data may be generated in the content distribution system. That is, the content distribution system may generate content data by processing real-time video provided from the distributor terminal, and transmit the content data to the viewer terminal in real time. The content distribution system may be used for time shifting, which allows content to be viewed for a given period of time after real-time distribution.

[0013] The content distribution system may perform on-demand distribution that allows a viewer to view content at any time. In this case, for example, the content distribution system may store content data generated by processing previously captured video in a storage device such as a database. The content distribution system may transmit the stored content data to a viewer terminal in response to a viewer request.

[0014] The content delivery system acquires gaze data indicating the gaze position of a user viewing content from two or more user terminals. The gaze position of a user is the position at which the user is looking on the screen of the user terminal. The gaze data is acquired by an eye tracking system. The eye tracking system may be installed in the user terminal, or may be installed in another computer different from the user terminal. Alternatively, the tracking system may be realized by cooperation between the user terminal and another computer.

[0015] The content delivery system calculates the distribution of gaze positions of two or more users in the content. The distribution of gaze positions is information indicating where the gazes of individual users are located in the content, and indicates, for example, the concentration of the gazes of the users. This distribution can indicate the degree to which each area in the content is attracting attention from viewers. The delivery system analyzes two or more gaze data to calculate the distribution of gaze positions of two or more users. The number of gaze data used to calculate the distribution of gaze positions may be two or more, and may be 100 or more or 1000 or more gaze data. Based on the distribution of gaze positions, the content delivery system may specify a first area in the content where the gazes of users are concentrated, and a second area where the gazes of users are less concentrated than the first area. The first area can be said to be an area that includes a relatively large number of user gazes (gaze positions), or an area that is viewed by many users. The second area can be said to be an area that includes fewer user gazes (gaze positions) than the first area, or an area that is not viewed by users very often.

[0016] The content distribution system determines the manner of applying an effect to the content based on the distribution of the gaze positions. The effect is an audiovisual effect that occurs in the user terminal. For example, the effect includes an audiovisual effect for guiding the user's gaze to a specific area of ​​the content displayed on the user terminal, or an audiovisual effect according to the concentration of the user's gaze. The manner of applying an effect is information required for generating an effect in the user terminal, and includes, for example, the configuration of the effect, the display position of the effect in the content, the volume of the effect, or the output timing of the effect. The configuration of the effect includes the visual configuration (display configuration) and the auditory configuration (sound configuration) of the effect. Electronic data indicating the manner of applying an effect is called effect data. The user terminal to which the effect is applied is called the target terminal. That is, the content distribution system determines the manner of applying an effect to the content displayed on the target terminal.

[0017] [System configuration] FIG. 1 is a diagram showing an example of application of a content delivery system 1 according to an embodiment. In this embodiment, the content delivery system 1 includes a server 10. The server 10 is a computer that delivers content data. The server 10 is connected to a plurality of viewer terminals 20 and distributor terminals 30 via a communication network N. The number of viewer terminals 20 is not limited as long as it is two or more. The number of distributor terminals 30 is not limited as long as it is one or more. The server 10 is also connected to a user database 40 via the communication network N. The configuration of the communication network N is not limited. For example, the communication network N may be configured to include the Internet, or may be configured to include an intranet.

[0018] The viewer terminal 20 is a computer used by a viewer. In one example, the viewer terminal 20 has a function of accessing the content distribution system 1 to receive and display content data. The type and configuration of the viewer terminal 20 are not limited. For example, the viewer terminal 20 may be a portable terminal such as a high-function mobile phone (smartphone), a tablet terminal, a wearable terminal (e.g., a head-mounted display (HMD), smart glasses, etc.), a laptop personal computer, or a mobile phone. Alternatively, the viewer terminal 20 may be a stationary terminal such as a desktop personal computer.

[0019] The distributor terminal 30 is a computer used by a distributor. In one example, the distributor terminal 30 has a function of shooting an image and a function of accessing the content distribution system 1 and transmitting electronic data (image data) showing the image. The type and configuration of the distributor terminal 30 are not limited. For example, the distributor terminal 30 may be a shooting system having functions of shooting, recording, and transmitting an image. Alternatively, the distributor terminal 30 may be a portable terminal such as a high-function mobile phone (smartphone), a tablet terminal, a wearable terminal (e.g., a head-mounted display (HMD), smart glasses, etc.), a laptop personal computer, or a mobile phone. Alternatively, the distributor terminal 30 may be a stationary terminal such as a desktop personal computer.

[0020] A viewer operates the viewer terminal 20 to log in to the content distribution system 1, thereby enabling the viewer to view the content. A distributor operates the distributor terminal 30 to log in to the content distribution system 1, thereby enabling the viewer to provide the content. In this embodiment, it is assumed that the viewer and distributor of the content distribution system 1 are already logged in. It is not essential for a viewer to log in to the content distribution system 1. In other words, the content distribution system 1 can transmit content data to the viewer terminal 20 of a general viewer who is not logged in. In this case, general viewers who are not logged in can also view the content.

[0021] The user database 40 is a non-transient storage device that stores data used by the content distribution system 1. The user database 40 stores attribute information of users (e.g., viewers) who use the content distribution system 1. The attribute information is various information related to the user, and may include, for example, a user identifier (user ID), age, sex, an identifier (content ID) of a content viewed by the user, and the number of times the content has been viewed. The attribute information may include information arbitrarily selected or set by the user. For example, the attribute information may include information on a favorite person or character selected by the user, an image color associated with the person or character, and the like. The attribute information may be stored in an area other than the user database 40. For example, the attribute information may be stored in a cookie area of ​​a browser in the viewer terminal 20. The attribute information may include information indicating whether or not the user is logged in to the content distribution system 1.

[0022] The user database 40 may be constructed as a single database or may be a collection of multiple databases. The location of the user database 40 is not limited. For example, the user database 40 may be provided in a computer system separate from the content distribution system 1.

[0023] Fig. 2 is a diagram showing an example of a hardware configuration related to the content distribution system 1. Fig. 2 shows a server computer 100 functioning as the server 10, and a terminal computer 200 functioning as the viewer terminal 20 or the distributor terminal 30.

[0024] As an example, the server computer 100 includes a processor 101, a main memory unit 102, an auxiliary memory unit 103, and a communication unit 104 as hardware components. The processor 101 is a computing device that executes an operating system and application programs, and is, for example, a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit). The main memory unit 102 is a device that stores programs to be executed, calculation results, and the like, and is, for example, composed of a ROM (Read Only Memory) or a RAM (Random Access Memory). The auxiliary memory unit 103 is a device that can generally store a larger amount of data than the main memory unit 102, and is, for example, composed of a non-volatile storage medium such as a hard disk or a flash memory. The auxiliary memory unit 103 stores a server program P1 and various data for making the server computer 100 function as the server 10. The communication unit 104 is a device that executes data communication with other computers via a communication network N, and is, for example, composed of a network card or a wireless communication module.

[0025] In this embodiment, the content delivery program is implemented as a server program P1. Each functional element of the server 10 is realized by loading the server program P1 onto the processor 101 or the main memory unit 102 and having the processor 101 execute the program. The server program P1 includes code for realizing each functional element of the server 10. The processor 101 operates the communication unit 104 in accordance with the server program P1, and executes reading and writing of data in the main memory unit 102 or the auxiliary memory unit 103.

[0026] The server 10 may be composed of one or more computers. When multiple computers are used, these computers are connected to each other via a communication network N to logically configure one server 10.

[0027] As an example, the terminal computer 200 includes a processor 201, a main memory unit 202, an auxiliary memory unit 203, a communication unit 204, an input interface 205, an output interface 206, and an imaging unit 207 as hardware components. The processor 201 is a computing device that executes an operating system and an application program, and is, for example, a CPU or a GPU. The main memory unit 202 is a device that stores a program to be executed, a computation result, and the like, and is, for example, composed of a ROM or a RAM. The auxiliary memory unit 203 is a device that can generally store a larger amount of data than the main memory unit 202, and is, for example, composed of a non-volatile storage medium such as a hard disk or a flash memory. The auxiliary memory unit 203 stores a client program P2 and various data for causing the terminal computer 200 to function as the viewer terminal 20 or the distributor terminal 30. The communication unit 204 is a device that executes data communication with other computers via the communication network N, and is, for example, composed of a network card or a wireless communication module. The input interface 205 is a device that accepts data based on a user's operation or action, and is composed of at least one of a keyboard, an operation button, a pointing device, a touch panel, a microphone, a sensor, and a camera, for example. The output interface 206 is a device that outputs data processed by the terminal computer 200, and is composed of a display device such as a monitor, a touch panel, and an HMD, for example. The imaging unit 207 is a device that captures an image (video or photo) of the real world, and is, for example, a camera. The imaging unit 207 can also function as the input interface 205.

[0028] Each functional element of the viewer terminal 20 or the distributor terminal 30 is realized by loading a corresponding client program P2 into the processor 201 or the main memory unit 202 and having the processor 201 execute the program. The client program P2 includes code for realizing each functional element of the viewer terminal 20 or the distributor terminal 30. The processor 201 operates the communication unit 204, the input interface 205, the output interface 206, or the imaging unit 207 in accordance with the client program P2, and reads and writes data in the main memory unit 202 or the auxiliary memory unit 203.

[0029] At least one of the server program P1 and the client program P2 may be provided in a state of being non-temporarily recorded on a tangible recording medium such as a CD-ROM, a DVD-ROM, a semiconductor memory, etc. Alternatively, at least one of these programs may be provided as a data signal superimposed on a carrier wave via the communication network N. These programs may be provided separately or together.

[0030] FIG. 3 is a diagram showing an example of a functional configuration related to the content distribution system 1. The server 10 includes a content transfer unit 11, an acquisition unit 12, a calculation unit 13, a specification unit 14, a decision unit 15, and an effect transmission unit 16 as functional elements. The content transfer unit 11 is a functional element that receives content data transmitted from the distributor terminal 30 and transmits the content data to the viewer terminal 20. The acquisition unit 12 is a functional element that acquires gaze data from the viewer terminal 20. The calculation unit 13 is a functional element that analyzes the gaze data acquired by the acquisition unit 12 and calculates the distribution of gaze positions. The specification unit 14 is a functional element that specifies a first area in the content where the gaze of the user is concentrated and a second area where the gaze of the user is less concentrated than the first area, based on the distribution of the gaze positions calculated by the calculation unit 13. The decision unit 15 is a functional element that determines the mode of applying an effect based on the distribution of the gaze positions. The effect transmission unit 16 is a functional element that transmits effect data to the viewer terminal 20.

[0031] The viewer terminal 20 includes, as functional elements, a content receiving unit 21, a gaze identifying unit 22, a gaze data transmitting unit 23, an effect receiving unit 24, and a display control unit 25. The content receiving unit 21 is a functional element that receives content data from the server 10. The gaze identifying unit 22 is a functional element that identifies the gaze position based on the movement of the viewer's eyes. In this embodiment, the gaze identifying unit 22 constitutes an eye tracking system. The gaze data transmitting unit 23 is a functional element that transmits gaze data indicating the gaze position to the server 10. The effect receiving unit 24 is a functional element that receives effect data from the server 10. The display control unit 25 is a functional element that controls the display on the screen of the viewer terminal 20.

[0032] The distributor terminal 30 includes, as a functional element, a content transmission unit 31. The content transmission unit 31 is a functional element that transmits content data to the server 10.

[0033] [System Operation] The operation of the content distribution system 1 and the content distribution method according to the present embodiment will be described with reference to Fig. 4. Fig. 4 is a sequence diagram showing an example of content distribution processing as a processing flow S1.

[0034] In step S101, the content transmission unit 31 transmits content data to the server 10. For example, when a distributor operates the distributor terminal 30 to distribute content to a viewer, the content transmission unit 31 transmits the content data to the server 10 in response to the operation. The content transfer unit 11 receives the content data transmitted from the content transmission unit 31.

[0035] In step S102, the content transfer unit 11 transmits content data to multiple viewer terminals 20. The content transfer unit 11 transmits the content data in response to a content request from the viewer terminal 20. The content request is a data signal for requesting the server 10 to play the content. For example, when a viewer operates the viewer terminal 20 to start playing the desired content, the viewer terminal 20 generates a content request in response to the operation and transmits it to the server 10. The content transfer unit 11 transmits the content data in response to the content request. The content receiving unit 21 receives the content data transmitted from the content transfer unit 11.

[0036] In step S103, the viewer terminal 20 displays the content. When the content receiving unit 21 receives the content data, the display control unit 25 processes the content data and displays the content on the screen. The viewer terminal 20 may output audio from a speaker in accordance with the display of the content.

[0037] In step S104, the line of sight identifying unit 22 identifies the gaze position of the viewer. The line of sight identifying unit 22 identifies the gaze position on the screen of the viewer terminal 20 based on the movement of the viewer's eyes. The method of identifying the gaze position by the line of sight identifying unit 22 is not limited. As an example, the line of sight identifying unit 22 may capture an image of the periphery of the viewer's eyes by the imaging unit 207 of the viewer terminal 20, and identify the gaze position based on the position of the iris with the inner corner of the user's eye as the reference point. As another example, the line of sight identifying unit 22 may identify the gaze position of the viewer using the corneal reflex method (PCCR). When the corneal reflex method is adopted, the viewer terminal 20 may include an infrared emitting device and an infrared camera as hardware configurations. The gaze position may be expressed, for example, using a two-dimensional coordinate system that can uniquely identify a position on the screen of the viewer terminal 20.

[0038] In step S105, the gaze data transmission unit 23 transmits gaze data indicating the gaze position to the server 10. The gaze data indicating the gaze position is not limited to data indicating the coordinate position of the gaze on the screen. For example, the viewer terminal 20 may acquire data indicating that the viewer is viewing a specific area in the content (e.g., a specific object included in the content) as gaze data, and the gaze data transmission unit 23 may transmit the acquired gaze data to the server 10. The acquisition unit 12 receives (acquires) the gaze data transmitted by the gaze data transmission unit 23. The acquisition unit 12 acquires gaze data from two or more viewer terminals 20 out of the multiple viewer terminals 20. That is, the acquisition unit 12 acquires two or more gaze data.

[0039] In step S106, the calculation unit 13 calculates the distribution of gaze positions of two or more viewers in the content. The calculation unit 13 analyzes two or more pieces of gaze data acquired by the acquisition unit 12 to calculate the distribution of gaze positions. A method for calculating the distribution of gaze positions by the calculation unit 13 is not limited. For example, the calculation unit 13 may divide the content into a plurality of small regions and calculate the number of gazes located in each small region as the distribution of gaze positions based on the acquired gaze data.

[0040] In step S107, the identification unit 14 identifies a first region in the content where the viewer's gaze is focused and a second region where the viewer's gaze is less focused than the first region. The identification unit 14 identifies the first region and the second region based on the distribution of gaze positions calculated by the calculation unit 13.

[0041] The method of identifying the first region and the second region by the identification unit 14 is not limited. For example, the identification unit 14 divides the content into a plurality of small regions. When the number of lines of sight located in a small region is equal to or greater than a predetermined first threshold, the identification unit 14 may identify the small region as a first region. When the number of lines of sight located in a small region is equal to or less than a predetermined second threshold that is smaller than the first threshold, the identification unit 14 may identify the small region as a second region. When a plurality of consecutive small regions are all first regions, the identification unit 14 may identify these multiple small regions as one first region. Similarly, when a plurality of consecutive small regions are all second regions, the identification unit 14 may identify these multiple small regions as one second region. The shapes and sizes of the first region and the second region are not limited. The first region and the second region may be polygonal, circular, or irregularly shaped without symmetry.

[0042] In step S108, the determination unit 15 determines the manner in which an effect is applied to the content based on the distribution of the gaze positions. The determination unit 15 determines, as the manner in which the effect is applied, for example, the configuration of the effect, the display position of the effect in the content, the volume of the effect, or the output timing of the effect.

[0043] When the effect is a visual effect, the configuration of the effect may be, for example, changing the display mode of a part of the content. As an example, the change in the display mode may be adding a pattern (e.g., a star, a heart, or a face mark, etc.) or a character string to a part of the content, or surrounding a part of the content with a frame. The change in the display mode may be displaying a part of the content brighter or darker than other parts. The change in the display mode may be displaying a part of the content by enlarging or reducing it. The change in the display mode may be displaying a part of the content by performing a predetermined movement (e.g., vibrating or rotating, etc.).

[0044] The effect may be configured to change the display mode of a comment included in the content. The comment may be a comment posted by a plurality of viewers via the viewer terminal 20. In this case, the content distribution system 1 includes a comment posted from a certain viewer terminal 20 in the content and displays it on the other viewer terminals 20. Therefore, a viewer can view not only the comment posted by the viewer, but also the comments provided by other viewers. The change in the display mode of the comment may be to add a pattern to the target comment, to change the color of the target comment to a specific color, or to change the font of the target comment to a specific font. The change in the display mode of the comment may be to display the target comment larger than other comments. Changing the display mode of the comment is included in changing the display mode of a part of the content described above.

[0045] When the effect is an auditory effect, the effect may be configured to generate a sound related to the content. For example, the effect may be configured to generate a voice of a person or character included in the content, a sound related to an object included in the content (e.g., an engine sound if the content includes a car), or a sound reading out a comment included in the content.

[0046] As described above, the determination unit 15 determines the mode of applying the effect based on the distribution of the gaze positions. The determination unit 15 may determine the mode of applying the effect by using information indicating the first region and the second region specified based on the distribution of the gaze positions. As an example, the determination unit 15 may determine that the display mode of the first region is changed as the mode of applying the effect. In this case, the configuration of the effect may be to add a pattern or a character string to the first region, or to display a comment located in the first region larger than other comments. The configuration of the effect may be to display information indicating the number or ratio of viewers viewing the first region. The information indicating the number or ratio of viewers is not limited to a specific numerical value. For example, an icon or the like included in the first region may be displayed so as to perform a predetermined movement (for example, vibration or rotation) indicating that the number or ratio of viewers viewing the first region is large. The number or ratio of viewers viewing the first region is calculated based on the distribution of the gaze positions.

[0047] As another example, the determination unit 15 may determine that the mode of applying the effect is to generate a sound related to the first area. In this case, the effect may be configured to generate a voice of a person or character located in the first area, generate a sound related to an object located in the first area, or generate a sound reading out a comment located in the first area.

[0048] By applying the above-mentioned effects related to the first region, the viewer's gaze is further focused on the first region where the viewer's gaze is already focused. In other words, the above-mentioned effects can be said to be audiovisual effects for guiding the viewer's gaze to the first region in the content. The above-mentioned effects are effects related to the first region where the viewer's gaze is focused, and can also be said to be audiovisual effects according to the degree of concentration of the viewer's gaze.

[0049] The determination unit 15 may determine that the display mode of the second region is changed as the mode of applying the effect. The configuration of the effect in this case is the same as that in the case of changing the display mode of the first region. That is, for example, the configuration of the effect may be to add a pattern or a character string to the second region, or to display a comment located in the second region larger than other comments, etc. The configuration of the effect may be to display information indicating the number or ratio of viewers viewing the second region.

[0050] The determination unit 15 may determine that the effect is applied in such a manner that a sound related to the second area is generated. The effect in this case is configured in the same manner as the effect in the case of generating a sound related to the first area. That is, for example, the effect may be configured to generate a voice of a person or character located in the second area, to generate a sound related to an object located in the second area, or to generate a voice reading out a comment located in the second area.

[0051] By applying the above-mentioned effect related to the second region, the viewer's gaze is focused on the second region where the viewer's gaze is not focused. In other words, the above-mentioned effect can be said to be an audiovisual effect for guiding the viewer's gaze to the second region in the content. The above-mentioned effect is an effect related to the second region where the viewer's gaze is not focused, and can also be said to be an audiovisual effect according to the degree of concentration of the viewer's gaze.

[0052] In step S109, the effect transmitting unit 16 transmits effect data indicating the manner in which the effect is applied to the viewer terminal 20. At this time, the effect transmitting unit 16 does not have to transmit the effect data to all viewer terminals 20, and may transmit the effect data only to the viewer terminal 20 (target terminal) to which the effect is to be applied. The effect receiving unit 24 of the viewer terminal 20 to which the effect data has been transmitted receives the effect data.

[0053] In step S110, the viewer terminal 20 applies an effect to the content. If the effect is a visual effect, the display control unit 25 processes the effect data and displays the effect on the screen. If the effect is an auditory effect, the viewer terminal 20 outputs the effect from a speaker.

[0054] An example of an aspect of applying an effect will be described with reference to Fig. 5 and Fig. 6. Fig. 5 is a diagram showing an example of a content before an effect is applied, and Fig. 6 is a diagram showing an example of a content to which an effect has been applied.

[0055] 5 and 6, the viewer terminal 20 displays a video of two singers performing a live concert as content C1. Content C1 includes comments posted by multiple viewers. In this example, comments such as "Wave your hands!", "Good luck!", and "Cute!" are displayed.

[0056] First, the identification unit 14 identifies a first region in the content C1 where the viewer's gaze is focused and a second region where the viewer's gaze is less focused than the first region, based on the distribution of gaze positions. In this example, the identification unit 14 identifies the region A1 where the comment "Wave your hand!" is displayed and the region A3 where one singer is displayed as the first region, and identifies the region A2 where the comment "Go for it!" is displayed and the region A4 where the other singer is displayed as the second region.

[0057] Thereafter, the determination unit 15 determines the mode of applying the effect based on the distribution of the gaze positions. In this example, the determination unit 15 determines the mode of applying the effect to display the comments included in the area A2 specified as the second area larger than the other comments, add star marks to the comments, and add star and heart marks to the area A4 specified as the second area. Furthermore, the determination unit 15 determines the mode of applying the effect to generate the voice of the singer located in the area A4 specified as the second area (e.g., a voice such as "Look at me!"). The effect transmission unit 16 transmits effect data indicating the mode of applying the effect determined by the determination unit 15 to the viewer terminal 20 (target terminal).

[0058] The effect receiving unit 24 receives the effect data, and the viewer terminal 20 processes the effect data to generate an effect. In this example, the display control unit 25 displays the comment included in area A2 larger than the other comments, and adds marks such as stars to areas A2 and A4. The viewer terminal 20 produces the voice of the singer located in area A4 from a speaker.

[0059] Another example of the manner in which an effect is applied will be described with reference to Fig. 7. Fig. 7 is a diagram showing another example of content to which an effect is applied. In the example of Fig. 7, the viewer terminal 20 displays, as content C2, a questionnaire video including a character string constituting the question "Which season do you like best?" and four icons constituting the options of "spring", "summer", "autumn" and "winter".

[0060] First, the identification unit 14 identifies a first region in content C2 where the viewer's gaze is focused and a second region where the viewer's gaze is less focused than the first region, based on the distribution of gaze positions. In this example, the identification unit 14 identifies the region B2 including the "summer" icon as the first region, and identifies the regions B1, B3, and B4 including the "spring," "autumn," and "winter" icons, respectively, as the second regions.

[0061] After that, the determination unit 15 determines the manner of applying the effect based on the distribution of the gaze positions. In this example, the determination unit 15 determines that the effect is applied in such a manner that the icon of "summer" included in the area B2 specified as the first area is displayed in a vibrating manner, and that the proportion of gazes located in each of the areas B1 to B4 is displayed on the corresponding icon. That is, in this example, the icon that is particularly attracting attention (the gazes are focused on) from the viewers is displayed in a vibrating manner. In addition, in this example, the degree of attention (proportion of gazes) from the viewers on each icon is displayed as a numerical value. The proportion of gazes is calculated from the distribution of the gaze positions. In this example, a character string of "20%" indicating the proportion of gazes located in the area B1 is displayed on the icon of "spring", a character string of "40%" indicating the proportion of gazes located in the area B2 is displayed on the icon of "summer", a character string of "10%" indicating the proportion of gazes located in the area B3 is displayed on the icon of "autumn", and a character string of "30%" indicating the proportion of gazes located in the area B4 is displayed on the icon of "winter". The effect transmitting section 16 transmits effect data indicating the mode of application of the effect determined by the determining section 15 to the viewer terminal 20 (target terminal).

[0062] The effect receiving unit 24 receives the effect data, and the viewer terminal 20 processes the effect data to generate an effect. In this example, the display control unit 25 displays the "summer" icon included in the area B2 in a vibrating manner, and displays a character string indicating the gaze ratio on the corresponding icon.

[0063] [Variations] Various examples of the present disclosure have been described in detail above. However, the present disclosure is not limited to the above examples. Various modifications of the present disclosure are possible without departing from the spirit of the present disclosure.

[0064] The content distribution system 1 may transmit content data not only to the viewer terminal 20 but also to the distributor terminal 30. The distributor terminal 30 processes the content data and displays the content on a screen. In this case, the content distribution system 1 may also transmit effect data to the distributor terminal 30. The distributor terminal 30 processes the effect data and applies effects to the content. In other words, the distributor terminal 30 can also function as a viewer terminal 20 (target terminal).

[0065] The manner in which the effect is applied is not limited to the above-mentioned example. The determination unit 15 may determine the manner in which the effect is applied based on the attribute information of the viewer. The determination unit 15 may determine the manner in which the effect is applied based on attribute information such as age or gender. Specifically, the determination unit 15 may determine that the comment included in the first area where the gazes of elderly viewers are concentrated is displayed larger and in a more noticeable color than other comments as the manner in which the effect is applied. When the determination unit 15 determines the manner in which the effect is applied based on the attribute information of the viewer in this way, the calculation unit 13 may classify the viewer into a plurality of groups based on the attribute information and calculate the distribution of the gaze position for each group. For example, the calculation unit 13 may calculate the distribution of the gaze position for each age group or gender of the viewer.

[0066] When calculating the distribution of gaze positions, the calculation unit 13 may weight the gaze data based on the attribute information of the viewers. For example, the calculation unit 13 may calculate the distribution of gaze positions by using a numerical value obtained by multiplying the number of gazes of viewers of a particular age group or gender by a predetermined coefficient.

[0067] The determination unit 15 may determine the manner of applying the effect based on the attribute information of the viewer (hereinafter, referred to as the target person) who uses the target terminal. Specifically, when the attribute information includes information on a favorite person or character selected by the target person and an image color associated with the person or character, the determination unit 15 may set the sound generated as an effect to the sound of the person or character selected by the target person, or may set the color of a design added to the content as an effect to the image color associated with the person or character.

[0068] When multiple comments posted by viewers are included in the content and displayed, the determination unit 15 may determine, as the mode of applying the effect, that only a predetermined number of comments that attract many gazes among the multiple comments are displayed, and the other comments are not displayed. At this time, the determination unit 15 identifies the comment that attracts many gazes based on the distribution of gaze positions.

[0069] The determination unit 15 may determine, as the mode of applying the effect, that the distribution of the gaze positions is displayed on the screen of the user terminal in a format that is visible to the user, such as a heat map. In this case, the determination unit 15 may determine the mode of applying the effect without the specification unit 14 specifying the first region and the second region.

[0070] When the content distribution system 1 is used for on-demand distribution, the acquisition unit 12 acquires gaze data every time a content is viewed by each viewer, and accumulates the acquired gaze data in a database. The calculation unit 13 may analyze two or more accumulated gaze data to calculate the distribution of gaze positions. In other words, the acquisition unit 12 does not necessarily acquire gaze data from each viewer terminal 20 at the same time, and may acquire the gaze data at different times.

[0071] When the content distribution system 1 is used for on-demand distribution, the content distribution system 1 may accumulate data showing the history of comments posted by a viewer in a database, and when other viewers view the content, the comments may be included in the content and displayed based on the data.

[0072] When there is a difference in the timing at which the content is displayed on each viewer terminal 20, the viewer terminal 20 may transmit data indicating the time at which the gaze data was acquired (e.g., data indicating the progress of the content) to the server 10 together with the gaze data. When there is a difference in the timing at which the content is displayed on each viewer terminal 20, for example, the content distribution system 1 is used for on-demand distribution, or when there is a delay (lag) in the timing at which the content is displayed. The calculation unit 13 of the server 10 can calculate the distribution of gaze positions for each scene included in the content based on the gaze data and the data indicating the time at which the gaze data was acquired. When there is no difference in the timing at which the content is displayed on each viewer terminal 20, for example, the content distribution system 1 is used for real-time distribution, or when there is no delay (lag) in the timing at which the content is displayed.

[0073] The effect application process may be performed by the server 10. For example, the server 10 may change the configuration of the content based on the effect application mode determined by the determination unit 15 (such as changing the content to one with a part highlighted), and transmit content data indicating the changed content to the viewer terminal 20. In this case, the display control unit 25 of the viewer terminal 20 processes the content data and displays the content, so that the content to which the effect has been applied is displayed on the screen.

[0074] In this disclosure, the expression "at least one processor executes a first process, executes a second process, ... executes an nth process" or a corresponding expression indicates a concept including a case where the executing entity (i.e., the processor) of n processes from the first process to the nth process changes midway. In other words, this expression indicates a concept including both a case where all n processes are executed by the same processor and a case where the processor changes among the n processes according to an arbitrary policy.

[0075] The processing procedure of the method executed by at least one processor is not limited to the example in the above embodiment. For example, some of the above steps may be omitted, or each step may be executed in a different order. In addition, any two or more of the above steps may be combined, or some of the steps may be modified or deleted. Alternatively, other steps may be executed in addition to the above steps.

[0076] In comparing the magnitude of two numerical values, either of the two criteria "greater than or equal to" or "greater than" may be used, or either of the two criteria "less than or equal to" or "less than".

[0077] Any part or all of the functional units described in this specification may be realized by a program. The program mentioned in this specification may be distributed in a non-temporary manner recorded on a computer-readable recording medium, or may be distributed via a communication line (including wireless communication) such as the Internet, or may be distributed in a state in which it is installed on any terminal.

[0078] Based on the above description, a person skilled in the art may be able to conceive additional effects or various modifications of the present disclosure, but the aspects of the present disclosure are not limited to the individual embodiments described above. Various additions, modifications, and partial deletions are possible within the scope of the conceptual idea and intent of the present disclosure derived from the contents defined in the claims and their equivalents.

[0079] For example, a configuration described in this specification as one device (or component; the same applies below) (including a configuration depicted as one device in the drawings) may be realized by multiple devices. Alternatively, a configuration described in this specification as multiple devices (including a configuration depicted as multiple devices in the drawings) may be realized by one device. Alternatively, some or all of the means or functions included in a certain device (e.g., a server) may be included in another device (e.g., a user terminal).

[0080] Not all of the features described in this specification are essential. For example, features that are described in this specification but not in the claims may be considered optional additional features.

[0081] The applicant is merely aware of the known technology described in the "Prior Art Documents" column of this specification. It should also be noted that this disclosure is not necessarily intended to solve the problems in the known technology. The problems to be solved in this disclosure should be identified by taking into consideration the entire specification. For example, if there is a description in this specification that a specific configuration produces a certain effect, it can also be said that the problem corresponding to the certain effect is solved. However, the description of the effect does not necessarily intend that such a specific configuration is an essential requirement.

[0082] [Note] As can be seen from the various examples above, the present disclosure includes the following aspects. (Appendix 1) At least one processor; the at least one processor: Displaying the content on multiple user terminals; acquiring gaze data indicating gaze positions of users viewing the content from two or more user terminals among the plurality of user terminals; Analyzing the two or more pieces of gaze data acquired, and calculating a distribution of gaze positions of two or more users in the content; A content distribution system that determines, based on the calculated distribution, the manner in which an effect is applied to the content being displayed on at least one target terminal among the plurality of user terminals. (Appendix 2) the at least one processor: identifying a first region in the content in which gazes of the two or more users are concentrated and a second region in which gazes of the two or more users are less concentrated than in the first region based on the distribution; A content distribution system as described in Appendix 1, which determines that the effect application mode is to change the display mode of the first area of ​​the content displayed on the at least one target terminal. (Appendix 3) the at least one processor: identifying a first region in the content in which gazes of the two or more users are concentrated and a second region in which gazes of the two or more users are less concentrated than in the first region based on the distribution; A content distribution system as described in Appendix 1, which determines that the effect application mode is to change the display mode of the second area of ​​the content displayed on the at least one target terminal. (Appendix 4) The plurality of user terminals include a distributor terminal that distributes the content and a plurality of viewer terminals, The content distribution system according to any one of claims 1 to 3, wherein the content is distributed in real time from the distributor terminal to the plurality of viewer terminals. (Appendix 5) The plurality of user terminals includes a plurality of viewer terminals, 4. The content distribution system according to any one of claims 1 to 3, wherein the content is content that is distributed on demand to the plurality of viewer terminals. (Appendix 6) The content distribution system according to any one of claims 1 to 5, wherein the at least one processor determines a mode of applying the effect based on attribute information of the multiple users. (Appendix 7) 1. A content distribution method performed by a content distribution system comprising at least one processor, comprising: displaying the content on a plurality of user terminals; acquiring gaze data indicating gaze positions of users viewing the content from two or more of the plurality of user terminals; A step of analyzing the two or more pieces of acquired gaze data to calculate a distribution of gaze positions of two or more users in the content; determining a mode of applying an effect to the content displayed on at least one target terminal among the plurality of user terminals based on the calculated distribution; Content delivery methods including: (Appendix 8) displaying the content on a plurality of user terminals; acquiring gaze data indicating gaze positions of users viewing the content from two or more of the plurality of user terminals; A step of analyzing the two or more pieces of acquired gaze data to calculate a distribution of gaze positions of two or more users in the content; determining a mode of applying an effect to the content displayed on at least one target terminal among the plurality of user terminals based on the calculated distribution; A content distribution program that causes a computer to execute the above.

[0083] According to Supplementary Notes 1, 7, and 8, two or more pieces of gaze data are analyzed to obtain a distribution of gaze positions of two or more users in the content, and the manner of applying an effect to the content is determined based on this distribution. This mechanism determines the manner of applying an effect based on the reactions of multiple viewers to the content, thereby increasing the appeal of the content to the viewers. In one example, this mechanism reflects the viewers' reactions in the content, providing interactive content, which can promote communication between viewers and distributors, and among viewers.

[0084] According to Supplementary Note 2, the display mode of the first area where the user's gaze is focused is changed. This makes it possible to, for example, apply an effect for guiding the viewer's gaze to the first area, thereby further focusing the gaze on the first area.

[0085] According to Supplementary Note 3, the display mode of the second area, which is less focused on by the user than the first area, is changed. This makes it possible to, for example, impart an effect for guiding the viewer's gaze to the second area, dispersing the gazes omnipresent in the first area and drawing the gaze to the second area as well.

[0086] According to Supplementary Note 4, effects are added to real-time distributed content. This makes it possible to enhance the appeal of the real-time distributed content to viewers.

[0087] According to Supplementary Note 5, effects are added to on-demand distributed content. This makes it possible to enhance the appeal of on-demand distributed content to viewers.

[0088] According to Supplementary Note 6, the manner in which effects are applied is determined based on the viewer's attribute information, which further enhances the appeal of the content to the viewer. [Explanation of symbols]

[0089] 1...content distribution system, 10...server, 11...content transfer unit, 12...acquisition unit, 13...calculation unit, 14...identification unit, 15...decision unit, 16...effect transmission unit, 20...viewer terminal, 21...content receiving unit, 22...gaze identification unit, 23...gaze data transmission unit, 24...effect receiving unit, 25...display control unit, 30...distributor terminal, 31...content transmission unit, 40...user database, A1, A2, A3, A4, B1, B1, B2, B3, B4...area, C1, C2...content, P1...server program, P2...client program.

Claims

1. Comprising at least one processor, wherein the at least one processor displays the content on a plurality of user terminals used by a plurality of users, and determines an application mode of an effect applied to the content displayed on at least one target terminal among the plurality of user terminals based on attribute information of at least one user among the plurality of users. A content distribution system.

2. The at least one processor acquires line-of-sight data indicating a line-of-sight position of a user viewing the content from two or more of the plurality of user terminals, and determines the application mode of the effect based on the attribute information of the at least one user and the two or more acquired line-of-sight data. The content distribution system according to claim 1.

3. The at least one processor analyzes the two or more acquired line-of-sight data to calculate a distribution of line-of-sight positions of two or more users in the content, and determines the application mode of the effect based on the attribute information of the at least one user and the calculated distribution. The content distribution system according to claim 2.

4. The at least one processor identifies, based on the distribution, a first region where the line of sight of the two or more users in the content converges and a second region where the line of sight of the two or more users does not converge more than the first region, and determines, as the application mode of the effect, to change a display mode of the first region of the content displayed on the at least one target terminal. The content distribution system according to claim 3.

5. The at least one processor identifies, based on the distribution, a first region where the line of sight of the two or more users in the content converges and a second region where the line of sight of the two or more users does not converge more than the first region, and determines, as the application mode of the effect, to change a display mode of the second region of the content displayed on the at least one target terminal. The content distribution system according to claim 3.

6. A content distribution method executed by a content distribution system comprising at least one processor, the method comprising: displaying the content on a plurality of user terminals used by a plurality of users; Determining a manner of applying an effect to the content displayed on at least one target terminal among the plurality of user terminals based on the attribute information of at least one user among the plurality of users A content distribution method including the above

7. Displaying the content on a plurality of user terminals used by a plurality of users Determining a manner of applying an effect to the content displayed on at least one target terminal among the plurality of user terminals based on the attribute information of at least one user among the plurality of users A content distribution program for causing a computer to execute the above

Images