Video streaming that controls the display of comments posted during the stream.
The system identifies and controls the display of comments responded to by the distributor, improving viewer engagement by highlighting relevant interactions in video distribution systems.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- RAKUTEN GROUP INC
- Filing Date
- 2024-11-22
- Publication Date
- 2026-07-22
AI Technical Summary
In existing video distribution systems, comments posted by viewers are displayed in a simple comment column without indicating which comments have been responded to by the distributor, making it difficult for viewers to identify relevant interactions.
The system identifies comments to which the distributor has responded and controls their display on viewer terminals, either by changing their appearance or extending their display duration, using processors to manage comment management information and perform speech recognition to match broadcaster speech with viewer comments.
Enables viewers to easily identify comments that have been responded to by the distributor, enhancing viewer engagement and interaction through improved matching accuracy and reduced computational load.
Smart Images

Figure 0007893852000001 
Figure 0007893852000002 
Figure 0007893852000003
Abstract
Description
Technical Field
[0004] , , , , , , , , , , , ,
[0005] , , , , , , ,
[0003]
[0001] The present disclosure relates to video distribution that controls the display of comments posted during distribution.
Background Art
[0002] In recent years, a distribution system that distributes live videos provided by a distributor to a viewer terminal has become widely popular. In such a distribution system, for example, a viewer watching a live video can post a comment. And the distributor may react to the posted comment and mention (speak about) that comment in the live video. This creates a sense of unity among the viewers that they are participating in the live video, so it can be expected that the viewers will use the distribution system more.
[0003] As an example of the prior art of such a distribution system, Patent Document 1 discloses a distribution system that appropriately processes the posted comments. In this distribution system, by restricting the comments to be displayed superimposed on the video according to the attribute information of the poster, even when a large number of comments are posted, the video is displayed in an easy-to-view manner.
Prior Art Documents
Patent Documents
[0004]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0005] In the distribution system disclosed in Patent Document 1 described above, the posted comments are also displayed in a comment column. However, in this comment column, each comment is simply listed. Therefore, even if the comment column contains a comment to which the distributor has reacted, the viewer cannot identify that comment. [[ID=
[0006] This disclosure is made to solve the problems described above and aims to provide video streaming that controls the display of comments posted during the stream. [Means for solving the problem]
[0007] The server equipment relating to the first aspect of this disclosure is Equipped with one or more processors, By at least one of the one or more processors, The live video provided from the streamer's device is distributed to viewer devices that have a comment area capable of displaying a predetermined number of comments. During the live video broadcast, comments posted from the viewer's device are received. The received comment is sent to the viewer terminal to be added to the comment area. In the aforementioned live video being streamed, the comments to which the streamer responded are identified, Controlling the display of the identified comment on the viewer terminal, which is a different terminal from the broadcaster terminal, The process is characterized by being executed.
[0008] The server equipment relating to the second aspect of this disclosure is: Equipped with one or more processors, By at least one of the one or more processors, The live video provided by the streamer is distributed to viewer devices that have a comment area capable of displaying a predetermined number of comments. During the live video broadcast, comments posted from the viewer's device are received. The received comment is sent to the viewer terminal to be added to the comment area. In the aforementioned live video being streamed, the comments to which the streamer responded are identified, Control the display of the identified comment in the comment area for a longer period than the standard duration. The process is characterized by being executed.
[0009] The display control method relating to the third aspect of this disclosure is: Computers The live video provided from the streamer's device is distributed to viewer devices that have a comment area capable of displaying a predetermined number of comments. During the live video broadcast, comments posted from the viewer's device are received. The received comment is sent to the viewer terminal to be added to the comment area. In the aforementioned live video being streamed, the comments to which the streamer responded are identified, Controlling the display of the identified comment on the viewer terminal, which is a different terminal from the broadcaster terminal, It is characterized by the following:
[0010] The display control method relating to the fourth aspect of this disclosure is: Computers The live video provided by the streamer is distributed to viewer devices that have a comment area capable of displaying a predetermined number of comments. During the live video broadcast, comments posted from the viewer's device are received. The received comment is sent to the viewer terminal to be added to the comment area. In the aforementioned live video being streamed, the comments to which the streamer responded are identified, Control the display of the identified comment in the comment area for a longer period than the standard duration. It is characterized by the following:
[0011] The program relating to the fifth aspect of this disclosure is On the computer, The live video provided from the streamer's device is distributed to viewer devices that have a comment area capable of displaying a predetermined number of comments. During the live video broadcast, comments posted from the viewer's device are received. Transmit the received comment to the viewer terminal to add it to the comment area, In the live video being distributed, identify the comments to which the distributor has responded, Control the display of the identified comments on the viewer terminal, which is a terminal different from the distributor terminal, Characterized by executing the process.
[0012] The program according to the sixth aspect of the present disclosure is To a computer, Distribute a live video provided by a distributor to a viewer terminal having a comment area where a predetermined number of comments can be displayed, During the distribution of the live video, receive comments posted from the viewer terminal, Transmit the received comment to the viewer terminal to add it to the comment area, In the live video being distributed, identify the comments to which the distributor has responded, Control the identified comments to be displayed in the comment area for a longer time than the standard, Characterized by executing the process.
Effect of the Invention
[0013] According to the present disclosure, it is possible to provide video distribution that controls the display of comments posted during distribution.
Brief Description of the Drawings
[0014] [Figure 1] It is a schematic diagram showing an example of the overall configuration of a distribution system according to Embodiment 1 of the present disclosure. [Figure 2] It is a block diagram showing an example of the schematic configuration of a typical information processing apparatus in which a distribution server or the like is realized. [Figure 3] It is a block diagram showing an example of the functional configuration of the distribution server according to Embodiment 1. [Figure 4] It is a schematic diagram showing an example of comment management information. [Figure 5] This is a schematic diagram illustrating an example of how to control the display of comments in the comment area. [Figure 6] This is a block diagram showing an example of the functional configuration of a broadcaster's terminal. [Figure 7] This is a block diagram showing an example of the functional configuration of a viewer terminal. [Figure 8] This is a schematic diagram showing an example of a browsing screen according to Embodiment 1. [Figure 9] This is a flowchart illustrating the distribution process according to Embodiment 1. [Figure 10] This is a schematic diagram showing an example of the overall configuration of the distribution system according to Embodiment 2 of this disclosure. [Figure 11] This is a block diagram showing an example of the functional configuration of the distribution server according to Embodiment 2. [Figure 12] This is a schematic diagram illustrating an example of chapter management information. [Figure 13] This is a schematic diagram showing an example of a browsing screen according to Embodiment 2. [Figure 14] This is a flowchart illustrating the distribution process according to Embodiment 2. [Modes for carrying out the invention]
[0015] The embodiments of this disclosure will be described in detail below with reference to the drawings. In the drawings, the same or corresponding parts will be denoted by the same reference numerals. Furthermore, although the following description will focus on the case where a distribution server (server device) identifies comments (comments to which the distributor has responded), the disclosure can also be applied in the same way when the distributor terminal identifies the comments, as will be described later. In other words, the embodiments described below are for illustrative purposes only and do not limit the scope of this disclosure. Therefore, those skilled in the art can adopt embodiments in which each or all of these elements are replaced with equivalents, and these embodiments are also included within the scope of this disclosure.
[0016] (Embodiment 1) Figure 1 is a schematic diagram showing an example of the overall configuration of a distribution system 1 according to Embodiment 1 of this disclosure. In this distribution system 1, as an example, a distribution server 100 that distributes live video, a distributor terminal 200 used by distributors, and a viewer terminal 300 used by viewers are connected to each other via the Internet 900. It is assumed that there are many distributor terminals 200 and viewer terminals 300 depending on the number of distributors and viewers using the system.
[0017] The distribution server 100 is, for example, a server device (such as a computer for use as a server) that distributes live video provided by the broadcaster to the viewer terminal 300. The distribution server 100 also sends comments posted during the live video distribution to the broadcaster terminal 200 and the viewer terminal 300.
[0018] The broadcaster terminal 200 is, for example, a PC (Personal Computer), smartphone, or tablet, and is used by broadcasters who conduct live streaming. For example, a broadcaster might film a live video to introduce a product. The broadcaster terminal 200 provides the live video to the streaming server 100, which then distributes the live video to the viewer terminal 300. During the live video broadcast, the broadcaster can view comments posted by viewers on the viewer terminal 300 and respond to certain comments by mentioning them in the live video.
[0019] The viewer terminal 300 is a device such as a smartphone, tablet, or PC, and is used by viewers to watch the live video being streamed. For example, a viewer launches a video viewing application (or browser application) on the viewer terminal 300, logs in to the streaming server 100, and then watches the live video streamed from the streaming server 100. Viewers can also post comments addressed to the streamer of the live video they are watching. In other words, the screen of the video viewing application, etc., is provided with a video area for displaying the live video and a comment area for displaying comments, as will be described later. The comment area can display a predetermined number of the most recent comments. That is, as long as the number of comments is less than the predetermined number, comments are added to the comment area sequentially each time they are posted. After the number of comments reaches the predetermined number, when a comment is posted, older comments are removed from the comment area and new comments are added to the comment area using a last-in, first-out method.
[0020] (Overview of the information processing device 400) A typical information processing device 400 that realizes the distribution server 100, distribution terminal 200, and viewer terminal 300 according to Embodiment 1 will be described.
[0021] As shown in Figure 2, the information processing device 400 includes a CPU (Central Processing Unit) 401, a ROM (Read Only Memory) 402, a RAM (Random Access Memory) 403, a NIC (Network Interface Card) 404, an image processing unit 405, an audio processing unit 406, an auxiliary storage unit 407, an interface 408, a shooting unit 409, an audio unit 410, an operation unit 411, and a display unit 412.
[0022] The CPU 401 controls the operation of the entire information processing unit 400, and is connected to each component to exchange control signals and data.
[0023] The ROM 402 stores the IPL (Initial Program Loader), which is executed immediately after power-on. When this is executed, the program stored in the auxiliary storage unit 407 is read into the RAM 403, and the CPU 401 begins executing that program.
[0024] RAM 403 is for temporarily storing data and programs, and holds programs and data read from auxiliary storage unit 407, as well as other data necessary for communication.
[0025] The NIC 404 is used to connect the information processing device 400 to computer communication networks such as the Internet. It consists of components such as those conforming to the 10BASE-T / 100BASE-T standard used when configuring a LAN (Local Area Network), analog modems for connecting to the Internet using telephone lines, ISDN (Integrated Services Digital Network) modems, ADSL (Asymmetric Digital Subscriber Line) modems, and cable modems for connecting to the Internet using cable television lines.
[0026] The image processing unit 405 processes the image data read from the auxiliary storage unit 407, etc., using the CPU 401 and an image processing processor (not shown) provided in the image processing unit 405, and then records it in a frame memory (not shown) provided in the image processing unit 405. The image data recorded in the frame memory is converted into a video signal at a predetermined synchronization timing and output to the display unit 412 via the interface 408, etc. In other words, under the control of the CPU 401, the image processing unit 405 generates images necessary as the processing performed by the information processing device 400 progresses and displays those images on the display unit 412.
[0027] The audio processing unit 406 converts music data and audio data read from the auxiliary storage unit 407, etc., into audio signals and outputs them to the outside via the interface 408, etc. If the information processing device 400 has a speaker inside, the audio processing unit 406 outputs the converted audio signals to the speaker. In other words, under the control of the CPU 401, the audio processing unit 406 generates music sounds and audio that should be generated during the processing performed by the information processing device 400, and outputs those music sounds, etc., from an internal or external speaker.
[0028] The auxiliary storage unit 407 is a hard disk, SSD (Solid State Drive), etc., and stores various programs and data necessary for the overall operation control of the information processing device 400. For example, the auxiliary storage unit 407 stores a program for realizing the distribution server 100, etc., according to the embodiment. Then, under the control of the CPU 401, the auxiliary storage unit 407 reads the stored programs and data as appropriate and temporarily stores them in the RAM 403, etc.
[0029] Interface 408 conforms to standards such as HDMI (registered trademark), USB (Universal Serial Bus), and I2C (Inter-Integrated Circuit), and the shooting unit 409, audio unit 410, operation unit 411, and display unit 412 are connected to it. Interface 408 may also send and receive necessary information with other connected external devices.
[0030] The imaging unit 409 is, for example, a fixed-focus lens and an image sensor (CMOS; Complementary Metal Oxide Semiconductor or CCD; Charge Coupled Device) with a predetermined number of pixels, and captures still images or videos.
[0031] The voice unit 410 is, for example, a microphone, and receives the voice (speech) of a worker or other person using the information processing device 400.
[0032] The operation unit 411 receives operation input from workers and others using the information processing device 400.
[0033] The display unit 412 draws an image corresponding to the image data output by the image processing unit 405 and presents it to the worker or other person using the information processing device 400.
[0034] In addition, the information processing device 400 may be equipped with a drive unit such as a DVD (Digital Versatile Disc)-ROM instead of the auxiliary storage unit 407. In this case, the information processing device 400 reads programs and data from the DVD-ROM or the like installed in the drive unit and operates in the same manner as described above.
[0035] The functions of the distribution server 100, distribution terminal 200, and viewer terminal 300 implemented in the above-mentioned information processing device 400 will be described below with reference to Figures 3 to 8. When power is turned on to the information processing device 400, a program that enables it to function as the distribution server 100, distribution terminal 200, and viewer terminal 300 according to Embodiment 1 is executed, and the distribution server 100, distribution terminal 200, and viewer terminal 300 according to Embodiment 1 are realized.
[0036] (Functional configuration of distribution server 100) Figure 3 is a block diagram showing an example of the functional configuration of a distribution server 100 according to Embodiment 1. As shown in the figure, the distribution server 100 includes a transmission unit 110, a reception unit 120, a storage unit 130, and a control unit 140.
[0037] The transmitting unit 110 transmits various information to the viewer terminal 300 and the like via the Internet 900. For example, the transmitting unit 110 distributes live video provided by the broadcaster terminal 200 to the viewer terminal 300. The transmitting unit 110 also transmits comments posted by the viewer terminal 300 to both the broadcaster terminal 200 and the viewer terminal 300. Furthermore, the transmitting unit 110 transmits command information to the viewer terminal 300 and the like to change the way the comments are displayed. The NIC 404 mentioned above can function as such a transmitting unit 110.
[0038] The receiving unit 120 receives various information sent from the broadcaster terminal 200 and the viewer terminal 300 via the internet 900. For example, the receiving unit 120 receives live video provided by the broadcaster terminal 200. The receiving unit 120 also receives comments posted by the viewer terminal 300. The NIC 404 mentioned above can function as such a receiving unit 120.
[0039] The memory unit 130 stores various information necessary for processing in the distribution server 100. For example, the memory unit 130 stores comment management information 131.
[0040] Comment management information 131 is information for managing comments posted by viewers during live video streaming, and includes information such as that shown in Figure 4 as an example. Specifically, comment management information 131 includes information such as comment ID 131a, reception time 131b, comment 131c, display flag 131d, and response flag 131e. The display flag 131d is a flag that indicates whether the comment is currently displayed in the comment area for displaying a predetermined number of comments on the viewer terminal 300. In other words, if the display flag 131d is "1", it indicates that the comment is to be displayed, while if the display flag 131d is "0", it indicates that the comment is not to be displayed. The response flag 131e is a flag that indicates whether the broadcaster has responded to the comment. In other words, if the response flag 131e is "1", it indicates that the broadcaster has responded to the comment, while if the response flag 131e is "0", it indicates that the broadcaster has not responded to the comment (no response).
[0041] The memory unit 130 also stores various other information necessary for processing by the control unit 140. For example, the memory unit 130 stores the ID and password of viewers using the viewer terminal 300. The memory unit 130 also stores information related to the live video, such as the video management ID, video title, video summary, and distribution start time. The auxiliary memory unit 407 mentioned above can function as such a memory unit 130.
[0042] Returning to Figure 3, the control unit 140 controls the entire distribution server 100. This control unit 140 includes, for example, a distribution control unit 141, a comment management unit 142, a speech recognition unit 143, a identification unit 144, and a display control unit 145.
[0043] The distribution control unit 141 distributes the live video received from the broadcaster terminal 200 to the viewer terminal 300. That is, when the receiving unit 120 receives the live video provided from the broadcaster terminal 200, the distribution control unit 141 controls the transmitting unit 110 to distribute the received live video to the viewer terminal 300.
[0044] The comment management unit 142 manages comments posted by viewers watching the live video. Specifically, when the receiving unit 120 receives a comment posted from the viewer terminal 300, the comment management unit 142 controls the transmitting unit 110 to send the received comment to the broadcaster terminal 200 and the viewer terminal 300. The comment management unit 142 also updates the comment management information 131 shown in Figure 4 above. In other words, the comment management unit 142 adds newly posted comments to the comment management information 131 (setting the display flag 131d to "1" and the reaction flag 131e to "0"), and changes the display flag 131d of the comment with the oldest reception time 131b among the comments with a display flag 131d of "1" to "0". Furthermore, when the identification unit 144, described later, identifies a comment, the comment management unit 142 changes the reaction flag 131e of that comment to "1".
[0045] The speech recognition unit 143 performs speech recognition in real time on the live video, converting the speech spoken by the broadcaster into speech text. For example, each time the broadcaster speaks, the speech recognition unit 143 divides the speech data into phonemes, identifies each phoneme by comparing it with the feature distribution of sample phonemes, and then performs pattern matching to words, ultimately generating the speech text spoken by the broadcaster.
[0046] Each time the broadcaster's voice is converted into speech text by the speech recognition unit 143, the identification unit 144 compares the converted speech text with each comment currently displayed in the comment area of the viewer terminal 300 to identify the comment to which the broadcaster responded (the comment mentioned by the broadcaster in the live video). More specifically, the identification unit 144 first performs morphological analysis on the speech text (natural language) to extract keywords (for example, nouns, noun phrases, etc.). Next, the identification unit 144 refers to the comment management information 131 shown in Figure 4 and performs morphological analysis on each comment where the display flag 131d is "1" to extract its respective keywords. Then, the identification unit 144 compares the keywords extracted from the speech text (keywords contained in the speech text) with the keywords extracted from each comment (keywords contained in each comment) and identifies the comments containing matching keywords as the comments to which the broadcaster responded.
[0047] Let's explain more specifically the case where the streamer says, "The battery life was about 4 hours." At the time of this utterance, the comments (comment 131c) with display flag 131d set to "1" in comment management information 131 are "You're good at explaining," "I see," "I might prefer the old model," "I've been waiting for that feature," and "How long is the battery life?" In this case, the identification unit 144 extracts the keywords "battery," "battery life," and "4 hours" from the utterance text converted by the speech recognition unit 143, and also extracts the keywords "good at explaining," "-(no keyword)," "older model," "feature," and "battery life" from each comment. The identification unit 144 then compares each keyword extracted from the utterance text with each keyword extracted from each comment. In this case, since the keyword "battery life" matches, the identification unit 144 identifies the comment "How long is the battery life?" which contains the keyword "battery life," as the comment to which the streamer responded.
[0048] Furthermore, the identification unit 144 may perform a text search on each comment where the display flag 131d is set to "1" using the keyword extracted from the spoken text as a key, and identify the searched comments (i.e., comments containing the keyword) as comments to which the broadcaster responded.
[0049] The display control unit 145 controls the display on the viewer terminal 300 for the comments identified by the identification unit 144. For example, the display control unit 145 transmits command information to the viewer terminal 300 to change the display manner of the comments identified by the identification unit 144, thereby changing the display manner of the identified comments (i.e., the comments to which the broadcaster responded) in the comment area of the viewer terminal 300.
[0050] More specifically, let's explain the case where the identification unit 144 identifies the comment "How long is the operating time?". In this case, the display control unit 145 sends command information to the viewer terminal 300 to change, for example, the text color and background color of this comment. Upon receiving this command information, the viewer terminal 300 changes the display of comment DC ("How long is the operating time?") in the comment area CA, for example, as shown in Figure 5. Note that the change in display is not limited to changing the text color and background color; it may also involve changing the font, text size, etc.
[0051] The CPU 401 and other components mentioned above can function as a control unit 140 with such a configuration.
[0052] (Functional configuration of broadcaster terminal 200) Figure 6 is a block diagram showing an example of the functional configuration of the broadcaster terminal 200. As shown in the figure, the broadcaster terminal 200 includes a shooting unit 210, an audio input unit 220, a transmitting / receiving unit 230, an operation reception unit 240, a storage unit 250, a control unit 260, and a display unit 270.
[0053] The shooting unit 210 is, for example, a camera located on the broadcaster terminal 200, and it takes pictures of the broadcaster, etc., during the broadcast. In other words, the shooting unit 210 outputs video including the broadcaster during the broadcast. The aforementioned shooting unit 409 can function as such a shooting unit 210.
[0054] The audio input unit 220 receives the broadcaster's voice. For example, the audio input unit 220 receives the voice spoken by the broadcaster during the broadcast. The aforementioned audio unit 410 can function as such an audio input unit 220.
[0055] The transmitting / receiving unit 230 transmits and receives various information to and from the distribution server 100 via the Internet 900. For example, the transmitting / receiving unit 230 is controlled by the control unit 260 (distribution unit 262, described later) and transmits to the distribution server 100 (distributed to the viewer terminal 300 via the distribution server 100) an image created by combining an object with the image captured by the shooting unit 210 (more specifically, the image including the audio input by the audio input unit 220). The transmitting / receiving unit 230 also receives comments sent from the distribution server 100 (comments posted by the viewer terminal 300). The NIC 404 described above can function as such a transmitting / receiving unit 230.
[0056] The operation reception unit 240 is a touch panel or pointing device that receives various operations from the broadcaster. For example, the operation reception unit 240 receives operations directed at an object to be composited into the video captured by the shooting unit 210. The operation unit 411 described above can function as such an operation reception unit 240.
[0057] The memory unit 250 stores various information necessary for processing in the broadcaster terminal 200. For example, the memory unit 250 stores information about objects to be composited onto the captured video, as well as the compositing position of the objects. As an example, the object is a subtitle (banner) containing text information to inform viewers in a live video. The compositing position is the position in the video where the object is composited. The auxiliary memory unit 407 mentioned above can function as such a memory unit 250.
[0058] The control unit 260 controls the entire broadcaster terminal 200. This control unit 260 includes, for example, a synthesis unit 261 and a broadcast unit 262.
[0059] The compositing unit 261 composites objects into the video captured by the shooting unit 210. For example, the compositing unit 261 composites text information to inform the viewer into the captured video according to the object information and compositing position stored in the storage unit 250.
[0060] The distribution unit 262 transmits the video, in which objects have been synthesized by the synthesis unit 261, to the distribution server 100 for distribution to the viewer terminal 300. In other words, the distribution unit 262 controls the transmission / reception unit 230 to transmit the video in which objects have been synthesized to the distribution server 100, and then distributes the video to the viewer terminal 300 via the distribution server 100.
[0061] Furthermore, the CPU 401 and other components mentioned above can function as a control unit 260 with such a configuration.
[0062] The display unit 270 displays the image in which objects have been combined by the composite unit 261 described above. Furthermore, the display unit 270, like the display unit 350 of the viewer terminal 300 (described later), has a comment area and displays comments received by the transmission / reception unit 230. The display unit 412 described above can function as such a display unit 270.
[0063] (Functional configuration of viewer terminal 300) Figure 7 is a block diagram showing an example of the functional configuration of the viewer terminal 300. As shown in the figure, the viewer terminal 300 includes a transmitting / receiving unit 310, an operation reception unit 320, a storage unit 330, a control unit 340, and a display unit 350.
[0064] The transmitting / receiving unit 310 transmits and receives various information to and from the distribution server 100 via the Internet 900. For example, the transmitting / receiving unit 310 is controlled by the control unit 340 and receives live video distributed from the distribution server 100. The transmitting / receiving unit 310 also sends comments received from the operation reception unit 320 to the distribution server 100 and receives comments and command information (command information for changing the display method of comments) sent from the distribution server 100. The NIC 404 described above can function as such a transmitting / receiving unit 310.
[0065] The operation reception unit 320 is a touch panel or pointing device that receives various operations from viewers. For example, the operation reception unit 320 receives comments entered by viewers. The operation unit 411 described above can function as such an operation reception unit 320.
[0066] The storage unit 330 stores various information necessary for processing on the viewer terminal 300. For example, the storage unit 330 stores various applications, including video viewing applications and browser applications. More specifically, various applications are installed in the storage unit 330. The video viewing application is, for example, an application for viewing videos distributed from the distribution server 100. A browser application may also be capable of viewing videos distributed from the distribution server 100. The auxiliary storage unit 407, etc., mentioned above can function as such a storage unit 330.
[0067] The control unit 340 controls the entire viewer terminal 300. For example, the control unit 340 executes a video viewing application stored in the memory unit 330 and displays live video and other content distributed from the distribution server 100 on the display unit 350. As will be described later, the display unit 350 is provided with a video area for displaying live video and a comment area for displaying comments. Therefore, the control unit 340 displays the live video received by the transmitting / receiving unit 310 in the video area, and displays the comments received by the transmitting / receiving unit 310 in the comment area. This comment area can display a predetermined number of the latest comments. Therefore, as long as the number of comments is less than the predetermined number, the control unit 340 sequentially adds the received comments to the comment area each time the transmitting / receiving unit 310 receives a comment. After the number of comments has reached the predetermined number, the control unit 340 deletes old comments from the comment area and adds new comments to the comment area using a last-in, first-out method each time the transmitting / receiving unit 310 receives a comment. Furthermore, when the transmitting / receiving unit 310 receives command information, the control unit 340 changes the display mode of the target comment in the comment area according to that command information. Note that the CPU 401 and the like described above can function as a control unit 340 with such a configuration.
[0068] The display unit 350 displays a screen corresponding to the application executed by the control unit 340. For example, when a video viewing application is executed by the control unit 340, the display unit 350 displays a viewing screen VG1 as shown in Figure 8. This viewing screen VG1 includes a video area VA for displaying live video and a comment area CA for displaying a predetermined number of posted comments. In the comment area CA, comments DC to which the broadcaster has responded are displayed in a different format than other comments.
[0069] (Operation of distribution server 100) The operation of the distribution server 100 will be described below with reference to Figure 9. Figure 9 is a flowchart illustrating the distribution process according to Embodiment 1. This distribution process is executed by the distribution server 100, for example, when the distribution terminal 200 starts providing live video.
[0070] First, the distribution server 100 starts distributing live video (step S11). That is, when the control unit 140 (distribution control unit 141) receives the live video provided by the distributor terminal 200 with the receiving unit 120, it controls the transmitting unit 110 to distribute the received live video to the viewer terminal 300.
[0071] The distribution server 100 determines whether or not a new comment has been received (step S12). That is, the control unit 140 (comment management unit 142) determines whether or not a comment posted from the viewer terminal 300 has been received by the receiving unit 120.
[0072] If the distribution server 100 determines that it has not received any new comments (step S12; No), it proceeds to step S14, which will be described later.
[0073] On the other hand, if the distribution server 100 determines that a new comment has been received (step S12; Yes), it updates the comment management information and sends the received comment to each terminal (step S13). Specifically, the control unit 140 (comment management unit 142) updates the comment management information 131 shown in Figure 4 above. In other words, the comment management unit 142 adds the new comment to the comment management information 131 (setting the display flag 131d to "1" and the response flag 131e to "0"), and also changes the display flag 131d of the comment with the oldest reception time 131b among the comments with the display flag 131d set to "1" to "0". Then, the control unit 140 sends the new comment to the broadcaster terminal 200 and the viewer terminal 300.
[0074] The distribution server 100 determines whether or not the broadcaster has spoken (step S14). That is, the control unit 140 (speech recognition unit 143) determines whether or not the broadcaster has spoken in the live video.
[0075] If the distribution server 100 determines that there was no utterance from the distributor (step S14; No), it proceeds to step S19, which will be described later.
[0076] On the other hand, if it is determined that the broadcaster has spoken (step S14; Yes), the broadcast server 100 performs speech recognition on the broadcaster's voice and converts it into speech text (step S15). That is, the control unit 140 (speech recognition unit 143) divides the speech data spoken by the broadcaster into phonemes, identifies each phoneme while comparing it with the feature distribution of sample phonemes, and after pattern matching to words, ultimately generates the speech text spoken by the broadcaster.
[0077] The distribution server 100 compares the spoken text with each comment to be displayed (step S16). That is, the control unit 140 (specification unit 144) compares the spoken text converted in step S15 with each comment currently displayed in the comment area of the viewer terminal 300. More specifically, the control unit 140 first performs morphological analysis on the spoken text to extract keywords (for example, nouns, noun phrases, etc.). Next, the control unit 140 refers to the comment management information 131 shown in Figure 4 and performs morphological analysis on each comment where the display flag 131d is "1" to extract its respective keywords. Then, the control unit 140 compares the keywords extracted from the spoken text with the keywords extracted from each comment.
[0078] The distribution server 100 determines whether or not there was a matching comment (step S17). For example, the control unit 140 (specification unit 144) determines whether or not there was a comment containing keywords that match the keywords contained in the spoken text, based on the comparison in step S16 above.
[0079] If the distribution server 100 determines that there are no matching comments (step S17; No), it proceeds to step S19, which will be described later.
[0080] On the other hand, if it determines that there is a matching comment (step S17; Yes), the distribution server 100 instructs each terminal to change the display of the matching comment (step S18). That is, the control unit 140 (display control unit 145) transmits command information to the viewer terminal 300, etc., to change the display of the comment to which the broadcaster has responded in the comment area of the viewer terminal 300. For example, the viewer terminal 300 that receives the command information changes the display of comment DC ("How long is the operating time?") in the comment area CA of the viewing screen VG1 shown in Figure 8 above.
[0081] The distribution server 100 determines whether the live video distribution has ended (step S19). That is, the control unit 140 (distribution control unit 141) determines whether the live video provided by the distributor terminal 200 has ended.
[0082] If the distribution server 100 determines that the live video distribution has not finished (step S19; No), it returns to step S12 as described above.
[0083] On the other hand, if it is determined that the live video stream has ended (step S19; Yes), the streaming server 100 terminates the streaming process.
[0084] This type of distribution processing makes it possible to identify and display comments posted by viewers that the broadcaster has responded to. Moreover, since only comments displayed in the comment area are targeted when identifying comments that the broadcaster has responded to, the matching accuracy with the speech test is improved, and the matching process can be performed at a faster speed. As a result, it is possible to determine whether or not the broadcaster has responded to a posted comment with high accuracy and low computational load.
[0085] In the above embodiment 1, we described a case where the display manner of comments to which the broadcaster has responded is changed, but the display of comments may be controlled from other perspectives. For example, the display control unit 145 may display the comments identified by the identification unit 144 (comments to which the broadcaster has responded) in the comment area for a longer period of time than the standard.
[0086] More specifically, the display control unit 145 sends command information to the viewer terminal 300 to delay (new) the reception time of the comment identified by the identification unit 144 by a certain amount of time compared to the original time, thereby causing the identified comment to be displayed in the comment area of the viewer terminal 300 for a longer period of time. In addition, this command information may include a first command information for changing the display mode of the comment and a second command information for delaying the reception time of the comment by a certain amount of time compared to the original time, so that the comment with the changed display mode is displayed in the comment area for a longer period of time than standard. In these cases, comments to which the broadcaster has responded can be displayed with priority.
[0087] (Embodiment 2) In Embodiment 1 described above, the display of a comment is changed when the broadcaster identifies a comment to which they have responded. However, the broadcaster's response to a comment may also be used for setting chapters. Below, a broadcasting system characterized by using the broadcaster's response to a comment for setting chapters will be described.
[0088] Figure 10 is a schematic diagram showing an example of the overall configuration of a distribution system 2 according to Embodiment 2 of this disclosure. In this distribution system 2, as an example, a distribution server 500 that distributes live video, a distributor terminal 200 used by distributors, and a viewer terminal 300 used by viewers are connected to each other via the Internet 900. The distributor terminal 200 and the viewer terminal 300 have the same configuration as the distribution system 1 according to Embodiment 1 described above. In other words, only the distribution server 500 differs from the distribution system 1 in Figure 1.
[0089] The distribution server 500 is also implemented using the information processing device 400 shown in Figure 2 above. That is, when power is turned on to the information processing device 400, a program is executed that causes it to function as the distribution server 500 according to Embodiment 2, and the distribution server 500 according to Embodiment 2 is realized.
[0090] (Functional configuration of distribution server 500) Figure 11 is a block diagram showing an example of the functional configuration of a distribution server 500 according to Embodiment 2. As shown in the figure, the distribution server 500 comprises a transmission unit 110, a reception unit 120, a storage unit 530, and a control unit 540. The transmission unit 110 and the reception unit 120 have the same configuration as the transmission unit 110 and the reception unit 120 in the distribution server 100 shown in Figure 3 above.
[0091] The memory unit 530 stores various information necessary for processing on the distribution server 500. For example, the memory unit 530 stores comment management information 131 and chapter management information 531. Note that the comment management information 131 is the same information as the comment management information 131 in Figure 4 above. The memory unit 530 also saves (records) the live video in parallel with the distribution of the live video. In other words, the control unit 540 (distribution control unit 141) saves the live video in the memory unit 530 while distributing the live video. As a result, as will be described later, even while the live video is being distributed, if a viewer who started watching late performs so-called catch-up playback to watch from a scene they missed, the control unit 540 can distribute the live video stored in the memory unit 530. In addition, if a viewer plays the live video (past video) on demand after the live video distribution has ended, the control unit 540 can distribute the live video stored in the memory unit 530.
[0092] Chapter management information 531 is information for managing chapters used to divide live video, and includes information such as that shown in Figure 12 as an example. Specifically, chapter management information 531 includes information such as chapter number 531a, relative time 531b, keyword 531c, and address 531d. Relative time 531b is time information indicating the start position of the chapter in the live video, and is shown as a relative time (elapsed time from the beginning) based on the start time of the live video. Keyword 531c is a phrase used to identify the chapter, and is also a phrase mentioned by the broadcaster within the chapter. Address 531d is a URL (Uniform Resource Locator) for viewing the live video by specifying the start position of the chapter. The "?t=103" appended to the end of this URL is an example of an argument, and specifies that viewing will start from a position 103 seconds after the beginning of the live video (the value of relative time 531b converted to seconds).
[0093] The memory unit 530 also stores various other information necessary for processing by the control unit 540. For example, the memory unit 530 stores the ID and password of viewers using the viewer terminal 300. The memory unit 530 also stores information related to live video. The auxiliary memory unit 407 mentioned above can function as such a memory unit 530.
[0094] Returning to Figure 11, the control unit 540 controls the entire distribution server 500. This control unit 540 includes, for example, the distribution control unit 141, the comment management unit 142, the speech recognition unit 143, the identification unit 144, and the setting unit 541. The comment management unit 142, the speech recognition unit 143, and the identification unit 144 have the same configuration as the comment management unit 142, the speech recognition unit 143, and the identification unit 144 in the distribution server 100 (control unit 140) in Figure 3 described above. In addition, the distribution control unit 141 has the following functions in addition to the functions of the distribution control unit 141 of the distribution server 100 described above.
[0095] The distribution control unit 141 distributes the live video to the viewer terminal 300 while simultaneously saving the live video to the storage unit 530. Furthermore, after the setting unit 541, described below, sets chapters in the live video, if the viewer plays the live video using catch-up or on-demand playback, the distribution control unit 141 displays the chapter on the seek bar that indicates the playback position of the live video. This allows viewers to view the live video from the beginning of a chapter by moving the seek bar to the chapter, in addition to operating on the chapter information (chapter information CD displayed in the summary area SA) described later.
[0096] The setting unit 541 sets chapters to divide the live video based on the relative time in the live video corresponding to the time when the comment identified by the identification unit 144 was received (i.e., the relative time based on the start time of the live video). For example, the setting unit 541 creates chapter management information 531 as shown in Figure 12 above, and sets chapters by adding the created chapter management information 531 to the summary information of the live video.
[0097] More specifically, let's explain an example where the identification unit 144 extracts keywords such as "driving time" from the spoken text, and identifies the comment "How long is the driving time?" from the comments currently displayed in the comment area. Assume that the start time of the live video is "20:20:00" and the address of the live video is "https: / / XXXX.com / AbCd1eFgH2IjK". In this case, the setting unit 541 first calculates the relative time in the live video by subtracting the start time of the live video from the reception time 131b of the corresponding comment (comment 131c, "How long is the driving time?") in the comment management information 131 shown in Figure 4. In other words, the setting unit 541 subtracts "20:20:00" from "20:21:43" to obtain "0:01:43", which is then set to the relative time 531b in the chapter management information 531 shown in Figure 12. Next, the setting unit 541 sets the keyword used by the identification unit 144 to identify the comment (i.e., the keyword "driving time") as keyword 531c in the chapter management information 531. Finally, the setting unit 541 adds the argument "?t=103" (to start viewing from 103 seconds after the beginning) to the address of the live video and sets it as address 531d in the chapter management information 531.
[0098] Chapters are set by adding the chapter management information 531 generated in this way to the summary information of the live video. For example, after chapter management information 531 as shown in Figure 12 has been added to the summary information of the live video, when the live video is viewed by the viewer terminal 300, the display unit 350 of the viewer terminal 300 displays a viewing screen VG2 as shown in Figure 13. This viewing screen VG2 includes a video area VA for displaying the live video, a summary area SA for displaying an overview of the live video, and a comment area CA for displaying a predetermined number of posted comments. Chapter information CD is attached to the summary area SA. The address 531d in the chapter management information 531 is linked to this chapter information CD, and by touching the chapter information CD, the viewer can view the live video from the beginning of that chapter.
[0099] (Operation of distribution server 500) The operation of the distribution server 500 will be described below with reference to Figure 14. Figure 14 is a flowchart illustrating the distribution process according to Embodiment 2. This distribution process is executed by the distribution server 500 when, for example, the distribution terminal 200 starts providing live video. Steps S11 to S17 and step S19 in the distribution process of Figure 14 are the same as steps S11 to S17 and step S19 in the distribution process of Figure 9 described above. Therefore, the same processing content will be explained briefly.
[0100] First, the distribution server 500 starts distributing live video (step S11) and determines whether or not it has received a new comment (step S12).
[0101] If the distribution server 500 determines that it has not received any new comments (step S12; No), it proceeds to step S14, which will be described later. On the other hand, if it determines that it has received a new comment (step S12; Yes), the distribution server 500 updates the comment management information and sends the received comment to each terminal (step S13).
[0102] The distribution server 500 determines whether or not there has been a speech from the broadcaster (step S14).
[0103] If the distribution server 500 determines that there was no utterance by the broadcaster (step S14; No), it proceeds to step S19, which will be described later. On the other hand, if it determines that there was utterance by the broadcaster (step S14; Yes), the distribution server 500 performs speech recognition on the broadcaster's voice and converts it into speech text (step S15).
[0104] The distribution server 500 compares the spoken text with each comment to be displayed (step S16) and determines whether or not there is a matching comment (step S17).
[0105] If the distribution server 500 determines that there are no matching comments (step S17; No), it proceeds to step S19, which will be described later.
[0106] On the other hand, if it is determined that a matching comment exists (step S17; Yes), the distribution server 500 sets chapters to divide the live video (step S21). That is, the control unit 540 (setting unit 541) sets chapters to divide the live video based on the relative time in the live video corresponding to the time the matching comment was received (i.e., the relative time based on the start time of the live video). For example, the control unit 540 creates chapter management information 531 as shown in Figure 12 above, and sets chapters by adding the created chapter management information 531 to the summary information of the live video.
[0107] The distribution server 500 determines whether or not the live video distribution has ended (step S19).
[0108] If the distribution server 500 determines that the live video distribution has not finished (step S19; No), it returns to step S12 as described above. On the other hand, if it determines that the live video distribution has finished (step S19; Yes), the distribution server 500 terminates the distribution process.
[0109] This type of distribution processing allows for the identification of comments to which the broadcaster has responded, and the easy setting of chapters to divide the live video based on the relative time of the live video corresponding to the time the identified comment was received. In other words, since the time the broadcaster received the comment to which they responded is used, rather than the time the broadcaster responded, chapters are set at a point where the topic before the response can be understood. As a result, chapters to divide the live video can be set appropriately. Furthermore, while previously broadcasters and viewers had to manually set chapters, which was a significant burden, this embodiment allows for automatic chapter setting, thus eliminating this human burden.
[0110] In the above embodiment 2, we described a case where a chapter information CD is added to the overview area SA as shown in Figure 13 based on the generated chapter management information. However, it is also possible to post a message containing such a chapter information CD to a Social Networking Service (SNS). After a message containing a chapter information CD is posted to an SNS, a user who views the message can operate the chapter information CD to, for example, launch a video viewing application and, as described above, view a live video from the beginning of the chapter.
[0111] (Other embodiments) In embodiments 1 and 2 described above, we explained how to identify comments to which the broadcaster responded by comparing the speech text obtained by speech recognition of the broadcaster's voice in the live video with each comment displayed. However, other methods may be used to identify comments to which the broadcaster responded. For example, the broadcaster's terminal 200 may be configured to allow the broadcaster to arbitrarily select posted comments, and the comments selected by the broadcaster may be identified as comments to which the broadcaster responded.
[0112] To explain in more detail, the display unit 270 of the broadcaster terminal 200 also has a comment area, similar to the display unit 350 of the viewer terminal 300, and displays comments (posted comments) received by the transmitting / receiving unit 230. When a broadcaster selects any of the comments displayed in the comment area, the control unit 260 transmits selection information indicating the selected comment to the broadcasting servers 100 and 500 via the transmitting / receiving unit 230. Upon receiving this selection information, the identification unit 144 of the broadcasting servers 100 and 500 identifies the comment to which the broadcaster responded based on the selection information. In this case, the comment to which the broadcaster responded can be identified without error.
[0113] In the embodiments 1 and 2 described above, the control units 140 and 540 of the distribution servers 100 and 500 include a speech recognition unit 143 and a identification unit 144, etc., and the case in which the distribution servers 100 and 500 identify comments (comments to which the distributor has responded) was described. However, the configuration of the speech recognition unit 143 and the identification unit 144, etc. may be added to the control unit 260 of the distributor terminal 200 so that the distributor terminal 200 identifies the comments.
[0114] In the embodiments 1 and 2 described above, the programs executed by the distribution servers 100, 500, etc., can also be distributed by storing them on computer-readable recording media such as CD-ROMs (Compact Disc Read Only Memory), DVDs, MOs (Magneto-Optical Disks), USB memory sticks, and memory cards. Furthermore, by installing such programs on a specific or general-purpose computer, that computer can function as the distribution server 100 or 500 in the embodiments 1 and 2 described above.
[0115] Alternatively, the above program may be stored on a disk device of a server on a communication network such as the Internet, and downloaded to a computer, for example, by superimposing it onto a carrier wave. The above processing can also be achieved by launching and executing the program while transferring it over a communication network. Furthermore, the above processing can also be achieved by running all or part of the program on a server device, with the computer sending and receiving information about the process over a communication network while executing the program.
[0116] Furthermore, if the above-mentioned functions are implemented by the OS (Operating System) or through collaboration between the OS and the application, only the parts other than the OS may be stored and distributed on the above-mentioned recording medium, or they may be downloaded to a computer.
[0117] [1] Equipped with one or more processors, By at least one of the one or more processors, The live video provided by the streamer is distributed to viewer devices that have a comment area capable of displaying a predetermined number of comments. During the live video broadcast, comments posted from the viewer's device are received. The received comments are sent to the viewer terminal in order to be added to the comment area using a last-in, first-out method. In the live video being streamed, each time the streamer speaks, the streamer identifies the comment to which they responded by comparing the speech text obtained by speech recognition of the streamer's voice with each comment currently displayed in the comment area. Control the display of the aforementioned identified comment, A server device characterized by the execution of processing. [2] The aforementioned display control is a control that changes the display manner of the identified comment so that it differs from the display manner of other comments. The server device according to [1], characterized in that [3] The aforementioned display control is a control that displays the identified comment in the comment area for a longer period than the standard duration. The server device according to [1] or [2], characterized in that [4] In identifying the aforementioned comments, keywords contained in the utterance text are compared with keywords contained in each of the aforementioned comments, and comments containing matching keywords are identified as comments to which the broadcaster responded. A server device according to any one of [1] to [3], characterized in that... [5] Computers The live video provided by the streamer is distributed to viewer devices that have a comment area capable of displaying a predetermined number of comments. During the live video broadcast, comments posted from the viewer's device are received. The received comments are sent to the viewer terminal in order to be added to the comment area using a last-in, first-out method. In the live video being streamed, each time the streamer speaks, the streamer identifies the comment to which they responded by comparing the speech text obtained by speech recognition of the streamer's voice with each comment currently displayed in the comment area. Control the display of the aforementioned identified comment, A display control method characterized by the following: [6] On the computer, The live video provided by the streamer is distributed to viewer devices that have a comment area capable of displaying a predetermined number of comments. During the live video broadcast, comments posted from the viewer's device are received. The received comments are sent to the viewer terminal in order to be added to the comment area using a last-in, first-out method. In the live video being streamed, each time the streamer speaks, the streamer identifies the comment to which they responded by comparing the speech text obtained by speech recognition of the streamer's voice with each comment currently displayed in the comment area. Control the display of the aforementioned identified comment, A computer-readable recording medium that contains a program for executing a process. [Industrial applicability]
[0118] This disclosure can be suitably adopted in video streaming that controls the display of comments posted during the stream. [Explanation of symbols]
[0119] 1,2 Distribution System 100,500 distribution servers 110 Transmitter 120 Receiver 130,530 storage section 131 Comment Management Information 531 Chapter Management Information 140,540 Control Unit 141 Distribution Control Unit 142 Comment Management Department 143 Voice Recognition Unit 144 Specific part 145 Display Control Unit 541 Settings Section 200 broadcaster devices 210 Photography Department 220 Voice input section 230 Transmitter / Receiver 240 Operation reception unit 250 Storage section 260 Control Unit 261 Synthesis section 262 Distribution Department 270 Display section 300 viewer terminals 310 Transmitter / Receiver 320 Operation Reception Unit 330 Storage section 340 Control Unit 350 Display section 400 Information Processing Devices 401 CPU 402 ROM 403 RAM 404 NIC 405 Image Processing Unit 406 Audio Processing Unit 407 Auxiliary storage 408 Interface 409 Shooting Unit 410 Voice Unit 411 Control Unit 412 Display Unit 900 Internet
Claims
1. Equipped with one or more processors, At least one of the one or more processors mentioned above, The live video provided from the streamer's device is distributed to viewer devices that have a comment area capable of displaying a predetermined number of comments. During the live video broadcast, comments posted from the viewer's device are received. The received comment is added to the comment area and sent to the viewer terminal for normal display. Based on the streamer's speech in the live video being streamed, the comments to which the streamer responded are identified. Controlling the viewer terminal, which is a different terminal from the broadcaster terminal, to change the display of the identified comment from a normal display to a special display. A server device characterized by the execution of processing.
2. In the transmission of the aforementioned comments, the received comments are added in such a manner that older comments are removed from the comment area and new comments are added to the comment area. The server device according to feature 1.
3. The aforementioned display control involves changing one of the following: the text color, background color, font, or text size of the identified comment. The server device according to claim 1 or 2.
4. Equipped with one or more processors, At least one of the one or more processors mentioned above, The live video provided by the streamer is distributed to viewer devices that have a comment area capable of displaying a predetermined number of comments. During the live video broadcast, comments posted from the viewer's device are received. The received comment is sent to the viewer terminal to be added to the comment area. Based on the streamer's speech in the live video being streamed, the comments to which the streamer responded are identified. In a system where older comments are removed from the comment area and new comments are added to the comment area, the system controls the display of the identified comment in the comment area for a longer period than the standard duration. A server device characterized by the execution of processing.
5. Computers The live video provided from the streamer's device is distributed to viewer devices that have a comment area capable of displaying a predetermined number of comments. During the live video broadcast, comments posted from the viewer's device are received. The received comment is added to the comment area and sent to the viewer terminal for normal display. Based on the streamer's speech in the live video being streamed, the comments to which the streamer responded are identified. Controlling the viewer terminal, which is a different terminal from the broadcaster terminal, to change the display of the identified comment from a normal display to a special display. A display control method characterized by the following:
6. Computers The live video provided by the streamer is distributed to viewer devices that have a comment area capable of displaying a predetermined number of comments. During the live video broadcast, comments posted from the viewer's device are received. The received comment is sent to the viewer terminal to be added to the comment area. Based on the streamer's speech in the live video being streamed, the comments to which the streamer responded are identified. In a system where older comments are removed from the comment area and new comments are added to the comment area, the system controls the display of the identified comment in the comment area for a longer period than the standard duration. A display control method characterized by the following:
7. On the computer, The live video provided from the streamer's device is distributed to viewer devices that have a comment area capable of displaying a predetermined number of comments. During the live video broadcast, comments posted from the viewer's device are received. The received comment is added to the comment area and sent to the viewer terminal for normal display. Based on the streamer's speech in the live video being streamed, the comments to which the streamer responded are identified. Controlling the viewer terminal, which is a different terminal from the broadcaster terminal, to change the display of the identified comment from a normal display to a special display. A program to execute a process.
8. On the computer, The live video provided by the streamer is distributed to viewer devices that have a comment area capable of displaying a predetermined number of comments. During the live video broadcast, comments posted from the viewer's device are received. The received comment is sent to the viewer terminal to be added to the comment area. Based on the streamer's speech in the live video being streamed, the comments to which the streamer responded are identified. In a system where older comments are removed from the comment area and new comments are added to the comment area, the system controls the display of the identified comment in the comment area for a longer period than the standard duration. A program to execute a process.