Video distribution system

By designing a video distribution system to obtain audience feedback in real time and dynamically adjust video content, the problem of existing technologies failing to meet the personalized needs of audiences through pre-recorded video distribution is solved, resulting in a more interactive and immersive video experience.

CN113518979BActive Publication Date: 2024-11-12AVEX TECH INC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN201980093300.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2019-05-13
Filing Date
2019-12-26
Publication Date
2024-11-12
Estimated Expiration
2039-12-26

AI Technical Summary

Technical Problem

Existing technologies make it difficult to dynamically adjust video development based on audience reactions when distributing pre-recorded videos, resulting in an inability to meet the personalized needs of viewers.

Method used

A video distribution system was designed, including a video library, a video distribution unit, a reaction acquisition unit, and a switching decision unit. By acquiring audience reaction information in real time, the system dynamically adjusts the playback order and content of the videos.

Benefits of technology

It enables dynamic adjustment of video content based on audience feedback, providing a personalized audience experience and enhancing the interactivity and immediacy of video distribution.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113518979B_ABST
    Figure CN113518979B_ABST
Patent Text Reader

Abstract

The disclosed embodiment of the present invention discloses a video distribution system, including: a video library, storing a plurality of video data, a video distribution unit, distributing the video data, a reaction acquisition unit, acquiring reaction information representing the reactions of a plurality of viewers at least during the playback of the first video data, and a switching decision unit, which determines the second video data to be distributed after the first video data according to the reaction information, thereby providing a system capable of distributing video content in accordance with the reactions of the viewers.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a video distribution system. Background Art

[0002] In recent years, video distribution systems have become very popular. Video distribution methods include streaming media methods that passively and continuously play videos, and on-demand methods that actively and intentionally play videos. The on-demand method is a method in which viewers set the playback order (for example, Patent Document 1).

[0003] <Prior art documents>

[0004] <Patent Document 1> Japanese Patent No. 5350728

[0005] However, in the case of live video, the development of the live performance can be changed by observing the reaction of the audience, but in the case of recorded video, the development of the video is fixed, so it is difficult to develop the video according to the reaction of the audience. Summary of the invention

[0006] Based on the above background, the present invention aims to provide a technology capable of distributing video contents in accordance with the reactions of viewers.

[0007] In order to solve the above problems, the present invention is a video distribution system, comprising:

[0008] A video library, storing multiple video data;

[0009] A video distribution unit, which distributes the video data;

[0010] A reaction acquisition unit, which acquires reaction information representing the reactions of a plurality of viewers at least during the playing of the first video data;

[0011] The switching decision unit determines the second video data to be distributed after the first video data according to the response information.

[0012] Other problems of the present application and solutions thereof will be shown by the inventive embodiments and the accompanying drawings described later. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Other features, purposes and advantages of the present disclosure will become more apparent through the following detailed description of non-limiting embodiments in conjunction with the accompanying drawings. In the accompanying drawings:

[0014] Figure 1 A structural diagram of a video distribution system according to an embodiment of the present disclosure is shown.

[0015] Figure 2 The hardware structure diagram of the distributor device 3 is shown as follows:

[0016] Figure 3 A block diagram showing the software structure of the distributor device 3

[0017] Figure 4 A structural block diagram of the video library 331 is shown.

[0018] Figure 5 A structural block diagram of the scene storage unit 332 is shown.

[0019] Figure 6 A structural block diagram of the condition storage unit 333 is shown.

[0020] Figure 7 A block diagram showing the structure of the comment storage unit 334 is shown.

[0021] Figure 8 The flowchart shows the process performed by the video distribution system according to the embodiment of the present disclosure.

[0022] Fig. 9 An explanatory diagram showing an example of a screen displayed on a user terminal.

[0023] Fig.10 A structural diagram of a video distribution system according to an embodiment of the present disclosure is shown.

[0024] Fig.11 The hardware structure diagram of the distributor device 3 is shown as follows:

[0025] Fig.12 A block diagram showing the software structure of the distributor device 3

[0026] Fig.13 A structural block diagram of the material library 331 is shown.

[0027] Fig.14 A structural block diagram of the behavior storage unit 333 is shown.

[0028] Fig.15 A block diagram showing the structure of the active storage unit 334 is shown.

[0029] Fig.16 The flowchart shows the process performed by the video distribution system according to the embodiment of the present disclosure.

[0030] Fig.17 A structural diagram of the music distribution system according to the present embodiment is shown.

[0031] Fig.18 A block diagram showing the hardware structure of the distributor device 3.

[0032] Fig.19 A block diagram showing the software structure of the distributor device 3

[0033] Fig. 20Shows a structural block diagram of the music library.

[0034] Fig.21 A block diagram showing the structure of the playlist storage unit 332 is shown.

[0035] Fig. 22 A structural block diagram of the condition storage unit 333 is shown.

[0036] Fig.23 A block diagram showing the structure of the comment storage unit 334 is shown.

[0037] Fig.24 A flowchart showing the processing performed by the music distribution system of this embodiment.

[0038] Fig.25 An explanatory diagram showing an example of a screen displayed on a user terminal.

[0039] Fig.26 A structural diagram of a video distribution system according to an embodiment of the present disclosure is shown.

[0040] Fig. 27 The hardware structure diagram of the distributor device 3 is shown as follows:

[0041] Fig.28 A block diagram showing the software structure of the distributor device 3

[0042] Fig.29 A structural block diagram of the video library 331 is shown.

[0043] Fig.30 A structural block diagram of the scene storage unit 332 is shown.

[0044] Fig.31 A structural block diagram of the condition storage unit 333 is shown.

[0045] Fig.32 A block diagram showing the structure of the comment storage unit 334 is shown.

[0046] Fig.33 A block diagram showing the structure of the user information storage unit 335 is shown.

[0047] Fig.34 The flowchart shows the process performed by the video distribution system according to the embodiment of the present disclosure.

[0048] Fig.35 An explanatory diagram showing an example of a screen displayed on a user terminal.

[0049] Fig.36 A structural diagram of a video distribution system according to an embodiment of the present disclosure is shown.

[0050] Fig.37 The hardware structure block diagram of the user terminal 1 is shown.

[0051] Fig.38 A block diagram showing the hardware structure of the distributor device 3.

[0052] Fig.39 A block diagram showing the software structure of the distributor device 3

[0053] Fig.40 A structural block diagram of the material library 331 is shown.

[0054] Fig.41 A structural block diagram of the behavior storage unit 333 is shown.

[0055] Fig.42 A block diagram showing the structure of the active storage unit 334 is shown.

[0056] Fig.43 The flowchart shows the process performed by the video distribution system according to the embodiment of the present disclosure.

[0057] Fig.44 A structural diagram of a video distribution system according to an embodiment of the present disclosure is shown.

[0058] Fig.45 The hardware structure diagram of the distributor device 3 is shown as follows:

[0059] Fig.46 A block diagram showing the software structure of the distributor device 3

[0060] Fig.47 A structural block diagram of the material library 331 is shown.

[0061] Fig.48 A structural block diagram of the behavior storage unit 333 is shown.

[0062] Fig.49 A block diagram showing the structure of the active storage unit 334 is shown.

[0063] Fig.50 A block diagram showing the structure of the group condition storage unit 335 is shown.

[0064] Fig.51 A block diagram showing the structure of the group storage unit 336 is shown.

[0065] Fig.52 The flowchart shows the process performed by the video distribution system according to the embodiment of the present disclosure.

[0066] Fig.53 A diagram is shown to explain the process of grouping viewers in accordance with the present embodiment.

[0067] Fig.54 This figure shows an example of a viewing screen 50 of the video distribution system according to the present embodiment.

[0068] Fig.55 A structural diagram of a video distribution system according to an embodiment of the present disclosure is shown.

[0069] Fig.56 A block diagram showing the hardware structure of the distributor device 3.

[0070] Fig.57 A block diagram showing the software structure of the distributor device 3

[0071] Fig.58 A structural block diagram of the material library 331 is shown.

[0072] Fig.59 A structural block diagram of the behavior storage unit 333 is shown.

[0073] Fig.60 A block diagram showing the structure of the active storage unit 334 is shown.

[0074] Fig.61 A block diagram showing the structure of the group condition storage unit 335 is shown.

[0075] Fig.62 A block diagram showing the structure of the group storage unit 336 is shown.

[0076] Fig.63 The flowchart shows the process performed by the video distribution system according to the embodiment of the present disclosure.

[0077] Fig.64 Flowchart showing the execution process of action behavior

[0078] Fig.65 A diagram is shown to explain the process of grouping viewers in accordance with the present embodiment.

[0079] Fig.66 An example diagram of the viewing screen 50 is shown. DETAILED DESCRIPTION

[0080] <First embodiment>

[0081] The video distribution system according to the first embodiment may have the following configuration.

[0082] [Project 1]

[0083] A video distribution system, comprising:

[0084] A video library, storing multiple video data;

[0085] A video distribution unit, which distributes the video data;

[0086] A reaction acquisition unit, which acquires reaction information showing the reactions of a plurality of viewers at least during the playing of the first video data;

[0087] The switching decision unit determines the second video data to be distributed after the first video data according to the response information.

[0088] [Project 2]

[0089] The video distribution system according to item 1 is characterized by comprising:

[0090] The video distribution unit sends the first video data to a video distribution server that distributes the video data to a user terminal of each viewer;

[0091] The plurality of user terminals transmit the comments input by the viewers to the video distribution server;

[0092] The reaction acquisition unit acquires the comment as the reaction information from the video distribution server;

[0093] The switching decision unit determines to distribute the second video data based on the number of specific words included in the comments and / or based on the number of viewers who have posted the comments containing the specific words.

[0094] [Item 3]

[0095] The video distribution system according to item 1 is characterized by further comprising:

[0096] A scene storage unit for storing information of the video data to be distributed after each of the video data;

[0097] A condition storage unit for storing the condition of the reaction information and the information for distributing the video data in the next step;

[0098] When the reaction information meets the condition, the switching decision unit will determine that the video data to be distributed after the first video data corresponding to the condition met by the reaction information is the second video data. When the reaction information does not meet the condition, the switching decision unit will determine from the scene storage unit that the video data to be distributed after the first video data is the second video data.

[0099] The following will describe the video distribution system of the first embodiment. The video distribution system of the first embodiment dynamically changes the development of the video (story, story, plot, etc.) according to the reaction of the audience watching the streaming video. In the first embodiment, the reaction of the video refers to the comments made by the audience while watching the video. That is, the video will change the playback of the video due to the content of the audience's comments. For example, when there are two characters (roles) appearing in the video, the story can branch to the story of the character who made the most comments as the main story. The following will explain in detail.

[0100] Figure 1 The video distribution system of the first embodiment is shown in the block diagram. The video distribution system of the first embodiment includes a distributor device 3, wherein the distributor device 3 and the streaming media server 2 are connected to each other via a network, and the streaming media server 2 and the user terminal 1 are connected to each other via a network.

[0101] The distributor device 3 is a computer having a function of distributing videos, such as a personal computer, a tablet computer, a smart phone, etc.

[0102] The distributor device 3 can be, for example, a home computer used by an ordinary user who wants to distribute videos. The video data can be sent from the distributor device 3 to the streaming media server 2 using a streaming media method.

[0103] The streaming media server 2 is, for example, a workstation, a personal computer, a virtual computer provided by cloud computing, or the like. The streaming media server 2 distributes the video data received from the distributor device 3 to the user terminal 1.

[0104] The streaming media server 2 can distribute video data to a plurality of user terminals 1 simultaneously.

[0105] The user terminal 1 is a computer operated by the viewer, such as a personal computer, a tablet computer, a smart phone or the like.

[0106] Viewers can operate the user terminal 1 to access the streaming server 2 , and the user terminal 1 can receive and play the video data distributed from the streaming server 2 .

[0107] Furthermore, the viewer can operate the user terminal 1 to distribute the video comments to the streaming server 2. The streaming server 2 transmits the video data and the comment data to the user terminal 1. Therefore, the user terminal can display the comments on the video while playing the video.

[0108] The video described below that is distributed through streaming media and played linearly is called "distributed video". The format of the distributed video can be that the image and sound obtained by the camera and microphone are encoded into video data in real time and sent out. However, in the first embodiment, the distributed video is prepared in advance as component video data (hereinafter referred to as "component video data"), and at the same time, the scene for arranging the component video data is also prepared. That is to say, assuming that the component video data is sent according to the scene, a complete set of distributed videos will be sent.

[0109] Figure 2 1 is a block diagram showing the hardware structure of the distributor device 3. The distributor device 3 includes a CPU 301, a memory 302, a storage device 303, a communication interface 304, an input device 305, and an output device 306.

[0110] The storage device 303 is a device for storing various data and programs, and includes, for example, a hard disk drive, a non-volatile memory, and the like.

[0111] The communication interface 304 is an interface for connecting to the communication network 30, including, for example, an adapter for connecting to Ethernet (registered trademark), a modem for connecting to a public telephone network, a wireless communication device for wireless communication, and a USB (Universal Serial Bus) connector or RS232C connector for serial communication, etc.

[0112] The input device 305 is a device for inputting data, including, for example, a keyboard, a mouse, a touch panel, buttons, a microphone, etc. The output device 306 is a device for outputting data, including, for example, a display, a printer, a speaker, etc.

[0113] Figure 3 The block diagram shows the structure of the software of the distributor device 3. As shown in the figure, the distributor device 3 has a video distribution unit 311, a comment acquisition unit 312, a switching decision unit 313, a video library 331, a scene storage unit 332, a condition storage unit 333, and a comment storage unit 334. The video distribution unit 311, the comment acquisition unit 312, and the switching decision unit 313 are realized by the CPU 301 in the distributor device 3 causing the memory 302 to read and execute the program in the storage device 303. The video library 331, the scene storage unit 332, the condition storage unit 333, and the comment storage unit 334 are realized by providing a part of the storage area of ​​at least one of the memory 302 and the storage device 303 of the distributor device 3.

[0114] The video library 331 stores component video data. The component video data can be saved as a coded file in any format, such as MPEG4, MPEG2, AVI, MOV, etc. Figure 42 is a block diagram showing the structure of the video library 331. As shown in the figure, the video library 331 associates component video data with information (video ID) for identifying the component video data, and stores the component video data.

[0115] The scene storage unit 332 stores scenes of the distribution video. Figure 5 2 is a block diagram showing a structure of the scene storage unit 332. As shown in the figure, the scene storage unit 332 stores scene information and sequence information.

[0116] Scene information is information about the scene. Figure 5 For example, the scene information contains, for example, information for identifying the scene (scene ID), the scene name (title), information indicating the component video data to be played first in the scene (start video ID), and the like.

[0117] Sequence information is information indicating the order in which component videos are played by default in a scene. The sequence information contains a scene ID, a video ID indicating the component video data contained in the scene of the scene ID, and information corresponding to a sub-video ID indicating the component video data played after the component video data of the video ID.

[0118] As described above, in the video distribution system of the first embodiment, the component video data to be played next will be changed according to the reaction (comments) of the audience. However, if the reaction of the audience does not meet the set conditions, the component video data to be played next will be determined according to the default scene of the sequence information.

[0119] Condition storage section 333 stores information on conditions for branching based on viewers' responses (comments) (hereinafter referred to as "condition information"). Figure 6 2 is a block diagram showing the structure of the condition storage unit 333. As shown in the figure, the condition information stored in the condition storage unit 333 includes a scene ID, a judgment period, a condition, and a sub-video ID.

[0120] The scene ID refers to the information of the scene.

[0121] The judgment period is the period for judging whether the viewer's reaction (comment) satisfies the condition. The judgment period can be a relative period, such as from now to 5 minutes ago. The judgment period can also be an absolute period, such as 00:00 to 00:10 on December 25th.

[0122] The distributor device 3 determines the viewer's response during a period of time set within the determination period, that is, determines whether the comments posted by the viewer during this period meet the conditions.

[0123] The conditions are for the reactions of the viewers (comments distributed by the viewers), for example, the number of specified keywords contained in the comments distributed during the above-mentioned period, or the total number of comments or viewers by region among the viewers who distributed the comments, or, for example, the total value (average value, median value, maximum value, minimum value, etc.) of the amount of money invested by the viewers when asking questions in the video. When analyzing the joy, anger, sorrow, and happiness of the viewers based on the comments, when the number of viewers with sad emotions exceeds a specified threshold, when comments containing specified keywords are not posted, etc., can all be conditions.

[0124] The video distribution unit 311 distributes the video. When the video distribution unit 311 receives a designation from a user, the video distribution unit 311 reads scene information of a predetermined scene from the scene storage unit 332 .

[0125] Then, the video distribution unit 311 can read the component video data corresponding to the start video ID in the video library 331 according to the start video ID contained in the scene information (if necessary, it can be encoded or the format of the video can be converted). Then, the video distribution unit 311 can send the read component video data to the streaming media server 2 to distribute the video.

[0126] When the video distribution unit 311 finishes sending the read component video data, the video distribution unit 311 obtains the sub-video ID corresponding to the scene ID and the video ID of the component video data according to the sequence information of the scene storage unit 332. Then, the video distribution unit 311 can read the component video data corresponding to the obtained sub-video ID from the video library 331, and distribute the component video data to the streaming media server 2 in the same manner. When the sub-video ID does not exist, the video distribution unit 311 can terminate the distribution of the video.

[0127] When the switching decision unit 313 determines the secondary video ID, the video distribution unit 311 can interrupt the distribution of the component video data in progress, and then the video distribution unit 311 reads the component video data according to the secondary video ID determined by the switching decision unit 313 and sends it to the streaming server 2. This can change the story.

[0128] The comment storage unit 334 stores comments distributed by viewers.

[0129] Figure 7 The block diagram of the comment storage unit 334 is shown. The comment storage unit 334 associates comments with information (comment ID) for identifying the comments. The comment storage unit 334 can store the comments, the viewer ID of the viewer who distributed the comments, the date and time when the comments were distributed, and the content of the comments.

[0130] The comment acquisition unit 312 acquires comments distributed by the viewer operating the user terminal 1. For example, when the streaming server 2 provides an API for acquiring distributed comments, the comment acquisition unit 312 can acquire distributed comments via the API. The comment acquisition unit 312 can register the acquired comments in the comment storage unit 334.

[0131] The switching decision unit 313 determines whether to switch the video. The switching decision unit 313 reads and summarizes the comments corresponding to the period in the comment storage unit 334 according to the various condition information stored in the condition storage unit. In addition, the switching decision unit 313 determines whether the condition is satisfied. If the condition is satisfied, the switching decision unit 313 instructs the video distribution unit 311 to send the component video data corresponding to the sub-video ID of the condition information.

[0132] Figure 8 A flowchart showing the process executed by the video distribution system according to the first embodiment of the present disclosure.

[0133] The video distribution unit 311 receives the designation of a scene (S421), and sets the start video ID included in the scene information of the designated scene as the playback ID (S422).

[0134] The video distribution unit 311 reads the component video data corresponding to the play ID from the video library 331 (S423), and sends the read component video to the streaming server 2 (S424). This enables the streaming server 2 to distribute the video to each user terminal 1 in a streaming manner.

[0135] The comment acquisition unit 312 acquires the comments distributed by the viewer using the user terminal 1 from the streaming server 2 (S425). The acquisition of the comments can be realized, for example, via an API provided by the streaming server 2.

[0136] The switching decision section 313 reads the comments distributed during the judgment period from the comment storage unit 334 according to the respective condition information in the condition storage unit 333 (S426), and determines whether the read comments have conditions satisfying the condition information (S427).

[0137] Whether the comment meets the conditions can be determined by calculating the number of each keyword included in the comment and determining whether the number exceeds a predetermined threshold.

[0138] When the comment meets the condition (S428: YES), the switching decision unit 313 sets the sub-video ID contained in the condition information as the playback ID (S429), returns to step S423, and the video distribution unit 311 distributes the component video data corresponding to the playback ID. In this way, the flow of component video data can be changed according to the comment.

[0139] When the comment does not satisfy the conditions of all the condition information, when the video being played ends (S430: YES), the switching decision unit 313 sets the sub-video ID of the sequence information as the play ID (S431).

[0140] When the sub video ID is set in the sequence information (S432: YES), the process returns to step S423, and the video distribution unit 311 sends the component video data corresponding to the playback ID. Otherwise, when the sub video ID is not set in the sequence information (S432: NO), the process is terminated.

[0141] Fig. 9 An explanatory diagram showing an example of a screen displayed on a user terminal. Fig. 9 As shown in (a), the video data distributed from the streaming server 2 enables the user terminal 1 to display the video 511, and also displays the comments 512 distributed by the user terminal 1 or other user terminals 1.

[0142] exist Fig. 9 In the example (a), two characters are shown (Ai-chan and Megu-chan). Regarding the characters, the comments 512 posted include comments such as "Ah! It's Ai-chan!" and "Go Megu-chan!"

[0143] Here, if the condition storage 333 contains the condition information of the word "call Ai-chan" as the condition, it will be displayed as follows Fig. 9 (b) shows video 513. Since the word Fig. 9 (a) has been posted, so video 513 will be displayed later.

[0144] If, in Fig. 9 (b) If the comment does not contain the phrase "call Ai-chan", it will be Fig. 9 In (c), video 514 of the sub-video ID of the sequence information is displayed.

[0145] As described above, the video distribution system of the first embodiment can provide linear video to the user terminal 1 because the streaming server 2 continuously sends component video data.

[0146] At the same time, when playing component video data, the next component video data to be played can be determined based on the comments of the viewers.

[0147] Therefore, linear videos with different developments can be provided to viewers according to their responses.

[0148] Therefore, even if recorded component video data is used, the video can be distributed in a linear manner without losing the live broadcast feeling.

[0149] The video distribution system of the first embodiment is described above. The above embodiment is only for the convenience of understanding the present invention and is not limited to the technical solution formed by a specific combination of the above technical features. The present invention can be modified and improved without departing from its intention, and the present invention includes its equivalent technical solutions.

[0150] For example, in this embodiment, the video sent by the distributor device 3 is distributed to the user terminal 1 via the streaming server 2. However, the video can also be distributed directly from the distributor device 3 to each user terminal 1.

[0151] In this embodiment, the video library 331 stores video files encoded in a format such as MPEG4, however, the video library 331 may also store 3D models or scene files, and may send out dynamic rendering videos based on the 3D models or scene files.

[0152] In this embodiment, even when playing component video data, if the comment meets the conditions, it will switch to the next component video data ( Figure 8 Steps S428→S429→S423), however, not only that, the component video data can be played to the end and then transferred to the next component video data.

[0153] In this case, Figure 8 Before or after step S429, a step of confirming whether the component video data has been played can be set.

[0154] In the present embodiment, component video data is switched based on comments distributed by viewers (or keywords included in the comments). However, component video may be switched based on responses of any viewers obtained from the user terminal 1 .

[0155] For example, when a viewer clicks or touches a specific area of ​​the screen of the distributed video played by the user terminal 1, the comment acquisition unit 312 acquires the event as information. Then, the switching decision unit 313 can calculate the number of events (that is, the number of viewers who click or touch a specific area on the distributed video), and determine whether the number exceeds a threshold to decide whether to switch the component video data.

[0156] In this case, a threshold value of the number of viewers who click or touch a predetermined area on the distributed video and a video ID of the component video data to be switched according to the area may be registered as conditional information.

[0157] When a viewer watches a distributed video via a web browser on the user terminal 1, the click activity generated by the web browser is sent to the streaming server 2 or the distributor device 3.

[0158] Then, the comment acquisition unit 312 can acquire the click event directly or through the streaming server 2, and the click event can be stored in the comment storage unit 334.

[0159] In this case, the comment acquisition unit 312 may be an activity acquisition unit that not only acquires comments but also acquires various activities. In this case, the comment storage unit 334 may be an activity storage unit that not only stores comments but also stores various activities.

[0160] Furthermore, the activity acquisition unit receives the sound data obtained from the user terminal and analyzes the received sound data. When the sound data contains a specific pronunciation, the activity acquisition unit regards the pronunciation as an activity and acquires it. At this time, the switching decision unit 313 switches the video according to the activity.

[0161] In this case, under the premise that a specific pronunciation is a condition, it is possible to register that various types of pronunciations set different sub-video IDs as condition information in the condition storage unit 333.

[0162] Furthermore, the sound may be analyzed in the user terminal 1, and then the activity acquisition unit may receive the analyzed result.

[0163] In addition, the activity acquisition unit may receive image data captured by the user terminal 1, analyze the received image data to identify the posture, gaze, gestures, etc. of the viewer, and use these as activities. Then, the switching decision unit 313 may switch the video according to these activities.

[0164] In this case, under the premise of specific posture, sight line, and hand gesture as conditions, different sub-video IDs can be registered for various types of postures, gestures, and sight line positions as condition information in the condition storage unit 333. In addition, the image can also be parsed in the user terminal 1, and then the activity acquisition unit can receive the parsed result.

[0165] Furthermore, the activity acquisition unit does not need to acquire activities from the user terminal 1, for example, it can also acquire activities on the system.

[0166] The activities that can be obtained on the system include, for example, the elapsed time when the animation was distributed, the current time, the collision of objects that occurred during the distribution of the animation, the location of the viewer or distributor, and the weather conditions of the area set in advance.

[0167] The switching decision unit 313 may also perform switching animation according to these activities.

[0168] <Second embodiment>

[0169] The video distribution system according to the second embodiment may have the following structure.

[0170] [Project 1]

[0171] A video distribution system, comprising:

[0172] Material library, storing material data for generating videos;

[0173] A video distribution unit, which sends the video according to the material data;

[0174] a reaction acquisition unit, which acquires reaction information showing the reactions of the plurality of viewers during the playing of the video data;

[0175] The behavior processing unit operates the material data corresponding to the reaction information.

[0176] [Project 2]

[0177] The video distribution system according to item 1 is characterized by comprising:

[0178] The reaction acquisition unit acquires activities occurring in the video distribution system;

[0179] The behavior processing unit operates the material data corresponding to the activity.

[0180] [Item 3]

[0181] The video distribution system according to item 1 is characterized in that the reaction of the viewer includes at least one of the following:

[0182] The viewer's operation on the terminal, the voice and text input by the viewer, the image of the viewer, the viewer's posture, or / and gaze and gesture analyzed from the image, and the measurement data generated when measuring the viewer's physical reaction.

[0183] [Item 4]

[0184] The video distribution system according to item 1 is characterized in that the action behavior includes at least one of the following:

[0185] The appearance, movement and disappearance of objects, the start and stop of animation, the play and stop of video, the play and stop of audio, and the replacement of the material data.

[0186] Hereinafter, a video distribution system according to a second embodiment will be described. The video distribution system according to the second embodiment is a system that dynamically changes the video to be distributed in a streaming manner according to various activities.

[0187] The activities include information about the viewer (hereinafter referred to as user activity information), such as the viewer operating a device, inputting voice or text of the viewer, photographing the viewer, obtaining posture, line of sight, or gesture analyzed from the photographed image, obtaining measurement data measuring the viewer's physical reaction, etc.

[0188] In addition, the activity may also include information obtained by the system, such as the number of viewers watching, weather, time, contact conditions of objects in the video, etc. (hereinafter referred to as system activity information).

[0189] The distributed video is generated based on the material data of the video. The material data is, for example, a 3D model, video data, audio data, etc. Each material data can be set according to the action behavior of the activity.

[0190] Actions refer to operations on material data. Actions can include the appearance, movement, or elimination of objects represented by 3D models, the start and end of animations, the play and stop of videos, the play and stop of sounds, and the replacement (replacement) of material data.

[0191] In the second embodiment, the distributed video may be a video or image synthesized as a result of an action or behavior.

[0192] In the video distribution system of the second embodiment, the distributed video can be dynamically changed by activating and performing actions. The details are as follows.

[0193] Fig.10 A configuration diagram of a video distribution system according to a second embodiment is shown.

[0194] The video distribution system of the second embodiment further includes a distributor device 3. The distributor device 3 is connected to the streaming server 2 for communication, and the streaming server 2 is connected to the user terminal 1 for communication. A plurality of user terminals 1 can be connected to each other for communication.

[0195] The streaming media server 2 is, for example, a workstation, a personal computer, a virtual computer provided by cloud computing, or the like. The streaming media server 2 distributes the video data received from the distributor device 3 to the user terminal 1.

[0196] The streaming media server 2 can distribute video data to one or more user terminals 1 at the same time.

[0197] The user terminal 1 is a computer operated by the viewer, such as a personal computer, a tablet computer, a smart phone, etc. The viewer can operate the user terminal 1 to access the streaming server 2, and the user terminal 1 can receive and play the video data distributed from the streaming server 2. The user terminal 1 can also collect various activity information, such as taking photos of the viewer, recording the viewer's voice, and accepting comments entered by the viewer.

[0198] The streaming server 2 obtains the activities of one or more viewers. The distributor device 3 can obtain the activities of viewers via, for example, an API provided by the streaming server 2.

[0199] The video described below that is distributed through streaming media and played linearly is referred to as "distributed video". The format of the distributed video can be that the image and sound obtained by the camera and microphone are encoded into video data in real time and sent out. However, in the second embodiment, the distributed video can be image data generated by combining and synthesizing material data.

[0200] Fig.11 2 shows a block diagram of the hardware structure of the distributor device 3. The distributor device 3 has a CPU 301, a memory 302, a storage device 303, a communication interface 304, an input device 305, and an output device 306.

[0201] The storage device 303 is a device for storing various data and programs, and includes, for example, a hard disk drive, a non-volatile memory, and the like.

[0202] The communication interface 304 is an interface for connecting to the communication network 30, including, for example, an adapter for connecting to Ethernet (registered trademark), a modem for connecting to a public telephone network, a wireless communication device for wireless communication, and a USB (Universal Serial Bus) connector or RS232C connector for serial communication, etc.

[0203] The input device 305 is a device for inputting data, including, for example, a keyboard, a mouse, a touch panel, buttons, a microphone, etc. The output device 306 is a device for outputting data, including, for example, a display, a printer, a speaker, etc.

[0204] Fig.12The block diagram shows the structure of the software of the distributor device 3. As shown in the figure, the distributor device 3 has a video distribution unit 311, an activity acquisition unit 312, a behavior processing unit 313, a material library 331, a behavior storage unit 333, and an activity storage unit 334. Moreover, the video distribution unit 311, the activity acquisition unit 312, and the behavior processing unit 313 are implemented by the CPU 301 in the distributor device 3 causing the memory 302 to read and execute the program in the storage device 303.

[0205] The material library 331, the scene storage unit 334, and the behavior storage unit 333 are implemented by providing a portion of the storage area of ​​at least one of the memory 302 and the storage device 303 of the distributor device 3. The material library 331 stores various types of data (material data) that can be included in the video. The material data includes, for example, 3D models, static images, animations, sound data, MIDI data, character data, etc. Fig.13 2 is a block diagram showing the structure of the material library 331. As shown in the figure, the material library 331 provides information (material ID) for identifying a material and stores various material data.

[0206] The behavior storage unit 333 stores operation (action behavior) information (hereinafter referred to as behavior information) on material data. Fig.14 An example of the behavior information stored in the behavior storage unit 333 is shown.

[0207] As shown in the figure, the behavior information includes the behavior ID indicating the action behavior, the judgment period, the condition, and the action behavior.

[0208] The determination period refers to the period information for determining whether the activity meets the conditions. The determination period can be a relative period, such as from now to 5 minutes ago. The determination period can also be an absolute period, such as 00:00 to 00:10 on December 25th.

[0209] The condition may be activity-specific, for example, whether an activity exists, or whether the total value of activities from a plurality of viewers exceeds a threshold.

[0210] For user activity information, for example, whether the viewer presses a specific button while playing the video, whether the viewer clicks a designated area on the screen, whether the number of viewers who click or touch the video exceeds a threshold, etc. can all be conditions.

[0211] Furthermore, based on the material data used to generate the distributed video, whether an object displayed in the distributed video has been clicked or touched, and whether the number of viewers who clicked or touched the object exceeded a threshold can also be used as conditions.

[0212] In addition, whether the viewer has input specified characters (keywords) at the user terminal 1 can also be used as a condition. For example, whether the comments on the distributed video contain specified keywords, or whether the number of viewers who input keywords exceeds a threshold can also be used as a condition.

[0213] In addition, the total number of comments or viewers by region among the viewers who distributed the comments, for example, the total value (average, median, maximum, minimum, etc.) of the amount of money invested by viewers when asking questions in the video, when analyzing the viewers' emotions based on the comments, when the number of viewers with sad emotions exceeds a specified threshold, when comments containing specified keywords have not been posted, etc., can all be used as conditions.

[0214] Furthermore, the atmosphere or emotions of the audience obtained by performing speech recognition analysis can also be used as a condition. For example, whether the audience makes a specific sound, such as clapping, whistling, or stomping, or whether the number of audiences making these sounds exceeds a threshold.

[0215] In this case, speech recognition may be performed by the user terminal 1, and then the recognition result may be sent to the streaming server 2 or the distributor device 3. Either the speech data captured by the user terminal 1 is transmitted via the streaming server 2 to the distributor device 3, or the speech data is directly sent from the user terminal 1 to the distributor device 3, and then the distributor device 3 performs speech recognition.

[0216] In addition, conditions may also be used to determine whether such images are distributed to the streaming server 2, based on the viewer's self-portrait image in the user terminal 1 or the viewer's atmosphere in the image, and whether the number of viewers to whom the image is distributed exceeds a threshold.

[0217] Furthermore, through image analysis, whether an image of a predetermined object (for example, an image of a specific signboard or flyer around the viewer) has been posted, or whether the number of viewers who have posted the image exceeds a threshold value may be used as a condition.

[0218] In addition, information (viewer's posture, line of sight, gesture) recognized by analyzing the image can also be used as a condition. For example, whether the viewer is posing in a specific posture, directing a specific line of sight, making a specific gesture, or whether the number of viewers making the above gestures exceeds a threshold can also be used as a condition.

[0219] In this case, the image analysis can be performed by the user terminal 1, and then the recognition result can be sent to the streaming server 2 or the distributor device 3. Or the image data captured by the user terminal 1 is transmitted to the distributor device 3 via the streaming server 2, or the image data is directly sent from the user terminal 1 to the distributor device 3, and then the distributor device 3 is caused to perform the image analysis.

[0220] Furthermore, for system activity information, for example, whether the number of viewers who watch the distributed image exceeds a threshold may be used as a condition.

[0221] Furthermore, the playback time of the distributed image may be used as a condition, such as the elapsed time from the start of playback to the stop of playback.

[0222] In addition, when the location of the viewer or distributor and the weather in the area are obtained as system activity information, the weather can also be used as a condition, such as sunny days, rainy days, snowy days, a certain wind intensity, a certain temperature, etc.

[0223] Also, when the material data is a 3D model, collision of objects in the distribution video can also be used as a condition.

[0224] Actions are various operations on the material data. Actions can contain parameters so that the material data can be set in detail to perform specific operations.

[0225] Then, in the second embodiment, the action behavior can not only operate the material data, but also start and stop other action behaviors, and wait for other action behaviors to complete their execution. The action behavior is, for example, a program written in a scripting language and can also be saved.

[0226] The video distribution unit 311 distributes the video. A single action behavior may also be performed as a plurality of action behaviors. The video distribution unit 311 may generate a distribution video by synthesizing the action behavior (and encoding it if necessary) by the action processing unit 313 described later.

[0227] Also, the video delivery unit 311 can deliver the video to the user terminal 1 by sending the generated delivery video to the streaming server 2.

[0228] The activity storage unit 334 stores various activities that have occurred. Fig.15 A block diagram showing the structure of the active storage unit 334 is shown.

[0229] As described above, the activity storage unit 334 stores user activity information and system activity information.

[0230] Hereinafter, user activity information and system activity information are collectively referred to as activity information. User activity information includes an activity ID indicating an activity, a viewer ID indicating a viewer related to the activity, the time point at which the activity occurred, and the content of the activity. System activity information includes an activity ID, the time point at which the activity occurred, and the content of the activity.

[0231] The content of the activity may vary depending on the activity. For example, in the case of user activity information, when a viewer comments on a distributed video, the comment may be set as the content of the activity.

[0232] In addition, when analyzing the viewer image captured by the user terminal 1, the viewer's line of sight and the viewer's gesture, the information indicating the line of sight or gesture may be set as the activity content. In the case of system activity information, the number of viewers, weather, time point, etc. may be set as the activity content.

[0233] The activity acquisition unit 312 acquires an activity, and registers the acquired activity content in the activity storage unit 334 as activity information.

[0234] The type of activity to be acquired can be set by the user. Setting information indicating the type of activity to be acquired can be stored in, for example, the memory 302 or the storage device 303.

[0235] The activity acquisition unit 312 may register, for example, a key press, a touch, or a click input by the viewer as user activity information.

[0236] For example, when viewers use a web browser to watch a distributed video, a script is set in advance to send the click activity that occurs on the web browser to the streaming server 2 or the distributor device 3. In this way, the activity acquisition unit 312 can obtain the click activity via the streaming server 2, or directly obtain the click activity.

[0237] Also, the activity acquisition unit 312 can, for example, obtain the comments distributed by the viewer by calling the API when the streaming server 2 provides an API for obtaining distributed comments. In addition, the activity acquisition unit 312 can parse the comments and register the comments containing the specified keywords as user activity information.

[0238] In addition, the activity acquisition unit 312 may, for example, receive acquired voice data from the user terminal 1 , and analyze the received voice data to register a specific utterance as user activity information.

[0239] The sound may be analyzed at the user terminal 1 , and the activity acquisition unit 312 may receive the analysis result directly from the user terminal 1 or via the streaming media server 2 , and register the analysis result as user activity information.

[0240] The activity acquisition unit 312 may also receive a captured viewer image from the user terminal 1 and analyze the received image to acquire the viewer's posture, sight line, and gesture. In addition, the image may also be analyzed at the user terminal 1, and the activity acquisition unit 312 may receive the analysis result.

[0241] The activity acquisition unit 312 may also periodically count the number of viewers and register the number in the system activity information. In addition, the image may be analyzed at the user terminal 1, and the activity acquisition unit 312 may also receive the analysis result directly from the user terminal 1 or via the streaming media server 2, and register the analysis result as the user activity information.

[0242] For example, it is pre-set that the timeout activity can be obtained from the clock, and in this case, the activity acquisition unit 312 can register the time from the start of playing the distributed video to the time when the specified time has passed as the system activity information. In addition, the activity acquisition unit 312 can also register the specified time point (for example, the time point when the date is changed, or 3 o'clock in the afternoon, etc.) as the system activity information.

[0243] Also, the activity acquisition unit 312 may acquire weather information from, for example, a server of a weather company, and register weather elements of a specific area (eg, the location of each viewer or distributor, or a predetermined area) as system activity information.

[0244] Also, for example, when the material data is a 3D model, the activity acquisition unit may register system activity information that has determined the collision of objects in the distributed video as information.

[0245] The behavior processing unit 313 performs action behaviors on the material data. The behavior processing unit 313 receives the action behavior to be performed first and performs it. Since the action behavior also has the possibility of activating other action behaviors, in this case, the behavior processing unit 313 can continue to perform the action behaviors in sequence. In addition, the action behaviors can also be branched and executed in parallel.

[0246] In addition, the behavior processing unit 313 executes the action behavior corresponding to the activity. The behavior processing unit 313 counts the activity information of the corresponding period in the activity storage unit 334 for the behavior information stored in the behavior storage unit 333, and determines whether the conditions are met. If the conditions are met, the behavior processing unit 313 will execute the action behavior set in the behavior information. Therefore, the development of the video can be dynamically changed according to the activity.

[0247] Fig.16 The flowchart shows the process performed by the video distribution system according to the embodiment of the present disclosure.

[0248] The behavior processing unit 313 receives the instruction of the action behavior to be performed first (S421), and performs the specified action behavior (S422). As a result of performing the action behavior, the output image and sound will be synthesized into video data. Then, the video distribution unit 311 will send the video data to the streaming media server 2.

[0249] The activity acquisition unit 312 will periodically acquire activities (S423). For example, the activity acquisition unit 312 can acquire comments on the distributed video by calling an API provided by the streaming server 2. In addition, the activity acquisition unit 312 can use a timer function to acquire comments distributed after a predetermined time.

[0250] For each activity information stored in the activity storage unit 333, the activity processing unit 313 reads the activity information including the time point of the determination period from the activity storage unit 334 (S424). Then, the behavior processing unit 313 determines whether the activity content of the read activity information satisfies the condition of the behavior information (S425).

[0251] If the activity satisfies the conditions (S426: YES), the behavior processing unit 313 executes the action behavior included in the behavior information (S427).

[0252] Here, the activity processing unit 313 may stop the previously executed action behavior, or execute the previous action behavior and the new action behavior in parallel, or specify these action behaviors in the new action behavior.

[0253] If the action behavior of the behavior information does not terminate the distribution of the video (S428), then the process returns to step S423 for processing.

[0254] As described above, the video distribution system according to the second embodiment distributes videos to the user terminal 1 via the streaming server 2 and can change the distributed video being played in response to various events during the playback of the distributed video.

[0255] Therefore, while using the recorded video, various distribution videos can be developed based on the audience's response, and the distribution of videos in the streaming mode will not lose the sense of presence.

[0256] The video distribution system of the second embodiment is described above. The above embodiment is only for the convenience of understanding the present invention and is not limited to the technical solution formed by a specific combination of the above technical features. The present invention can be modified and improved without departing from its intention, and the present invention includes its equivalent technical solutions.

[0257] For example, in this embodiment, the video sent by the distributor device 3 is distributed to the user terminal 1 via the streaming server 2. However, the video can also be distributed directly from the distributor device 3 to each user terminal 1.

[0258] Also, in the embodiment of the present invention, even if the video is playing, as long as the comment meets the conditions, it will migrate to the next component video data ( Fig.16Step S427). However, it is not limited thereto, and the next action behavior may be executed after the action behavior being executed is completed.

[0259] <Third embodiment>

[0260] The music distribution system according to the third embodiment has the following structure.

[0261] [Project 1]

[0262] A music library storing multiple music data, including:

[0263] A music distribution unit, which distributes the music data;

[0264] A reaction acquisition unit, which acquires reaction information showing the reactions of a plurality of viewers and listeners at least during the period of playing the first music data;

[0265] The switching decision unit determines the second music data to be distributed after the first music data according to the response information.

[0266] [Project 2]

[0267] The music distribution system according to item 1 is characterized by comprising:

[0268] The music distribution unit sends the first music data to a music distribution server that distributes the music data to a user terminal of each viewer;

[0269] The plurality of user terminals transmit the comments input by the viewers to the music distribution server;

[0270] The reaction acquisition unit acquires the comment as the reaction information from the music distribution server;

[0271] The switching decision unit determines to distribute the second video data according to the number of specific words included in the comment.

[0272] [Item 3]

[0273] The music distribution system according to item 1 is characterized by further comprising:

[0274] A scene storage unit storing information of the music data to be distributed after each of the music data;

[0275] a condition storage unit storing the condition of the reaction information and the information that the music data will be distributed in the next step;

[0276] When the reaction information meets the condition, the switching decision unit will determine that the music data to be distributed after the first music data corresponding to the condition met by the reaction information is the second music data. When the reaction information does not meet the condition, the switching decision unit will determine from the scene storage unit that the music data to be distributed after the first music data is the second music data.

[0277] The video distribution system of the third embodiment will be described below. The music distribution system of the third embodiment dynamically changes the next music to be played based on the reaction of the viewer who is listening to the streaming music. In the third embodiment, the reaction to the music refers to the comments made by the viewer while listening to the music. That is, while the music is playing, the next music to be played can be changed based on the comments of the viewer. The change can be only the music, or a video composed of the music and animation. The following will explain in detail.

[0278] Fig.17 A structural diagram of a music distribution system according to a third embodiment is shown.

[0279] The music distribution system of the third embodiment includes a distributor device 3, wherein the distributor device 3 and the streaming media server 2 are connected to each other via a network, and the streaming media server 2 and the user terminal 1 are connected to each other via a network.

[0280] The distributor device 3 is a computer having a function of sending music, such as a personal computer, a tablet computer, a smart phone, etc. The distributor device 3 can be, for example, a home computer used by an ordinary user who wants to distribute music. The music data can be sent from the distributor device 3 to the streaming media server 2 using a streaming media method.

[0281] The streaming server 2 is, for example, a computer such as a workstation, a personal computer, a virtual computer provided by cloud computing, etc. The streaming server 2 distributes the music data received from the distributor device 3 to the user terminal 1. The streaming server 2 can distribute the music data to a plurality of user terminals 1 at the same time.

[0282] The user terminal 1 is a computer operated by the viewer, such as a personal computer, a tablet computer, a smart phone, etc. The viewer can operate the user terminal 1 to access the streaming server 2, and the user terminal 1 can receive and play the music data distributed from the streaming server 2. In addition, the viewer can operate the user terminal 1 to distribute the video comments to the streaming server 2. The streaming server 2 transmits the video data and the comment data to the user terminal 1. Therefore, the user terminal can play the video and display the comments on the video at the same time.

[0283] The following description of videos distributed via streaming as well as played linearly is referred to as "distributed music".

[0284] The format of the distributed music may be that the sound captured by the camera and microphone (or there is an animation containing music, etc.) is encoded in real time as music data and sent out. However, in the third embodiment, the distributed music is prepared in advance by preparing music data as components (hereinafter referred to as "component music data"). The distributed music is considered to be transmitted as a whole, and the music data is prepared in advance as components (hereinafter referred to as "component music data"), and a playlist is prepared in which the component music data is arranged, and the component music data is transmitted according to the playlist.

[0285] Fig.18 1 is a block diagram showing the hardware structure of the distributor device 3. The distributor device 3 includes a CPU 301, a memory 302, a storage device 303, a communication interface 304, an input device 305, and an output device 306.

[0286] The storage device 303 is a device for storing various data and programs, and includes, for example, a hard disk drive, a non-volatile memory, and the like.

[0287] The communication interface 304 is an interface for connecting to the communication network 30, including, for example, an adapter for connecting to Ethernet (registered trademark), a modem for connecting to a public telephone network, a wireless communication device for wireless communication, and a USB (Universal Serial Bus) connector or RS232C connector for serial communication, etc.

[0288] The input device 305 is a device for inputting data, including, for example, a keyboard, a mouse, a touch panel, buttons, a microphone, etc. The output device 306 is a device for outputting data, including, for example, a display, a printer, a speaker, etc.

[0289] Fig.19 The block diagram shows the structure of the software of the distributor device 3. As shown in the figure, the distributor device 3 includes a music distribution unit 311, a comment acquisition unit 312, a switching decision unit 313, a music library 331, a playlist storage unit 332, a condition storage unit 333, and a comment storage unit 334.

[0290] Furthermore, the music distribution unit 311, the comment acquisition unit 312, and the switching decision unit 313 are implemented by the CPU 301 in the distributor device 3 causing the memory 302 to read and execute the program in the storage device 303. The music library 331, the playlist storage unit 332, the condition storage unit 333, and the comment storage unit 334 are implemented by providing a partial storage area of ​​at least one of the memory 302 and the storage device 303 of the distributor device 3.

[0291] The music library stores component music data. The component music data can be saved as an encoded file in any format, such as MP3, MP4, AAC, etc. Fig. 20 The structural block diagram of the music library is shown. As shown in the figure, the music library 331 performs correspondence between component music data and information (music ID) for identifying component music data, and stores the component music data. The music ID can be a file name or an arbitrary value assigned.

[0292] The play list storage unit 332 stores the distribution order (distribution list) in which music is distributed.

[0293] Fig.21 2 is a block diagram showing a structure of the playlist storage unit 332. As shown in the figure, the playlist storage unit 332 stores playlist information and list information.

[0294] The playlist information is information about the playlist. Fig.21 For example, the playlist information is information that corresponds to the distributor ID of a specific distributor and information (scene ID) of a specific playlist. The playlist information includes a playlist name, information indicating the component music data to be played first (start music ID), and the like.

[0295] List information is information indicating the order in which music is played in a playlist by default. The list information includes a playlist ID, a music ID indicating the component music data contained in the playlist of the playlist ID, and information corresponding to a sub-music ID of the component music data played after the component music data of the music ID.

[0296] As described above, in the music distribution system of the third embodiment, the component music data to be played next will be changed according to the reaction (comments) of the audience. However, if the reaction of the audience does not meet the set conditions, the component music data to be played next will be determined according to the default playback order of the list information.

[0297] Condition storage section 333 stores information on conditions for branching based on viewers' responses (comments) (hereinafter referred to as "condition information"). Fig. 22 1 is a block diagram showing the structure of the condition storage unit 333. As shown in the figure, the condition information stored in the condition storage unit 333 includes a playlist ID, a judgment period, a condition, and a sub-music ID. The playlist ID is information indicating a playlist.

[0298] The judgment period is the period for judging whether the viewer's reaction (comment) satisfies the condition. The judgment period can be a relative period, such as from now to 5 minutes ago. The judgment period can also be an absolute period, such as 00:00 to 00:10 on December 25th.

[0299] The distributor device 3 determines the viewer's response during a period of time set within the determination period, that is, determines whether the comments posted by the viewer during this period meet the conditions.

[0300] The conditions are for the reactions of the viewers (comments distributed by the viewers), for example, the number of specified keywords contained in the comments distributed during the above-mentioned period, or the total number of comments or viewers by region among the viewers who distributed the comments, or, for example, the total value (average value, median value, maximum value, minimum value, etc.) of the amount of money invested by the viewers when asking questions while playing music. When analyzing the joy, anger, sorrow, and happiness of the viewers based on the comments, when the number of viewers with sad emotions exceeds a specified threshold, when comments containing specified keywords are not posted, etc., can all be conditions.

[0301] The music distribution unit 311 can distribute music. The music distribution unit 311 can read the playlist information in the playlist storage unit 332 corresponding to the playlist specified by the user.

[0302] Then, the music distribution unit 311 can read the component music data corresponding to the starting music ID in the music library 331 according to the starting music ID contained in the playlist information (if necessary, it can be encoded or the format of the video can be converted). Then, the music distribution unit 311 can send the read component music data to the streaming media server 2 to distribute the music.

[0303] When the music distribution unit 311 finishes sending the read component music data, the music distribution unit 311 obtains the sub-music ID corresponding to the playlist ID and the music ID of the component music data according to the list information of the playlist storage unit 332. Then, the music distribution unit 311 can read the component music data corresponding to the obtained sub-music ID from the music library 331, and distribute the component music data to the streaming media server 2 in the same manner.

[0304] When the secondary music ID does not exist, the music distribution unit 311 can terminate the distribution of music. Since the secondary music ID is determined by the switching decision unit 313 described later, the next music to be distributed may change.

[0305] The comment storage unit 334 stores comments distributed by viewers. Fig.23 The block diagram of the comment storage unit 334 is shown. The comment storage unit 334 associates comments with information (comment ID) for identifying the comments. The comment storage unit 334 can store the comments, the viewer ID of the viewer who distributed the comments, the date and time when the comments were distributed, and the content of the comments.

[0306] The comment acquisition unit 312 acquires comments distributed by viewers operating the user terminal 1. For example, when the streaming server 2 provides an API for acquiring distributed comments, the comment acquisition unit 312 can acquire distributed comments via the API.

[0307] The user terminal 1 may also send the comments directly to the distributor device 3 .

[0308] The comment acquisition unit 312 may register the acquired comments in the comment storage unit 334 .

[0309] The switching decision unit 313 can decide to switch the music. The switching decision unit 313 reads and summarizes the comments corresponding to the period in the comment storage unit 334 according to the various condition information stored in the condition storage unit. Then, the switching decision unit 313 determines whether the condition is satisfied. If the condition is satisfied, the switching decision unit 313 instructs the music distribution unit 311 to send the component music data corresponding to the sub-music ID of the condition information.

[0310] Fig.24 A flowchart showing the processing performed by the music distribution system according to the third embodiment of the present disclosure.

[0311] The music distribution unit 311 receives the designation of a playlist (S421), and sets the start music ID included in the playlist information of the designated playlist as the play ID (S422).

[0312] The music distribution unit 311 reads the component music data corresponding to the play ID from the music library 331 (S423), and then sets the play ID as the sub-music ID of the list information (S424).

[0313] The music distribution unit 311 sends the read component music data to the streaming server 2 (S425). In this way, music can be distributed from the streaming server 2 in a streaming media manner.

[0314] The comment acquisition unit 312 acquires the comments distributed by the viewer using the user terminal 1 from the streaming server 2 (S426). The acquisition of the comments can be realized, for example, via an API provided by the streaming server 2.

[0315] The switching decision section 313 reads the comments distributed during the judgment period from the comment storage unit 334 according to the respective condition information in the condition storage unit 333 (S427), and determines whether the read comments have conditions satisfying the condition information (S428).

[0316] Whether a comment satisfies a condition may be determined by, for example, counting the keywords in the comment and determining whether the number of keywords exceeds a predetermined threshold.

[0317] When the comment satisfies the condition (S429: YES), the switching decision unit 313 can set the sub-music ID included in the condition information as the playback ID (S430).

[0318] The above processing method is used to process the condition information, and finally the sub-music ID of the condition information that meets the conditions will be set as the playback ID.

[0319] If the music data being distributed has not been sent out (S431: NO), the process will return to step S425 and repeat the process.

[0320] When the music data being distributed is sent out (S431: YES), if the music distribution unit 311 has set the music ID as the playback ID (S423: YES), it will repeatedly process from step S423. If the music distribution unit 311 has not set the music ID as the playback ID (or set it to a NULL value) (S431: NO), the music distribution unit 311 will complete the playback of the playlist and complete the processing.

[0321] Fig.25 An explanatory diagram showing an example of a screen displayed on a user terminal.

[0322] Fig.25 (a) is an example of video 511 displayed based on music data distributed by the streaming server 2.

[0323] When the music data is sound data, the video 511 may be replaced by a static image. The video 511 may also be displayed using an image received from a different source.

[0324] Furthermore, comments 512 distributed by the user terminal 1 or distributed by other user terminals 1 are displayed on the screen.

[0325] Here, if the music such as "Fairy Empire" stored in the condition storage unit 333 is included, and the condition information contains the condition that the music has the most submissions among the submissions of more than a certain number, such as Fig.25 For example, if the keyword "Fairy Empire" is the most common in the comments, the following will be distributed: Fig.25 (b) Music from “Empire of the Fairies”.

[0326] Also, if the submitted review does not contain the predetermined music name, or the submitted review does not meet the specified standards, such as Fig.25 (c) The music set by the sub-music ID in the distribution list information will be distributed.

[0327] As described above, the music distribution system of the third embodiment continuously distributes linear videos to the user terminal 1 through the streaming server 2. In addition, the next music to be distributed is dynamically changed according to the comments of the viewers.

[0328] Therefore, linear videos with different developments can be provided to viewers according to their responses.

[0329] Therefore, even if recorded component music data is used, it is possible to distribute the music in a linear manner without losing the live feel.

[0330] The video distribution system of the third embodiment is described above. The above embodiment is only for the convenience of understanding the present invention and is not limited to the technical solution formed by a specific combination of the above technical features. The present invention can be modified and improved without departing from its intention, and the present invention includes its equivalent technical solutions.

[0331] For example, in this embodiment, the music sent by the distributor device 3 is distributed to the user terminal 1 via the streaming media server 2. However, the music can also be distributed directly from the distributor device 3 to each user terminal 1.

[0332] In this embodiment, the music library 331 stores video files encoded in MP3 or other formats. However, the music library 331 may also store

[0333] Music information synthesized from MIDI data or multiple pieces of music is then sent out based on this information, such as dynamic sound or video.

[0334] <Fourth embodiment>

[0335] The video distribution system according to the fourth embodiment has the following configuration.

[0336] [Project 1]

[0337] A video library that stores multiple video data, including:

[0338] A video reaction acquisition unit, which acquires reaction information of one or more viewers according to a priority order at least during the playing of the first video data;

[0339] The switching decision unit determines the second video data to be distributed after the first video data according to the response information.

[0340] [Project 2]

[0341] The video distribution system according to item 1 is characterized by comprising:

[0342] The video distribution unit sends the first video data to a video distribution server that distributes the video data to a user terminal of each viewer;

[0343] One or more of the user terminals transmit the comments input by the viewer to the video distribution server;

[0344] The reaction acquisition unit acquires the comment as the reaction information from the video distribution server;

[0345] The switching decision unit determines the second video data according to the comment.

[0346] [Item 3]

[0347] The video distribution system according to item 1 is characterized by further comprising:

[0348] A scene storage unit for storing information of the video data to be distributed after each of the video data;

[0349] A condition storage unit for storing the condition of the reaction information and the information for distributing the video data in the next step;

[0350] When the reaction information meets the condition, the switching decision unit will determine that the video data to be distributed after the first video data corresponding to the condition met by the reaction information is the second video data. When the reaction information does not meet the condition, the switching decision unit will determine from the scene storage unit that the video data to be distributed after the first video data is the second video data.

[0351] [Item 4]

[0352] The video distribution system according to claim 1 is characterized by comprising:

[0353] The priority order is determined based on the payment amount of the viewer.

[0354] [Item 5]

[0355] The video distribution system according to item 1 is characterized by comprising:

[0356] The priority order is determined based on the status information of the viewer.

[0357] Hereinafter, a video distribution system according to a fourth embodiment will be described. The video distribution system according to the fourth embodiment is a system that dynamically changes the development of a video (story, plot, etc.) according to the response of viewers who watch the streaming video.

[0358] In the fourth embodiment, the reaction of the video refers to the comments made by the audience while watching the video. That is, the video will be played differently according to the comments of the audience. For example, if there are two characters in the video, the story can be branched to the story of the character who made the most comments as the main story. The following will be explained in detail.

[0359] Fig.26 A configuration diagram of a video distribution system according to a fourth embodiment is shown.

[0360] The video distribution system of the fourth embodiment includes a distributor device 3, wherein the distributor device 3 and the streaming server 2 are connected to each other via a network, and the streaming server 2 and the user terminal 1 are connected to each other via a network.

[0361] The distributor device 3 is a computer having a function of distributing videos, such as a personal computer, a tablet computer, a smart phone, etc. The distributor device 3 can be, for example, a home computer used by an ordinary user who wants to distribute videos. The video data can be sent from the distributor device 3 to the streaming media server 2 using a streaming media method.

[0362] The streaming server 2 is, for example, a computer such as a workstation, a personal computer, a virtual computer provided by cloud computing, etc. The streaming server 2 distributes the video data received from the distributor device 3 to the user terminal 1. The streaming server 2 can distribute the video data to a plurality of user terminals 1 at the same time. The user terminal 1 is a computer operated by the viewer, such as a personal computer, a tablet computer, a smart phone, etc.

[0363] The viewer can operate the user terminal 1 to access the streaming server 2, and the user terminal 1 can receive and play the video data distributed from the streaming server 2. In addition, the viewer can operate the user terminal 1 to distribute the video comments to the streaming server 2. The streaming server 2 transmits the video data and the comment data to the user terminal 1. Therefore, the user terminal can play the video and display the comments on the video at the same time.

[0364] The following description refers to videos distributed via streaming media as well as played linearly as "distributed video".

[0365] The format of the distributed video may be that the image and sound captured by the camera and microphone are encoded in real time into video data and sent out. However, in the second embodiment, the distributed video may be image data generated by combining and synthesizing material data.

[0366] In the fourth embodiment, the distributed video is prepared in advance as component video data (hereinafter referred to as "component video data"), and at the same time, the scene in which the component video data is arranged is also prepared. That is, assuming that the component video data is sent according to the scene, a complete set of distributed video will be sent.

[0367] Fig. 27 2 shows a block diagram of the hardware structure of the distributor device 3. The distributor device 3 has a CPU 301, a memory 302, a storage device 303, a communication interface 304, an input device 305, and an output device 306.

[0368] The storage device 303 is a device for storing various data and programs, and includes, for example, a hard disk drive, a non-volatile memory, and the like.

[0369] The communication interface 304 is an interface for connecting to the communication network 30, including, for example, an adapter for connecting to Ethernet (registered trademark), a modem for connecting to a public telephone network, a wireless communication device for wireless communication, and a USB (Universal Serial Bus) connector or RS232C connector for serial communication, etc.

[0370] The input device 305 is a device for inputting data, including, for example, a keyboard, a mouse, a touch panel, buttons, a microphone, etc. The output device 306 is a device for outputting data, including, for example, a display, a printer, a speaker, etc.

[0371] Fig.28 The block diagram shows the structure of the software of the distributor device 3. As shown in the figure, the distributor device 3 has a video distribution unit 311, a comment acquisition unit 312, a switching decision unit 313, a video library 331, a scene storage unit 332, a condition storage unit 333, a comment storage unit 334, and a user information storage unit 335.

[0372] Furthermore, the video distribution unit 311, the comment acquisition unit 312, and the switching decision unit 313 are implemented by the CPU 301 in the distributor device 3 causing the memory 302 to read and execute the program in the storage device 303. The video library 331, the scene storage unit 332, the condition storage unit 333, and the comment storage unit 334 are implemented by providing a partial storage area of ​​at least one of the memory 302 and the storage device 303 of the distributor device 3.

[0373] The video library 331 stores component video data.

[0374] The component video data can be saved as encoded files in any format, for example, MPEG4, MPEG2, AVI, MOV, etc.

[0375] Fig.29 2 is a block diagram showing the structure of the video library 331. As shown in the figure, the video library 331 associates component video data with information (video ID) for identifying the component video data, and stores the component video data.

[0376] The scene storage unit 332 stores scenes of the distribution video. Fig.30 2 is a block diagram showing a structure of the scene storage unit 332. As shown in the figure, the scene storage unit 332 stores scene information and sequence information.

[0377] Scene information is information about the scene. Fig.30 For example, the scene information contains, for example, information for identifying the scene (scene ID), the scene name (title), information indicating the component video data to be played first in the scene (start video ID), and the like.

[0378] The sequence information indicates the playback order of the component videos of the scene by default.

[0379] The sequence information includes information corresponding to a scene ID, a video ID indicating component video data included in the scene with the scene ID, and a sub-video ID indicating component video data to be played after the component video data with the video ID.

[0380] As described above, in the video distribution system of the fourth embodiment, the component video data to be played next will be changed according to the reaction (comments) of the audience. However, if the reaction of the audience does not meet the set conditions, the component video data to be played next will be determined according to the scene of the sequence information (by default).

[0381] Condition storage section 333 stores information on conditions for branching based on viewers' responses (comments) (hereinafter referred to as "condition information"). Fig.31 2 is a block diagram showing the structure of the condition storage unit 333. As shown in the figure, the condition information stored in the condition storage unit 333 includes a scene ID, a judgment period, a condition, and a sub-video ID.

[0382] The scene ID refers to the information of the scene.

[0383] The judgment period is the period for judging whether the viewer's reaction (comment) satisfies the condition. The judgment period can be a relative period, such as from now to 5 minutes ago. The judgment period can also be an absolute period, such as 00:00 to 00:10 on December 25th.

[0384] The distributor device 3 determines the viewer's response during a period of time set within the determination period, that is, determines whether the comments posted by the viewer during this period meet the conditions.

[0385] The conditions are based on the audience's response (comments distributed by the audience), for example, whether the comments posted during the above period contain comments containing the specified keywords, or the number of comments containing the specified keywords, or the total number of comments or viewers by region among the audience who distributed the comments.

[0386] For example, the total value (average, median, maximum, minimum, etc.) of the amount of money invested by viewers when asking questions in the video, when analyzing the viewers' emotions based on comments, when the number of viewers with sad emotions exceeds a set threshold, when comments containing specified keywords are not posted, etc., can all be conditions.

[0387] The video distribution unit 311 distributes the video. When the video distribution unit 311 receives a designation from a viewer, the video distribution unit 311 reads the scene information of the predetermined scene from the scene storage unit 332. Then, the video distribution unit 311 can read the component video data corresponding to the start video ID in the video library 331 according to the start video ID contained in the scene information (if necessary, encoding or converting the video format can be performed). Then, the video distribution unit 311 can send the read component video data to the streaming media server 2 to distribute the video.

[0388] When the video distribution unit 311 finishes sending the read component video data, the video distribution unit 311 obtains the sub-video ID corresponding to the scene ID and the video ID of the component video data according to the sequence information of the scene storage unit 332. Then, the video distribution unit 311 can read the component video data corresponding to the obtained sub-video ID from the video library 331, and distribute the component video data to the streaming media server 2 in the same manner.

[0389] When the secondary video ID does not exist, the video distribution unit 311 may terminate distribution of the video.

[0390] When the switching decision unit 313 determines the secondary video ID, the video distribution unit 311 can interrupt the distribution of the component video data in progress, and then the video distribution unit 311 reads the component video data according to the secondary video ID determined by the switching decision unit 313 and sends it to the streaming server 2. This can change the story.

[0391] The comment storage unit 334 stores comments distributed by viewers. Fig.32 The block diagram of the comment storage unit 334 is shown. The comment storage unit 334 associates comments with information (comment ID) for identifying the comments. Then, the comment storage unit 334 can store the above-mentioned comments, the viewer ID who distributed the comments, the date and time when the comments were distributed, the content of the comments, whether the viewer paid, the amount paid by the viewer, etc.

[0392] The user information storage unit 335 stores information on viewers. Fig.33: A block diagram of the structure of the user information storage unit 335 is shown. The user information storage unit 335 assigns a viewer ID and stores the viewer's status information. The status information includes, for example, the video distribution service plan (for example, premium service, basic service, free service, etc.) to which the viewer has joined, whether the viewer has paid, the amount of the viewer's payment, the name of the item purchased by the viewer, and the comments posted by the viewer.

[0393] The comment acquisition unit 312 acquires comments distributed by viewers operating the user terminal 1 .

[0394] For example, when the streaming server 2 provides an API for obtaining distributed comments, the comment obtaining unit 312 can obtain the distributed comments via the API.

[0395] The comment acquisition unit 312 may register the acquired comments in the comment storage unit 334 .

[0396] The switching decision unit 313 determines whether to switch the video. The switching decision unit 313 reads and summarizes the comments corresponding to the period in the comment storage unit 334 according to the various condition information stored in the condition storage unit. Then, the switching decision unit 313 determines whether the condition is satisfied. If the condition is satisfied, it will communicate and cause the video distribution unit 311 to send the component video data of the sub-video ID in the condition information.

[0397] Here, the switching decision unit 313 reads the comment with a high priority based on the information stored in the comment storage unit 334 or the information stored in the user information storage unit 335 .

[0398] Fig.34 A flowchart showing a process executed by the video distribution system according to the fourth embodiment of the present disclosure.

[0399] The video distribution unit 311 receives the designation of a scene (S421), and sets the start video ID included in the scene information of the designated scene as the playback ID (S422).

[0400] The video distribution unit 311 reads the component video data corresponding to the play ID from the video library 331 (S423), and sends the read component video to the streaming server 2 (S424). This enables the streaming server 2 to distribute the video to each user terminal 1 in a streaming manner.

[0401] The comment acquisition unit 312 acquires the comments distributed by the viewer using the user terminal 1 from the streaming server 2 (S425). The acquisition of the comments can be realized, for example, via an API provided by the streaming server 2.

[0402] The switching decision unit 313 reads a high-priority comment from the comment storage unit 334 based on each condition information stored in the condition storage unit 333 ( S426 ).

[0403] Here, the switching decision unit 313 can determine the service plan (e.g., the service plan of the video distribution service) that the viewer joins based on the high-priority comments. For example, when the viewer has joined the premium service (e.g., a service that is higher than the basic service), the switching decision unit 313 can extract the high-priority comments from the comment storage unit 334.

[0404] Alternatively, when the switching decision unit 313 determines the high-priority comments, it may be based on, for example, whether the payment amount exceeds the reference amount when the viewer who posted the comment pays for the posted comment, or it may be based on the viewer who paid the most. For example, if the viewer pays 500 yuan for a certain comment, the switching decision unit 313 will extract the high-priority comments because the payment amount exceeds the reference amount (for example, 300 yuan). In addition, when the video distribution unit 311 is to distribute the video, the reference amount for the comment may be indicated in advance.

[0405] Alternatively, the switching decision unit 313 may determine the comments with high priority based on, for example, whether the viewer has the product when posting the comment, or whether he has purchased the product before or after, or whether he has exercised the rights generated by the product, etc. For example, a product may correspond to a specific review, or may not correspond to a specific product to generate the effect of a specified quantity and period.

[0406] Next, the switching decision unit 313 determines whether the read comment meets the condition information (S427). Whether the comment meets the condition can be determined by calculating the number of each keyword included in the comment and whether the number exceeds a predetermined threshold.

[0407] Alternatively, in step S426, when the switching decision unit 313 reads the comment with the highest priority (for example, the highest payment amount, or the highest paying viewer), it can determine whether the comment meets the conditions.

[0408] When the comment meets the condition (S428: YES), the switching decision unit 313 sets the sub-video ID contained in the condition information as the playback ID (S429), returns to step S423, and the video distribution unit 311 distributes the component video data corresponding to the playback ID. In this way, the flow of component video data can be changed according to the comment.

[0409] When the comment does not satisfy the conditions of all the condition information, when the video being played ends (S430: YES), the switching decision unit 313 sets the sub-video ID of the sequence information as the play ID (S431).

[0410] When the sub video ID is set in the sequence information (S432: YES), the process returns to step S423, and the video distribution unit 311 sends the component video data corresponding to the playback ID. Otherwise, when the sub video ID is not set in the sequence information (S432: NO), the process is terminated.

[0411] Fig.35 An explanatory diagram showing an example of a screen displayed on a user terminal.

[0412] like Fig.35 As shown in (a), the video data distributed from the streaming server 2 enables the user terminal 1 to display the video 511, and also displays the comments 512 distributed by the user terminal 1 or other user terminals 1.

[0413] exist Fig.35 In the example (a), two characters are shown (Ai-chan and Megu-chan). Regarding the characters, the comments 512 posted include comments such as "Hey, it's Ai-chan!" and "Go Ai-chan!"

[0414] Here, if the condition storage 333 contains the condition information of the word "call Ai-chan" as the condition, it will be displayed as follows Fig.35 (b) shows video 513. Since the word Fig.35 (a) has been posted, so video 513 will be displayed later.

[0415] If, in Fig.35 (b) If the comment does not contain the phrase "call Ai-chan", it will be Fig.35 In (c), video 514 of the sub-video ID of the sequence information is displayed.

[0416] As described above, the video distribution system of the fourth embodiment can provide linear video to the user terminal 1 because the streaming server 2 continuously sends component video data. At the same time, when playing component video data, the component video data to be played next can be determined based on the comments of the audience.

[0417] Therefore, linear videos with different developments can be provided to viewers according to their responses.

[0418] Therefore, even if recorded component video data is used, the video can be distributed in a linear manner without losing the live broadcast feeling.

[0419] The video distribution system of the fourth embodiment is described above. The above embodiment is only for the convenience of understanding the present invention and is not limited to the technical solution formed by a specific combination of the above technical features. The present invention can be modified and improved without departing from its intention, and the present invention includes its equivalent technical solutions.

[0420] For example, in this embodiment, the video sent by the distributor device 3 is distributed to the user terminal 1 via the streaming server 2. However, the video can also be distributed directly from the distributor device 3 to each user terminal 1.

[0421] In this embodiment, the video library 331 stores video files encoded in a format such as MPEG4, however, the video library 331 may also store 3D models or scene files, and may send out dynamic rendering videos based on the 3D models or scene files.

[0422] In this embodiment, even when playing component video data, if the comment meets the conditions, it will switch to the next component video data ( Figure 8 Steps S428→S429→S423), however, not only that, the component video data can be played to the end and then transferred to the next component video data.

[0423] In this case, Fig.33 Before or after step S429, a step of confirming whether the component video data has been played can be set.

[0424] In the present embodiment, the component video data is switched based on the comments (or keywords included in the comments) distributed by the viewers. However, the component video may be switched based on the response of any viewer obtained from the user terminal 1 .

[0425] For example, when a viewer clicks or touches a specific area of ​​the screen of the distributed video played by the user terminal 1, the comment acquisition unit 312 acquires the activity as information. Then, the switching decision unit 313 can calculate the number of the activities (that is, the number of viewers who click or touch the specific area on the distributed video), and determine whether the number exceeds a threshold to decide whether to switch the component video data.

[0426] In this case, a threshold value of the number of viewers who click or touch a predetermined area on the distributed video and a video ID of the component video data to be switched according to the area may be registered as conditional information.

[0427] When the viewer watches the distributed video via the web browser of the user terminal 1, the click event generated by the web browser is sent to the streaming server 2 or the distributor device 3. Then, the comment acquisition unit 312 can acquire the click event directly or through the streaming server 2, and the click event can be stored in the comment storage unit 334.

[0428] In this case, the comment acquisition unit 312 may be an activity acquisition unit that not only acquires comments but also acquires various activities. In this case, the comment storage unit 334 may be an activity storage unit that not only stores comments but also stores various activities.

[0429] In addition, the activity acquisition unit 312 may also receive audio data obtained from a user terminal, and analyze the received audio data. When the audio data contains a specific pronunciation, the activity acquisition unit 312 will acquire the pronunciation as an activity. At this time, the switching decision unit 313 will switch the video according to the activity.

[0430] In this case, under the premise that a specific pronunciation is a condition, it is possible to register that various types of pronunciations set different sub-video IDs as condition information in the condition storage unit 333.

[0431] Furthermore, the sound may be analyzed in the user terminal 1, and then the activity acquisition unit may receive the analyzed result.

[0432] In addition, the activity acquisition unit may receive image data captured by the user terminal 1, analyze the received image data to identify the posture, gaze, gestures, etc. of the viewer, and use these as activities. Then, the switching decision unit 313 may switch the video according to these activities.

[0433] In this case, under the premise of specific posture, sight line, and hand gesture as conditions, different sub-video IDs can be registered for various types of postures, gestures, and sight line positions as condition information in the condition storage unit 333. In addition, the image can also be parsed in the user terminal 1, and then the activity acquisition unit can receive the parsed result.

[0434] Furthermore, the activity acquisition unit 312 does not need to acquire activities from the user terminal 1, for example, it can also acquire activities on the system.

[0435] The activities that can be obtained on the system include, for example, the time that has passed since the start of the animation distribution, the current time, the collision of objects that occurred during the distribution of the animation, the location of the viewer or distributor, or the weather conditions of the area set in advance, etc.

[0436] The switching decision unit 313 may also perform switching animation according to these activities.

[0437] <Fifth embodiment>

[0438] The video distribution system according to the fifth embodiment has the following configuration.

[0439] [Project 1]

[0440] A video distribution system, comprising:

[0441] Material library, storing material data for generating videos;

[0442] A video distribution unit, which sends the video according to the material data;

[0443] The activity acquisition unit acquires activity information about sight lines from viewers of the video during video playback.

[0444] The behavior processing unit operates the material data according to the activity information.

[0445] [Project 2]

[0446] The video distribution system according to item 1 is characterized by further comprising:

[0447] The activity acquisition unit acquires the activities occurring in the video distribution system;

[0448] The behavior processing unit operates the material data according to the activity.

[0449] [Item 3]

[0450] The video distribution system according to item 1 is characterized by further comprising:

[0451] The movement information about the viewer's line of sight includes information about the viewer's line of sight projected onto a predetermined area in the played video.

[0452] [Item 4]

[0453] The video distribution system according to item 1 is characterized by further comprising:

[0454] The action behavior contains at least one of the following;

[0455] The appearance, movement and disappearance of objects, the start and stop of animation, the start or stop of video, the start or stop of sound, and the change of material data.

[0456] Hereinafter, a video distribution system according to a fifth embodiment will be described. The video distribution system according to the fifth embodiment is a system that dynamically changes the video to be distributed in a streaming manner according to various activities.

[0457] The activities include information about the viewer (hereinafter referred to as user activity information), such as the viewer operating a device, inputting voice or text of the viewer, photographing the viewer, obtaining posture, line of sight, or gesture analyzed from the photographed image, obtaining measurement data measuring the viewer's physical reaction, etc.

[0458] In addition, the activity may also include information obtained by the system, such as the number of viewers watching, weather, time, contact conditions of objects in the video, etc. (hereinafter referred to as system activity information).

[0459] The distributed video is generated based on the material data of the video. The material data is, for example, 3D model, video data, sound data, etc. Each material data can be set according to the action behavior of the activity.

[0460] Actions refer to operations on material data. Actions can include the appearance, movement, or elimination of objects represented by 3D models, the start and end of animations, the play and stop of videos, the play and stop of sounds, and the replacement (replacement) of material data.

[0461] In the fifth embodiment, the distributed video may be a video or image synthesis output as a result of an action.

[0462] In the video distribution system of the fifth embodiment, the distributed video can be dynamically changed by activating action behaviors according to the event. The details are as follows.

[0463] Fig.36 A configuration diagram of a video distribution system according to a fifth embodiment is shown.

[0464] The video distribution system of the fifth embodiment further includes a distributor device 3. The distributor device 3 is connected to the streaming media server 2 for communication, and the streaming media server 2 is connected to the user terminal 1 for communication.

[0465] A plurality of user terminals 1 can be connected for communication.

[0466] The distributor device 3 is a computer having a function of distributing videos, such as a personal computer, a tablet computer, a smart phone, etc. The distributor device 3 can be, for example, a home computer used by an ordinary user who wants to distribute videos. The video data can be sent from the distributor device 3 to the streaming media server 2 using a streaming media method.

[0467] The streaming server 2 is, for example, a computer such as a workstation, a personal computer, a virtual computer provided by cloud computing, etc. The streaming server 2 distributes the video data received from the distributor device 3 to the user terminal 1. The streaming server 2 can distribute the video data to one or more user terminals 1 at the same time.

[0468] The user terminal 1 can be operated by the viewer, for example, a helmet display (HMD), a personal computer, a tablet computer, a smart phone or other computer, but the user terminal 1 in the fifth embodiment will be exemplified by an HMD. The viewer will operate the user terminal 1 and an attached controller (not shown) to access the streaming media server 2, and the user terminal 1 can receive and play the video data sent by the streaming media server 2.

[0469] In addition, the user terminal 1 can also collect various activity information, such as taking photos of viewers, recording the voices of viewers, and accepting comments input by viewers.

[0470] The streaming server 2 acquires the activities of one or more viewers. The distributor device 3 can acquire the activities of viewers via, for example, an API (Application Programming Interface) provided by the streaming server 2.

[0471] The video described below that is distributed through streaming media and played linearly is referred to as "distributed video". The format of the distributed video can be that the image and sound obtained by the camera and microphone are encoded into video data in real time and sent out. However, in the fifth embodiment, the distributed video can be image data generated by combining and synthesizing material data.

[0472] Fig.37 Figure 2 shows the structural block diagram of a helmet display (HMD). Fig.37 As shown, HMD1 includes at least a control unit 101, a memory 102, a storage device 103, a display control unit 104, a display unit 105, a transceiver unit 106, an input / output unit 107, etc. They are electrically connected to each other via a bus. The control unit 101 is a computing device that can control the overall operation of HMD1, control data transmission between various elements, and execute game processing applications, as well as perform information processing for authentication processing.

[0473] For example, the control unit 101 is a CPU (Central Processing Unit), and the control unit 101 executes the program stored in the storage device 103 and expanded in the memory 102 to process various information.

[0474] The memory 102 includes a main storage unit composed of a volatile storage device such as DRAM (Dynamic Random Access Memory) and an auxiliary storage device composed of a non-volatile storage device such as a flash memory or HDD (Hard Disc Drive). The memory 102 is used as a work area of ​​the CPU 101, and also as a BIOS (Basic Input / Output System) executed when the streaming media server 2 or the distributor device 3 is started, and various setting information is stored.

[0475] The storage device 103 stores various programs such as application programs. A database for storing various data for processing may also be established in the storage device 103 .

[0476] The display control unit 104 is, for example, a GPU (Graphics Processing Unit), and mainly performs arithmetic processing such as image processing. The display control unit 104 synthesizes the character and other work data generated by the CPU 101.

[0477] The display unit 105 displays a virtual space image based on the image signal input from the display control unit 104 .

[0478] The display unit 105 is, for example, an LCD or organic EL display. The display unit 105 displays an image for the left eye and an image for the right eye, and provides a stereoscopic image to the viewer by using the parallax of the two eyes. The display unit 105 may be composed of a separate display for the left eye and a display for the right eye, or may be an integrated display for the left and right eyes.

[0479] The transceiver unit 106 enables the HMD 1 to connect to the network. The transceiver unit 106 may also include, for example, a short-range communication interface such as Bluetooth (registered trademark) and BLE (Bluetooth Low Energy). The transceiver unit 106 receives an instruction signal from a controller (not shown) via the network.

[0480] When an image generation device or a display device is installed outside, the input / output unit 107 is an interface for outputting / inputting image signals or audio signals.

[0481] Furthermore, the HMD 1 may be equipped with a sensor 108. The sensor is capable of detecting the direction or tilt of the viewer's head, for example, a magnetic sensor, an accelerometer, or a gyroscope sensor, or a combination of multiple sensors. The accelerometer can detect acceleration (speed change per unit time).

[0482] Here, the accelerometer can detect acceleration in three axes (X, Y, and Z axes). For example, assuming that the front-to-back direction of HMD1 is the X axis, the left-to-right direction is the Y axis, and the up-down direction is the Z axis, the front of HMD1 is the positive direction of the X axis, the left is the positive direction of the Y axis, and the bottom is the positive direction of the Z axis, the accelerometer 30 can detect the acceleration in each direction, as well as the rotation angle around the X axis (roll angle), the rotation angle around the Y axis (pitch angle), and the rotation angle around the Y axis (yaw angle).

[0483] In addition, HMD1 can be equipped with a plurality of light sources (e.g., infrared LED, visible light LED, etc.) instead of sensor 108. Then, a camera (e.g., infrared camera, visible light camera, etc.) can be set outside HMD1 to detect these light sources, so that the position, direction, and inclination of HMD1 in a specific space can be known. For the same purpose, HMD1 can also be equipped with a camera that can detect light sources.

[0484] Furthermore, the HMD 1 may be provided with an eye tracking sensor. The eye tracking sensor is used to detect the direction of the viewer's left and right eyes and the place where they are looking.

[0485] There are many types of eye tracking sensors. For example, the position of the reflected light generated by illuminating the left and right eyes with weak infrared light is used as the reference point. Then, the line of sight is detected based on the position of the reflected light and the position of the pupil. Then, the gaze point can be detected based on the intersection of the line of sight of the left and right eyes.

[0486] Furthermore, the speaker 109 outputs a sound signal such as music data input by the sound generating unit.

[0487] In addition, HMD 1 can cooperate with an external processing device such as a server or an image processing device to execute an application program together with the network to send and receive various data, and can also execute built-in programs by itself like an independent machine without relying on an external processing device.

[0488] Fig.38 1 is a block diagram showing the hardware structure of the distributor device 3. The distributor device 3 includes a CPU 301, a memory 302, a storage device 303, a communication interface 304, an input device 305, and an output device 306.

[0489] The storage device 303 is a device for storing various data and programs, and includes, for example, a hard disk drive, a non-volatile memory, and the like.

[0490] The communication interface 304 is an interface for connecting to the communication network 30, including, for example, an adapter for connecting to Ethernet (registered trademark), a modem for connecting to a public telephone network, a wireless communication device for wireless communication, and a USB (Universal Serial Bus) connector or RS232C connector for serial communication, etc.

[0491] The input device 305 is a device for inputting data, including, for example, a keyboard, a mouse, a touch panel, buttons, a microphone, etc. The output device 306 is a device for outputting data, including, for example, a display, a printer, a speaker, etc.

[0492] Fig.39 The block diagram shows the structure of the software of the distributor device 3. As shown in the figure, the distributor device 3 has a video distribution unit 311, an activity acquisition unit 312, a behavior processing unit 313, a material library 331, a behavior storage unit 333, and an activity storage unit 334.

[0493] The video distribution unit 311, the activity acquisition unit 312, and the behavior processing unit 313 are implemented by the CPU 301 in the distributor device 3 causing the memory 302 to read and execute the program in the storage device 303. The material library 331, the scene storage unit 334, and the behavior storage unit 333 are implemented by providing a partial storage area of ​​at least one of the memory 302 and the storage device 303 of the distributor device 3.

[0494] The material library 331 stores various types of data (material data) that can be incorporated into a video. The material data includes, for example, 3D models, static images, animations, sound data, MIDI data, character data, and the like. Fig.40 2 is a block diagram showing the structure of the material library 331. As shown in the figure, the material library 331 provides information (material ID) for identifying a material and stores various material data.

[0495] The behavior storage unit 333 stores operation (action behavior) information (hereinafter referred to as behavior information) on material data. Fig.41 2 shows an example of the behavior information stored in the behavior storage unit 333. As shown in the figure, the behavior information includes a behavior ID indicating an action behavior, a judgment period, a condition, and an action behavior.

[0496] The judgment period refers to information for judging whether an activity satisfies a condition. The judgment period may be a relative period, such as from now to 5 minutes ago. The judgment period may also be an absolute period, such as 00:00 to 00:10 on December 25th.

[0497] The condition may be for an activity, for example, whether an activity exists, or whether the total value of activities from a plurality of viewers exceeds a threshold, etc.

[0498] For viewer activity information, for example, in the distribution of video playback, whether the viewer is watching a specific area, or whether the number of viewers watching a specific area on the screen exceeds a threshold, etc. can be used as conditions.

[0499] Based on the material data used to generate the distributed video, whether the viewer has viewed the displayed object, or whether the number of viewers who have viewed the object exceeds a threshold, etc. can be used as conditions.

[0500] To determine whether the viewer is looking at a specific area or object, the eye tracking sensor or various sensors installed on the HMD can be used to detect the viewer's head posture, direction, and gaze location. In this case, the sensor can be used alone or in combination with multiple sensors.

[0501] However, image analysis can be used instead of HMD to recognize the viewer's posture, line of sight, gesture, etc. In this case, the condition can be whether the viewer is in a specific posture, looking in a specific direction (specific line of sight), making a specific gesture, or whether the viewer who is in a specific posture, looking in a specific direction, and making a specific gesture exceeds a threshold.

[0502] In this case, the image analysis can be performed by the user terminal 1, and then the recognition result can be sent to the streaming server 2 or the distributor device 3. Or the image data captured by the user terminal 1 is transmitted to the distributor device 3 via the streaming server 2, or the image data is directly sent from the user terminal 1 to the distributor device 3, and then the distributor device 3 is caused to perform the image analysis.

[0503] In addition, for system activity information, for example, whether the number of viewers who watch the distributed image exceeds a threshold can also be used as a condition. In addition, the playback time of the distributed image can also be used as a condition. For example, the elapsed time from the start of playback to the stop of playback, etc. In addition, when the location of the viewer or distributor and the weather in the area are obtained as system activity information, the weather can also be used as a condition, for example, sunny, rainy, snowy, a certain wind strength, a certain temperature, etc. In addition, when the material data is a 3D model, the collision of objects in the distributed video can also be used as a condition.

[0504] Actions are various operations on the material data. Actions can contain parameters so that the material data can be set in detail to perform specific operations.

[0505] Then, in the fifth embodiment, the action behavior can not only operate the material data, but also start and stop other action behaviors, and can also wait for other action behaviors to complete their execution. The action behavior is, for example, a program written in a scripting language and can also be saved.

[0506] The video distribution unit 311 distributes the video. A single action behavior may also be performed as a plurality of action behaviors. The video distribution unit 311 may generate a distribution video by synthesizing the action behaviors by the action processing unit 313 described later.

[0507] In addition, the video delivery unit 311 can deliver the video to the user terminal 1 by sending the generated delivery video to the streaming server 2.

[0508] The activity storage unit 334 stores various activities that have occurred. Fig.42 2 shows a block diagram of the structure of the activity storage unit 334. As described above, the activity storage unit 334 stores user activity information and system activity information.

[0509] Hereinafter, user activity information and system activity information are collectively referred to as activity information.

[0510] The user activity information includes an activity ID indicating the activity, a viewer ID indicating a viewer related to the activity, a time point when the activity occurs, and the content of the activity.

[0511] System activity information includes the activity ID, the time when the activity occurred, and the content of the activity.

[0512] The content of the activity varies depending on the activity. For example, in the case of user activity information, when the viewer's eyes are directed to a specific area of ​​the video during video playback, this information may be set as the activity content. The specific area can be a single area or multiple areas.

[0513] In addition, when analyzing the viewer image captured by the user terminal 1, the viewer's line of sight and the viewer's gesture, the information indicating the line of sight or gesture may be set as the activity content. In the case of system activity information, the number of viewers, weather, time point, etc. may be set as the activity content.

[0514] The activity acquisition unit 312 acquires an activity and stores the acquired activity content in the activity storage unit 334 as activity information.

[0515] The user may set what kind of activities the activity acquisition unit 312 is to acquire. Setting information indicating the kind of activities to be acquired may be stored in, for example, the memory 302 or the storage device 303.

[0516] The activity acquisition unit 312 can register information related to the viewer's line of sight position during video playback as user activity information. For example, when a video is viewed and distributed via an HMD, one or a combination of information such as the viewer's head posture, tilt, and gaze position obtained by the sensor of the HMD will be sent to the streaming server 2 or the distributor device 3. The activity acquisition unit 312 analyzes the received information and determines whether the viewer has directed his or her line of sight to a specific area of ​​the video screen being played, and determines to register the activity. Alternatively, the user terminal 1 (HMD) performs the above analysis, receives information about the viewer's line of sight position during the video being played, and registers the information as an activity. In addition, the activity acquisition unit 312 can also receive a captured viewer image from the user terminal 1, and analyze the received image to obtain the viewer's posture, line of sight, and gesture. In addition, the image can also be analyzed at the user terminal 1, and the analysis result is then received by the activity acquisition unit 312.

[0517] The activity acquisition unit 312 may periodically count the number of viewers who are viewing the video and register system activity information.

[0518] Furthermore, the image analysis process may also be performed by the user terminal 1 (HMD), and then the activity acquisition unit 312 may receive the analysis result directly from the user terminal 1 or via the streaming server 2 and register it as user activity information.

[0519] For example, it is pre-set that a timeout activity can be obtained from a clock, and in this case, the event acquisition unit 312 can also register the time from the start of playing the distributed video to the time when the specified time has passed as system activity information. In addition, the activity acquisition unit 312 can also register a specified time point (for example, the time point when the date is changed, exactly 3 pm, etc.) as system activity information.

[0520] Also, the activity acquisition unit 312 may acquire weather information from, for example, a server of a weather company, and register weather elements of a specific area (eg, the location of each viewer or distributor, or a predetermined area) as system activity information.

[0521] Also, for example, when the material data is a 3D model, the activity acquisition unit 312 may register system activity information that has determined the collision of objects in the distributed video as information.

[0522] The behavior processing unit 313 performs action behaviors on the material data. The behavior processing unit 313 receives the action behavior to be performed first and performs it. Since the action behavior also has the possibility of activating other action behaviors, in this case, the behavior processing unit 313 can continue to perform the action behaviors in sequence. In addition, the action behaviors can also be branched and executed in parallel.

[0523] In addition, the behavior processing unit 313 executes the action behavior corresponding to the activity. The behavior processing unit 313 counts the activity information of the corresponding period in the activity storage unit 334 for the behavior information stored in the behavior storage unit 333, and determines whether the conditions are met. If the conditions are met, the behavior processing unit 313 will execute the action behavior set in the behavior information. Therefore, the development of the video can be dynamically changed according to the activity.

[0524] Fig.43 The flowchart shows the process performed by the video distribution system according to the embodiment of the present disclosure.

[0525] The behavior processing unit 313 receives the instruction of the action behavior to be performed first (S421), and performs the specified action behavior (S422). As a result of performing the action behavior, the output image and sound will be synthesized into video data. Then, the video distribution unit 311 will send the video data to the streaming media server 2.

[0526] The activity acquisition unit 312 may periodically acquire information associated with the viewer's sight position (S423). For example, the activity acquisition unit 312 may acquire parameters via an API provided by the streaming server 2, and the parameters may be one of the head posture, tilt, and gaze point acquired via a sensor of the HMD, or a combination of such information.

[0527] The activity acquisition unit 312 determines whether the viewer has directed their gaze toward a specific area of ​​the video being played based on the received parameters, and can register it as an activity.

[0528] In addition, the activity acquisition unit 312 may utilize a timer function to acquire comments distributed after a predetermined time.

[0529] For each activity information stored in the activity storage unit 333, the activity processing unit 313 reads the activity information including the time point of the determination period from the activity storage unit 334. Then, the behavior processing unit 313 determines whether the activity content of the read activity information satisfies the condition of the behavior information.

[0530] If the activity satisfies the conditions (S426: YES), the behavior processing unit 313 executes the action included in the behavior information (S427).

[0531] Here, the activity processing unit 313 may stop the previously executed action behavior, or execute the previous action behavior and the new action behavior in parallel, or specify these action behaviors in the new action behavior.

[0532] For example, when the viewer's gaze is directed to a specific area where the video is being played, or when the number of viewers in that specific area exceeds a certain number, the material data of the video corresponding to that area (for example, a specific scene of the video) is connected and stored, that is, when the activity satisfies the action behavior conditions, the corresponding scene can be distributed.

[0533] Also, for example, when multiple characters are included in the distributed video, if it is detected that the viewer's gaze is directed toward a specific character, the scene focusing on the character can be separately distributed, and the video of the scene can be distributed.

[0534] If the action behavior of the behavior information does not terminate the distribution of the video (S428), then the process returns to step S423 for processing.

[0535] As described above, the video distribution system of the fifth embodiment distributes the video to the user terminal 1 via the streaming server 2, and can change the play distribution video according to the viewer's line of sight. Therefore, while using the recorded video, various distribution videos can be developed according to the viewer's reaction, and the distribution of the video in the streaming mode does not lose the sense of presence.

[0536] In particular, usually, when watching a video, the viewer will direct his or her gaze toward a person or object of interest, so the video can be naturally divided and distributed without any special operation.

[0537] The video distribution system of the fifth embodiment is described above. The above embodiment is only for the convenience of understanding the present invention and is not limited to the technical solution formed by a specific combination of the above technical features. The present invention can be modified and improved without departing from its intention, and the present invention includes its equivalent technical solutions.

[0538] For example, in this embodiment, the video sent by the distributor device 3 is distributed to the user terminal 1 via the streaming server 2. However, the video can also be distributed directly from the distributor device 3 to each user terminal 1.

[0539] Also, in the embodiment of the present invention, even if the video is playing, as long as the comment meets the conditions, it will migrate to the next component video data ( Fig.42 Step S427). However, it is not limited thereto, and the next action behavior may be executed after the action behavior being executed is completed.

[0540] <Sixth Implementation Method>

[0541] The video distribution system according to the sixth embodiment has the following configuration.

[0542] [Project 1]

[0543] A video distribution system, comprising:

[0544] Material library, storing material data for generating videos;

[0545] A video distribution unit, which sends the video according to the material data;

[0546] A reaction acquisition unit, which acquires reaction information about the reaction of viewers and listeners of the video during the video playback process;

[0547] a behavior processing unit, operating the material data according to the reaction information;

[0548] A group setting unit, which divides the viewers into two or more groups according to the reaction information;

[0549] The behavior processing unit divides the viewers into groups and performs different operations on each group.

[0550] [Project 2]

[0551] The video distribution system according to item 1 is characterized by further comprising:

[0552] The group storage unit associates and stores the information indicating the viewer corresponding to the acquired reaction information and the group to which the viewer belongs.

[0553] [Item 3]

[0554] The video distribution system according to item 1 or item 2 is characterized by further comprising:

[0555] a reaction record storage unit for associating the viewer with specific information and managing information indicating the reaction of the viewer;

[0556] The video contains depicted characters, and the video is about a game of rock-paper-scissors, and;

[0557] The reaction refers to the move made by the viewer in the rock-paper-scissors game, and;

[0558] The group setting unit groups the audience into the following groups: the audience of the winning role is divided into the first group, the audience of the losing role is divided into the second group, and;

[0559] The behavior processing unit reflects only the response information of the viewers belonging to the first group and performs the operation.

[0560] [Item 4]

[0561] The video distribution system according to item 3 is characterized by further comprising:

[0562] When the number of the viewers to which the first group belongs is less than a predetermined number, the behavior processing unit operates the material data having a function of outputting an image of terminating the rock-paper-scissors game.

[0563] [Item 5]

[0564] The video distribution system according to item 4 is characterized by further comprising:

[0565] The reward processing unit, when playing the image of the end of the rock-paper-scissors game, will reward the viewers belonging to the first group.

[0566] Hereinafter, a video distribution system according to a sixth embodiment will be described. The video distribution system according to the sixth embodiment is a system that dynamically changes the video to be distributed in a streaming manner according to various activities.

[0567] The activities include information about the viewer (hereinafter referred to as user activity information), such as the viewer operating a device, inputting voice or text of the viewer, photographing the viewer, obtaining posture, line of sight, or gesture analyzed from the photographed image, obtaining measurement data measuring the viewer's physical reaction, etc.

[0568] In addition, the activity may also include information obtained by the system, such as the number of viewers watching, weather, time, contact conditions of objects in the video, etc. (hereinafter referred to as system activity information).

[0569] The distributed video is generated based on the material data of the video. The material data is, for example, a 3D model, video data, audio data, etc. Each material data can be set according to the action behavior of the activity.

[0570] Actions refer to operations on material data. Actions can include the appearance, movement, or elimination of objects represented by 3D models, the start and end of animations, the play and stop of videos, the play and stop of sounds, and the replacement (replacement) of material data.

[0571] In the sixth embodiment, the distributed video may be an image or image synthesis output as a result of an action. In the video distribution system of the sixth embodiment, the distributed video may be dynamically changed by activating an active action. Details are as follows.

[0572] Fig.44 A configuration diagram of a video distribution system according to a sixth embodiment is shown.

[0573] The video distribution system of the sixth embodiment includes a distributor device 3, and the distributor device 3 is communicatively connected to a streaming server 2, and the streaming server 2 is communicatively connected to a user terminal 1. A plurality of user terminals 1 can be communicatively connected.

[0574] The distributor device 3 is a computer having a function of distributing videos, such as a personal computer, a tablet computer, a smart phone, etc. The distributor device 3 can be, for example, a home computer used by an ordinary user who wants to distribute videos. The video data can be sent from the distributor device 3 to the streaming media server 2 using a streaming media method.

[0575] The streaming server 2 is, for example, a computer such as a workstation, a personal computer, a virtual computer provided by cloud computing, etc. The streaming server 2 distributes the video data received from the distributor device 3 to the user terminal 1. The streaming server 2 can distribute the video data to one or more user terminals 1 at the same time.

[0576] The user terminal 1 is a computer operated by the viewer, such as a personal computer, a tablet computer, a smart phone, etc. The viewer can operate the user terminal 1 to access the streaming server 2, and the user terminal 1 can receive and play the video data distributed from the streaming server 2. The user terminal 1 can also collect various activity information, such as taking photos of the viewer, recording the viewer's voice, and accepting comments entered by the viewer.

[0577] The streaming server 2 acquires the activities of one or more viewers. The distributor device 3 can acquire the activities of viewers via, for example, an API (Application Programming Interface) provided by the streaming server 2.

[0578] The following description refers to videos distributed via streaming media as well as played linearly as "distributed video".

[0579] The format of the distributed video may be that the image and sound captured by the camera and microphone are encoded in real time into video data and sent out. However, in the sixth embodiment, the distributed video may be image data generated by combining and synthesizing material data.

[0580] In the video distribution system according to the sixth embodiment, it is assumed that a rock-paper-scissors game is being played as an example.

[0581] In the sixth embodiment, a character appears in the distributed video, and the character and a plurality of viewers play a rock-paper-scissors game. The final winner of the rock-paper-scissors game will receive a reward.

[0582] The reward may be, for example, electronic money, gift certificates, the right to use a work, the right to use an item such as a game service, etc., and may be set arbitrarily.

[0583] Fig.45 2 shows a block diagram of the hardware structure of the distributor device 3. The distributor device 3 has a CPU 301, a memory 302, a storage device 303, a communication interface 304, an input device 305, and an output device 306.

[0584] The storage device 303 is a device for storing various data and programs, and includes, for example, a hard disk drive, a non-volatile memory, and the like.

[0585] The communication interface 304 is an interface for connecting to the communication network 30, including, for example, an adapter for connecting to Ethernet (registered trademark), a modem for connecting to a public telephone network, a wireless communication device for wireless communication, and a USB (Universal Serial Bus) connector or RS232C connector for serial communication, etc.

[0586] The input device 305 is a device for inputting data, including, for example, a keyboard, a mouse, a touch panel, buttons, a microphone, etc. The output device 306 is a device for outputting data, including, for example, a display, a printer, a speaker, etc.

[0587] Fig.46 The block diagram shows the structure of the software of the distributor device 3. As shown in the figure, the distributor device 3 has various processing units such as a video distribution unit 311, an activity acquisition unit 312, a behavior processing unit 313, a group setting unit 314, a total output unit 315, and a reward processing unit 316, and various storage units such as a material library 331, a behavior storage unit 333, an activity storage unit 334, a group condition storage unit 335, and a group storage unit 336.

[0588] The various processing units are implemented by the CPU 301 in the distributor device 3 causing the memory 302 to read and execute the program in the storage device 303. The various storage units are implemented by at least one of the memory 302 and the storage device 303 provided by the distributor device 3 providing a partial storage area.

[0589] The material library 331 stores various types of data (material data) that can be incorporated into a video. The material data includes, for example, 3D models, static images, animations, sound data, MIDI data, character data, and the like. Fig.47 2 is a block diagram showing the structure of the material library 331. As shown in the figure, the material library 331 provides information (material ID) for identifying a material and stores various material data.

[0590] In the sixth embodiment, it is assumed that a character plays a rock-paper-scissors game with a plurality of viewers.

[0591] The material library registers material data for various scenes of depiction, such as material data for scenes in which characters explain how to play the rock-paper-scissors game, how it proceeds, and the rewards for the winner; material data for scenes instructing the viewer on the timing of throwing a punch; material data for scenes showing the result of the rock-paper-scissors game; material data for scenes in which the rock-paper-scissors game will continue; material data for scenes in which the rock-paper-scissors game will end; and the like.

[0592] The behavior storage unit 333 stores operation (action behavior) information (hereinafter referred to as behavior information) on material data. Fig.48 1 shows an example of the behavior information stored in the behavior storage unit 333. As shown in the figure, the behavior information includes a behavior ID indicating an action behavior, a judgment period, a group, a condition, and an action behavior.

[0593] The judgment period refers to the period information for judging whether the activity meets the conditions. The judgment period can be a relative period, such as from now to 5 minutes ago. The judgment period can also be an absolute period, such as 00:00 to 00:10 on December 25th. In addition, the judgment period can also be a specified action and the time when the action is performed (for example, from the start of the action to 10 seconds, and the action ends after 10 seconds). The length of the judgment period can be, for example, 1 second, 1 minute, 1 hour, 1 day, etc., which can be set arbitrarily.

[0594] A group refers to the group to which the viewer belongs.

[0595] When the behavior information has a group set, the activity information of the viewer belonging to the set group will be judged whether it meets the conditions described below. For example, when the character in the distributed video plays a rock-paper-scissors game with the viewer, the user activity of the viewer belonging to the winning group can be added as a condition in the second and subsequent trials. In addition, the group can be omitted, and in the conditions described below, it can also be specified that the viewer belongs to a specific group as a condition.

[0596] The condition may be for an activity, for example, whether an activity exists, or whether the total value of activities from a plurality of viewers exceeds a threshold, etc.

[0597] Regarding user activity information, conditions may include, for example, whether the viewer presses a specific button while playing the video, whether the viewer clicks a designated area on the screen, whether the number of viewers who click or touch the video exceeds a threshold, etc.

[0598] Furthermore, based on the material data used to generate the distributed video, whether an object displayed in the distributed video has been clicked or touched, and whether the number of viewers who clicked or touched the object exceeded a threshold can also be used as conditions.

[0599] In addition, whether the viewer has input specified characters (keywords) at the user terminal 1 can also be used as a condition. For example, whether the comments on the distributed video contain specified keywords, or whether the number of viewers who input keywords exceeds a threshold can also be used as a condition.

[0600] In addition, the total number of comments or viewers by region among the viewers who distributed the comments, for example, the total value (average, median, maximum, minimum, etc.) of the amount of money invested by viewers when asking questions in the video, when analyzing the viewers' emotions based on the comments, when the number of viewers with sad emotions exceeds a specified threshold, when comments containing specified keywords have not been posted, etc., can all be used as conditions.

[0601] Furthermore, the atmosphere or emotions of the audience obtained by performing speech recognition analysis can also be used as a condition. For example, whether the audience makes a specific sound, such as clapping, whistling, or stomping, or whether the number of audiences making these sounds exceeds a threshold.

[0602] In this case, speech recognition may be performed by the user terminal 1, and then the recognition result may be sent to the streaming server 2 or the distributor device 3. Either the speech data captured by the user terminal 1 is transmitted via the streaming server 2 to the distributor device 3, or the speech data is directly sent from the user terminal 1 to the distributor device 3, and then the distributor device 3 performs speech recognition.

[0603] Furthermore, conditions may be used to determine whether such images are distributed to the streaming server 2, based on whether the images are self-portraits of the viewers or the atmosphere of the viewers in the images, and whether the number of viewers to whom the images are distributed exceeds a threshold.

[0604] Furthermore, through image analysis, whether an image of a predetermined object (for example, an image of a specific signboard or flyer around the viewer) has been posted, or whether the number of viewers who have posted the image exceeds a threshold value may be used as a condition.

[0605] In addition, information (viewer's posture, line of sight, gesture) recognized by analyzing the image can also be used as a condition. For example, whether the viewer is posing in a specific posture, directing a specific line of sight, making a specific gesture, or whether the number of viewers making the above gestures exceeds a threshold can also be used as a condition.

[0606] In this case, the image analysis can be performed by the user terminal 1, and then the recognition result can be sent to the streaming server 2 or the distributor device 3. Or the image data captured by the user terminal 1 is transmitted to the distributor device 3 via the streaming server 2, or the image data is directly sent from the user terminal 1 to the distributor device 3, and then the distributor device 3 is caused to perform the image analysis.

[0607] Furthermore, for system activity information, for example, whether the number of viewers who watch the distributed image exceeds a threshold may be used as a condition.

[0608] Furthermore, the playback time of the distributed image may be used as a condition, such as the elapsed time from the start of playback to the stop of playback.

[0609] In addition, when the location of the viewer or distributor and the weather in the area are obtained as system activity information, the weather can also be used as a condition, such as sunny days, rainy days, snowy days, a certain wind intensity, a certain temperature, etc.

[0610] Also, when the material data is a 3D model, collision of objects in the distribution video can also be used as a condition.

[0611] The action behavior is various operations on the material data. The action behavior may contain parameters so that the material data can be set in detail to perform specific operations. Then, in the sixth embodiment, the action behavior can not only operate the material data, but also perform and stop other action behaviors, and wait for other action behaviors to complete their execution. The action behavior is, for example, a program written in a scripting language.

[0612] The activity storage unit 334 stores various activities that have occurred. Fig.49 A block diagram showing the structure of the active storage unit 334 is shown.

[0613] As described above, the activity storage unit 334 stores user activity information and system activity information.

[0614] Hereinafter, user activity information and system activity information are collectively referred to as activity information. User activity information includes an activity ID indicating an activity, a viewer ID indicating a viewer related to the activity, a time point when the activity occurs, and the content of the activity.

[0615] System activity information includes the activity ID, the time when the activity occurred, and the content of the activity.

[0616] The content of the activity may vary depending on the activity. For example, in the case of user activity information, when a viewer comments on a distributed video, the comment may be set as the content of the activity. Also, when analyzing the viewer image captured by the user terminal 1, the viewer's line of sight and the viewer's gesture may be set as the content of the activity. In the case of system activity information, the number of viewers, weather, time point, etc. may be set as the content of the activity.

[0617] Group condition storage section 335 stores conditions for grouping viewers (hereinafter referred to as group condition information). Fig.50 A block diagram showing the structure of the group condition storage unit 335 is shown.

[0618] The group condition information may include a judgment period, a condition, and a group.

[0619] The judgment period indicates the period for performing the grouping operation. The judgment period can be the same as the judgment period of the above-mentioned behavior information, for example, it can be a specified action behavior and the time for the action behavior to be performed (for example, from the start of the action behavior to 10 seconds, and the action behavior ends after 10 seconds). The length of the judgment period can be, for example, 1 second, 1 minute, 1 hour, 1 day, etc., which can be set arbitrarily.

[0620] The condition may be a condition related to a specific viewer, such as the latest user activity, past user activity, the group to which the viewer belongs, etc. For example, when the rock-paper-scissors game is first played, the move made by the viewer (e.g., when the viewer plays paper, etc.) can be used as a condition, and then, for the second and subsequent games, it can be set that the viewer belongs to the winner group and the move made is a specific move (rock, scissors, or paper).

[0621] The group condition information can also set multiple conditions. The group is the group to which the audience who meets the above conditions will belong. For example, the condition can be specified to belong to the winner group, and the player who plays the rock, and the group condition information specifies that the group is the winner group, which means that the audience who has won until the previous time (or, it can be a tie) and the audience who plays the rock during the judgment period will be assigned to the winner group.

[0622] In the sixth embodiment, it is assumed that the group condition information sets all possible modes that the viewer may adopt. For example, it is assumed that the group condition information includes a condition that specifies a default (there is no viewer matching other conditions).

[0623] The group storage unit 336 can manage the groups to which viewers of the distributed video belong. Fig.51The following is a block diagram showing the structure of the group storage unit 336. The group storage unit 336 stores group information including a viewer ID indicating a viewer and a group to which the viewer belongs.

[0624] The video distribution unit 311 distributes the video. The video distribution unit 311 generates (and encodes if necessary) the distribution video by synthesizing the action behavior (or multiple action behaviors) performed by the action processing unit 313 described later. In addition, the video delivery unit 311 can deliver the video to the user terminal 1 by sending the generated delivery video to the streaming server 2.

[0625] The activity acquisition unit 312 acquires activities and stores the acquired activity contents as activity information in the activity storage unit 334. The user may set what type of activities the activity acquisition unit 312 acquires. The setting information indicating the type of activities to be acquired may be stored in, for example, the memory 302 or the storage device 303.

[0626] The activity acquisition unit 312 can register, for example, a key press, a touch, or a click input by the viewer as user activity information. For example, when the viewer uses a web browser to watch a distributed video, a script is set in advance to send the click activity occurring on the web browser to the streaming server 2 or the distributor device 3. In this way, the activity acquisition unit 312 can acquire the click activity via the streaming server 2 or directly acquire the click activity.

[0627] Also, the activity acquisition unit 312 can, for example, obtain the comments distributed by the viewer by calling the API when the streaming server 2 provides an API for obtaining distributed comments. In addition, the activity acquisition unit 312 can parse the comments and register the comments containing the specified keywords as user activity information.

[0628] In addition, the activity acquisition unit 312 may, for example, receive acquired voice data from the user terminal 1 , and analyze the received voice data to register a specific utterance as user activity information.

[0629] The sound may be analyzed at the user terminal 1 , and the activity acquisition unit 312 may receive the analysis result directly from the user terminal 1 or via the streaming media server 2 , and register the analysis result as user activity information.

[0630] The activity acquisition unit 312 may also receive the captured viewer image from the user terminal 1, and analyze the received image to acquire the viewer's posture, sight line, and gesture. In addition, the image may be analyzed at the user terminal 1, and then the analysis result may be received by the activity acquisition unit 312. The activity acquisition unit 312 may periodically count the number of viewers and register the number in the system activity information. However, the image may be analyzed at the user terminal 1, and the activity acquisition unit 312 may receive the analysis result directly from the user terminal 1 or via the streaming media server 2, and register the analysis result as the user activity information.

[0631] Furthermore, in the rock-paper-scissors game of the sixth embodiment, the action acquisition unit 312 may register, for example, the moves made by the viewer as user acquisition information.

[0632] The moves in the rock-paper-scissors game can be buttons for rock, scissors, and paper that are set on the web browser for the viewer to click.

[0633] In addition, the hand of rock-paper-scissors is displayed in the distribution video, and the field corresponding to each move is set. Then, the position information of the clicked point in the distribution video is sent to the distributor device 3 via the streaming media service 2, or directly to the distributor device 3. Then, the activity acquisition unit 312 will determine whether there is a corresponding move based on whether the clicked position has a corresponding move, and can judge the move of the viewer.

[0634] This determination may be performed on the user terminal 1 or the streaming server 2. Furthermore, the action acquisition unit 312 may determine the hand of the viewer when, for example, a statement indicating a hand for rock-paper-scissors is drawn in the viewer's posted comment.

[0635] For example, it is pre-set that a timeout activity can be obtained from a clock, and in this case, the event acquisition unit 312 can also register the time from the start of playing the distributed video to the time when the specified time has passed as system activity information. In addition, the activity acquisition unit 312 can also register a specified time point (for example, the time point when the date is changed, exactly 3 pm, etc.) as system activity information.

[0636] Also, the activity acquisition unit 312 may acquire weather information from, for example, a server of a weather company, and register weather elements of a specific area (eg, the location of each viewer or distributor, or a predetermined area) as system activity information.

[0637] Also, for example, when the material data is a 3D model, the activity acquisition unit may register system activity information that has determined the collision of objects in the distributed video as information.

[0638] The behavior processing unit 313 performs action behaviors on the material data. The behavior processing unit 313 receives the action behavior to be performed first and performs it. Since the action behavior also has the possibility of activating other action behaviors, in this case, the behavior processing unit 313 can continue to perform the action behaviors in sequence. In addition, the action behaviors can also be branched and executed in parallel.

[0639] In addition, the behavior processing unit 313 executes the action behavior corresponding to the activity. The behavior processing unit 313 counts the activity information of the corresponding period in the activity storage unit 334 for the behavior information stored in the behavior storage unit 333, and determines whether the conditions are met. If the conditions are met, the behavior processing unit 313 will execute the action behavior set in the behavior information. Therefore, the development of the video can be dynamically changed according to the activity.

[0640] The behavior processing unit 313 may also refer to the group to which the viewer belongs. That is, when the behavior information has a group set, the behavior processing unit 313 performs an action behavior corresponding to the activity information of the viewer belonging to the group.

[0641] For example, in the case of the rock-paper-scissors game, only the actions from the audience belonging to the winner group are performed. Therefore, when playing the rock-paper-scissors game, the actions from the loser are not considered, and the game can be played correctly.

[0642] The group setting unit 314 groups the viewers. In the sixth embodiment, the group setting unit 314 groups the viewers every time the behavior processing unit 313 performs an action. In addition, the group setting unit 314 may also perform grouping at any time.

[0643] For example, the activity acquisition unit 312 may perform the grouping operation when acquiring a previously set activity (for example, a viewer's reaction such as a viewer's comment) or every time a predetermined time has passed.

[0644] The group setting unit 314 searches for group condition information that satisfies the condition for each viewer among the group condition information registered in the group condition storage unit 335. Then, the group setting unit 312 determines whether the viewer belongs to the group set in the searched group condition information.

[0645] The group setting unit 314 generates group information corresponding to the determined viewer and registers it in the group storage unit 336. If the group information corresponding to the viewer has been previously registered in the group storage unit 336, the group setting unit 314 updates the information.

[0646] In the sixth embodiment, the group condition information sets the conditions for playing rock-paper-scissors (and, for the second and subsequent games, the viewer must belong to the winner group), and the viewer who meets the conditions will be set as the winner group.

[0647] In addition, there is also a setting that other viewers are set as the loser group. Therefore, the group setting unit 314 will repeatedly perform the rock-paper-scissors game to reduce the number of viewers belonging to the winner group.

[0648] The total output unit 315 can output various totals. The total output unit 315 can totalize, for example, calculate the number of viewers from the user activity information registered in the past, or for each specific word, total the number of viewers who have posted comments containing the specific word. In addition, the total output unit 315 can totalize, for example, the number of viewers belonging to each group from the group storage unit 336. The total output unit 315 can output the totaled quantity. The quantity output from the total output unit 315 will be sent to the user terminal 1 separately from the distributed video. Then, the quantity can be displayed on the user terminal 1 or superimposed on the distributed video.

[0649] The reward processing unit 316 performs processing to reward viewers according to the group. The reward processing unit 316 can, for example, only reward viewers belonging to a specific group, or can give different rewards according to the group. The reward processing performed by the reward processing unit 316 can be a general reward processing such as giving goods. The explanation is omitted here.

[0650] In the sixth embodiment, the reward processing unit 316 gives a reward to the winner of the rock-paper-scissors game, that is, executes rewarding each viewer belonging to the winner group.

[0651] Fig.52 A flowchart showing the processing executed by the video distribution system according to the sixth embodiment of the present disclosure.

[0652] The behavior processing unit 313 receives the instruction of the action behavior to be performed first (S421), and performs the specified action behavior (S422). As a result of performing the action behavior, the output image and sound will be synthesized into video data. Then, the video distribution unit 311 will send the video data to the streaming media server 2.

[0653] The activity acquisition unit 312 will periodically acquire activities (S423). For example, the activity acquisition unit 312 can acquire comments on the distributed video by calling an API provided by the streaming server 2. In addition, the activity acquisition unit 312 can use a timer function to acquire comments distributed after a predetermined time.

[0654] Regarding each behavior information stored in the behavior storage unit 333, if the behavior information has a group set (S424: YES), the behavior processing unit 313 will correspond to the group and read the activity information of the time and date within the judgment period from the activity storage unit 334 (S425). If the behavior information has no group set (S424: NO), all the activity information of the time and date within the judgment period is read from the activity storage unit 334 (S426).

[0655] The behavior processing unit 313 determines whether the activity content of the read activity information satisfies the behavior information (S427).

[0656] In addition, when the behavior information contains information other than activity information and group information, and is conditions corresponding to information managed by the distributor device 3, or conditions corresponding to information that can be obtained from other information processing devices, the behavior processing unit 313 obtains this information and determines whether the conditions are met.

[0657] If the activity satisfies the conditions (S428: YES), the behavior processing unit 313 executes the action behavior included in the behavior information (S429).

[0658] Here, the activity processing unit 313 may stop the previously executed action behavior, or execute the previous action behavior and the new action behavior in parallel, or specify these action behaviors in the new action behavior.

[0659] The group setting unit 314 performs grouping operation on viewers ( S430 ). Fig.53 An explanatory diagram showing a process of grouping viewers in accordance with Embodiment 6 is shown.

[0660] Group setting section 314 performs the following processing on each viewer of the event information.

[0661] The group setting unit 314 reads the group condition information from the group condition storage unit 335 (S441). Then, based on the group condition information that has been read, the activity information corresponding to the viewer and at the date and time within the judgment period is read from the activity storage unit 334 (S442). When the read activity information has information that satisfies the group condition information (S443: YES), the group information is registered in the group storage unit 336 (S444). The group information has a viewer ID that indicates the viewer and a group of the group condition information.

[0662] In the above-described manner, viewers are grouped.

[0663] Back to Fig.52If the behavior information does not terminate the distribution of the video (S431: NO), return to step S423 and repeat the process. For example, in the rock-paper-scissors game, if the number of viewers belonging to the winner group is less than the predetermined number, the behavior information that will terminate the distribution of the video action can be registered.

[0664] When the action behavior of terminating the distribution of the video is performed (S431), the reward processing unit 316 rewards the viewer corresponding to the group (S432) and terminates the processing.

[0665] Taking the rock-paper-scissors game as an example, the reward processing unit 316 can only reward viewers who belong to the winner group.

[0666] Fig.54 The figure shows an example of a viewing screen 50 of a distributed video. The viewing screen 50 is displayed on the user terminal 1. The viewing screen 50 plays a distributed video 51 and displays viewers' real-time comments 52 on the distributed video 51 (which can be displayed in a list format).

[0667] by Fig.54 For example, the character in the distribution video 51 will say (voice) that he is accepting the rock-paper-scissors game 53. Then the viewer will enter text as his own move.

[0668] Then, based on the rock-paper-scissors move included in the comment 52 , the behavior processing unit 313 draws a drawing in the distributed video to indicate the move made by the viewer.

[0669] Although not in Fig.54 As shown, the behavior processing unit 313 can also operate the material data drawn as the distribution video 51 according to the comment 52. For example, when playing the rock-paper-scissors game, when most of the hands are paper, speech information such as "many people play paper" can be added to the distribution video 51.

[0670] The viewing screen 50 also displays the results of the aggregation by the aggregation output unit 315. For example, the number of viewers 55 belonging to the winner group and the percentage of shots in the submissions 56.

[0671] Viewers can refer to the above total results and then decide whether to take action.

[0672] As described above, the video distribution system according to the sixth embodiment distributes videos to the user terminal 1 via the streaming server 2 and can change the distributed video being played in response to various events during the playback of the distributed video.

[0673] Therefore, while using the recorded video, various distribution videos can be developed based on the audience's response, and the distribution of videos in the streaming mode will not lose the sense of presence.

[0674] The video distribution system of the sixth embodiment is described above. The above embodiment is only for the convenience of understanding the present invention and is not limited to the technical solution formed by a specific combination of the above technical features. The present invention can be modified and improved without departing from its intention, and the present invention includes its equivalent technical solutions.

[0675] For example, in this embodiment, the video sent by the distributor device 3 is distributed to the user terminal 1 via the streaming server 2. However, the video can also be distributed directly from the distributor device 3 to each user terminal 1.

[0676] Also, in the embodiment of the present invention, even if the video is playing, as long as the comment meets the conditions, it will migrate to the next component video data ( Fig.52 Step S428). However, it is not limited thereto, and the next action behavior may be executed after the action behavior being executed is completed.

[0677] This embodiment describes that grouping will be performed whenever an action is performed, but it is not limited thereto, and whether to perform grouping can also be determined based on material data or the content of the action. For example, grouping of viewers can be performed only when an image of a character's move is generated.

[0678] In addition, the present embodiment takes the rock-paper-scissors game as an example, but is not limited to this, and can also be applied to entertainment games such as guessing number games, guessing word games, bingo games, look over there games, psychological test games, guessing puzzles, and back-out rock-paper-scissors games.

[0679] <Seventh embodiment>

[0680] The video distribution system according to the seventh embodiment has the following configuration.

[0681] [Project 1]

[0682] A video distribution system, comprising:

[0683] Material library, storing material data for generating videos;

[0684] A video generating unit, which generates a first or second component video based on the first or second material data, and simultaneously generates the generated first or second component video as the video showing the split state;

[0685] A reaction acquisition unit, which acquires reaction information about the reaction of viewers and listeners of the video during the video playback process;

[0686] The behavior processing unit performs the operation on the first material data in response to only the reaction of the viewers belonging to the first group, and performs the operation on the second material data in response to only the reaction of the viewers belonging to the second group.

[0687] [Project 2]

[0688] The video distribution system according to item 1 is characterized by further comprising:

[0689] When the first or second material data is the same material data, the video generating unit stops displaying the split state and generates the video based on the first or second material data.

[0690] [Item 3]

[0691] The video distribution system according to item 1 or item 2 is characterized by further comprising:

[0692] The material data is associated with at least one of the plurality of characters;

[0693] Each of the groups is associated with the role;

[0694] When all of the first or second material data associated with the characters corresponding to the plurality of groups are used, the video generation unit stops displaying the split state and generates the video based on the first or second material data.

[0695] [Item 4]

[0696] The video distribution system according to at least one of items 1 to 3, further comprising:

[0697] The group setting unit groups the viewers according to the response information.

[0698] [Item 5]

[0699] The video distribution system according to item 4 is characterized by further comprising:

[0700] The group storage unit associates the information of the viewer corresponding to the acquired reaction information with the group to which the viewer belongs, and performs storage operation.

[0701] Hereinafter, a video distribution system according to a seventh embodiment will be described. The video distribution system according to the seventh embodiment is a system that dynamically changes the video to be distributed in a streaming manner according to various activities.

[0702] The activities include information about the viewer (hereinafter referred to as user activity information), such as the viewer operating a device, inputting voice or text of the viewer, photographing the viewer, obtaining posture, line of sight, or gesture analyzed from the photographed image, obtaining measurement data measuring the viewer's physical reaction, etc.

[0703] In addition, the activity may also include information obtained by the system, such as the number of viewers watching, weather, time, contact conditions of objects in the video, etc. (hereinafter referred to as system activity information).

[0704] The distributed video is generated based on the material data of the video. The material data is, for example, a 3D model, video data, audio data, etc. Each material data can be set according to the action behavior of the activity.

[0705] Action refers to the operation on material data. Actions can include the appearance, movement, or elimination of objects represented by 3D models, the start and end of animations, the play and stop of videos, the play and stop of sounds, the replacement (replacement) of material data, etc.

[0706] In the seventh embodiment, the distributed video may be a video or image synthesis output as a result of an action.

[0707] In the video distribution system of the seventh embodiment, the distributed video can be dynamically changed by activating and performing actions. The details are as follows.

[0708] Fig.55 A structural diagram of a video distribution system according to a seventh embodiment is shown.

[0709] The video distribution system of the seventh embodiment includes a distributor device 3, and the distributor device 3 is communicatively connected to a streaming server 2, and the streaming server 2 is communicatively connected to a user terminal 1. A plurality of user terminals 1 can be communicatively connected.

[0710] The distributor device 3 is a computer having a function of distributing videos, such as a personal computer, a tablet computer, a smart phone, etc. The distributor device 3 can be, for example, a home computer used by an ordinary user who wants to distribute videos. The video data can be sent from the distributor device 3 to the streaming media server 2 using a streaming media method.

[0711] The streaming server 2 is, for example, a computer such as a workstation, a personal computer, a virtual computer provided by cloud computing, etc. The streaming server 2 distributes the video data received from the distributor device 3 to the user terminal 1. The streaming server 2 can distribute the video data to one or more user terminals 1 at the same time.

[0712] The user terminal 1 is a computer operated by the viewer, such as a personal computer, a tablet computer, a smart phone, etc. The viewer can operate the user terminal 1 to access the streaming server 2, and the user terminal 1 can receive and play the video data distributed from the streaming server 2. The user terminal 1 can also collect various activity information, such as taking photos of the viewer, recording the viewer's voice, and accepting comments entered by the viewer.

[0713] When the streaming media server 2 obtains the activities of one or more viewers, the distributor device 3 can obtain the activities of the viewers through, for example, an API (Application Programming Interface) provided by the streaming media server 2.

[0714] The following description refers to videos distributed via streaming media as well as played linearly as "distributed video".

[0715] The format of the distributed video may be that the image and sound captured by the camera and microphone are encoded in real time into video data and sent out. However, in the seventh embodiment, the distributed video may be image data generated by combining and synthesizing material data.

[0716] Fig.56 1 is a block diagram showing the hardware structure of the distributor device 3. The distributor device 3 includes a CPU 301, a memory 302, a storage device 303, a communication interface 304, an input device 305, and an output device 306.

[0717] The storage device 303 is a device for storing various data and programs, and includes, for example, a hard disk drive, a non-volatile memory, and the like.

[0718] The communication interface 304 is an interface for connecting to the communication network 30, including, for example, an adapter for connecting to Ethernet (registered trademark), a modem for connecting to a public telephone network, a wireless communication device for wireless communication, and a USB (Universal Serial Bus) connector or RS232C connector for serial communication, etc.

[0719] The input device 305 is a device for inputting data, including, for example, a keyboard, a mouse, a touch panel, buttons, a microphone, etc. The output device 306 is a device for outputting data, including, for example, a display, a printer, a speaker, etc.

[0720] Fig.57The block diagram shows the structure of the software of the distributor device 3. As shown in the figure, the distributor device 3 is equipped with processing units such as a video distribution unit 311, an activity acquisition unit 312, a behavior processing unit 313, and a group setting unit, and storage units such as a material library 331, a behavior storage unit 333, an activity storage unit 334, a group condition storage unit 335, and a group storage unit 336.

[0721] The various processing units are implemented by the CPU 301 in the distributor device 3 causing the memory 302 to read and execute the program in the storage device 303. The various storage units are implemented by at least one of the memory 302 and the storage device 303 provided by the distributor device 3 providing a partial storage area.

[0722] The material library 331 stores various types of data (material data) that can be incorporated into a video. The material data includes, for example, 3D models, static images, animations, sound data, MIDI data, character data, and the like. Fig.58 1 is a block diagram showing the structure of the material library 331. As shown in the figure, the material library 331 provides information (material ID) for identifying a material, and stores various material data and roles corresponding to the material data.

[0723] The character is a character corresponding to the video based on the material data, for example, a character that appears in the video based on the material data.

[0724] The behavior storage unit 333 stores operation (action behavior) information (hereinafter referred to as behavior information) on material data.

[0725] Fig.59 1 shows an example of the behavior information stored in the behavior storage unit 333. As shown in the figure, the behavior information includes a behavior ID indicating an action behavior, a judgment period, a group, a condition, and an action behavior.

[0726] The judgment period refers to the period information for judging whether the activity meets the conditions. The judgment period can be a relative period, such as from now to 5 minutes ago. The judgment period can also be an absolute period, such as 00:00 to 00:10 on December 25th. In addition, the judgment period can also be a specified action and the time when the action is performed (for example, from the start of the action to 10 seconds, and the action ends after 10 seconds). The length of the judgment period can be, for example, 1 second, 1 minute, 1 hour, 1 day, etc., which can be set arbitrarily.

[0727] A group is a group that the viewer belongs to. If a group is set for the behavior information, only the activity information associated with the viewer belonging to the set group will be judged to see if it meets the conditions described below.

[0728] The condition may be activity-specific, for example, whether an activity exists, or whether the total value of activities from a plurality of viewers exceeds a threshold.

[0729] For user activity information, conditions may include whether the viewer presses a specific button while playing the video, clicks a designated area on the screen, or the number of viewers who click or touch the video exceeds a threshold.

[0730] Furthermore, based on the material data used to generate the distributed video, whether an object displayed in the distributed video has been clicked or touched, and whether the number of viewers who clicked or touched the object exceeded a threshold can also be used as conditions.

[0731] In addition, whether the viewer has input specified characters (keywords) at the user terminal 1 can also be used as a condition. For example, whether the comments on the distributed video contain specified keywords, or whether the number of viewers who input keywords exceeds a threshold can also be used as a condition.

[0732] In addition, the total number of comments or viewers by region among the viewers who distributed the comments, for example, the total value (average, median, maximum, minimum, etc.) of the amount of money invested by viewers when asking questions in the video, when analyzing the viewers' emotions based on the comments, when the number of viewers with sad emotions exceeds a specified threshold, when comments containing specified keywords have not been posted, etc., can all be used as conditions.

[0733] Furthermore, the atmosphere or emotions of the audience obtained by performing speech recognition analysis can also be used as a condition. For example, whether the audience makes a specific sound, such as clapping, whistling, or stomping, or whether the number of audiences making these sounds exceeds a threshold.

[0734] In this case, speech recognition may be performed by the user terminal 1, and then the recognition result may be sent to the streaming server 2 or the distributor device 3. Either the speech data captured by the user terminal 1 is transmitted via the streaming server 2 to the distributor device 3, or the speech data is directly sent from the user terminal 1 to the distributor device 3, and then the distributor device 3 performs speech recognition.

[0735] Furthermore, conditions may be used to determine whether such images are distributed to the streaming server 2, based on whether the images are self-portraits of the viewers or the atmosphere of the viewers in the images, and whether the number of viewers to whom the images are distributed exceeds a threshold.

[0736] Furthermore, through image analysis, whether an image of a predetermined object (for example, an image of a specific signboard or flyer around the viewer) has been posted, or whether the number of viewers who have posted the image exceeds a threshold value may be used as a condition.

[0737] In addition, information (viewer's posture, line of sight, gesture) recognized by analyzing the image can also be used as a condition. For example, whether the viewer is posing in a specific posture, directing a specific line of sight, making a specific gesture, or whether the number of viewers making the above gestures exceeds a threshold can also be used as a condition.

[0738] In this case, image parsing can be performed by the user terminal 1, and then the recognition result can be sent to the streaming server 2 or the distributor device 3, or the image data captured by the user terminal 1 can be sent via the streaming server 2 to the distributor device 3, or the image data can be sent directly from the user terminal 1 to the distributor device 3, and then the distributor device 3 can perform image parsing.

[0739] Furthermore, for system activity information, for example, whether the number of viewers who watch the distributed image exceeds a threshold may be used as a condition.

[0740] Furthermore, the playback time of the distributed image may be used as a condition, such as the elapsed time from the start of playback to the stop of playback.

[0741] In addition, when the location of the viewer or distributor and the weather in the area are obtained as system activity information, the weather can also be used as a condition, such as sunny days, rainy days, snowy days, a certain wind intensity, a certain temperature, etc.

[0742] Also, when the material data is a 3D model, collision of objects in the distribution video can also be used as a condition.

[0743] Actions are various operations on the material data. Actions can contain parameters so that the material data can be set in detail to perform specific operations.

[0744] Then, in the seventh embodiment, the action behavior can not only operate the material data, but also start and stop other action behaviors, and can also wait for other action behaviors to complete their execution. The action behavior is, for example, a program written in a scripting language and can also be saved.

[0745] The activity storage unit 334 stores various activities that have occurred. Fig.60 A block diagram showing the structure of the active storage unit 334 is shown.

[0746] As described above, the activity storage unit 334 stores user activity information and system activity information.

[0747] Hereinafter, user activity information and system activity information are collectively referred to as activity information. User activity information includes an activity ID indicating an activity, a viewer ID indicating a viewer related to the activity, a time point when the activity occurs, and the content of the activity.

[0748] System activity information includes the activity ID, the time when the activity occurred, and the content of the activity.

[0749] The content of the activity may vary depending on the activity. For example, in the case of user activity information, when a viewer comments on a distributed video, the comment may be set as the content of the activity.

[0750] In addition, when analyzing the viewer image captured by the user terminal 1, the viewer's line of sight and the viewer's gesture, the information indicating the line of sight or gesture may be set as the activity content. In the case of system activity information, the number of viewers, weather, time point, etc. may be set as the activity content.

[0751] Group condition storage section 335 stores conditions for grouping viewers (hereinafter referred to as group condition information). Fig.61 The following is a block diagram showing the structure of the group condition storage unit 335. The group condition information includes a determination period, a condition, and a group. The determination period is a period indicating the grouping operation.

[0752] The judgment period can be the same as the judgment period of the above-mentioned behavior information, for example, it can be a start time and an end time, or it can be a specified action and the time the action is performed (for example, from the start of the action to 10 seconds, and the action ends after 10 seconds). The length of the judgment period can be, for example, 1 second, 1 minute, 1 hour, 1 day, etc., which can be set arbitrarily.

[0753] The conditions may be conditions related to a specific viewer, for example, the latest user activity, past user activity, a group to which the viewer belongs, etc. may all be conditions.

[0754] In the seventh embodiment, it is assumed that the group condition information sets all possible modes that the viewer may adopt. For example, it is assumed that the group condition information specifies a default condition (a viewer who does not match other conditions) is included.

[0755] The group storage unit 336 can manage the groups to which viewers of the distributed video belong. Fig.62 The following is a block diagram showing the structure of the group storage unit 336. The group storage unit 336 stores group information including a viewer ID indicating a viewer, a group to which the viewer belongs, and a role of the viewer.

[0756] The role can be, for example, a role selected by the viewer or a role automatically assigned to the viewer. For example, when the viewer decides to chase a character in a distributed video, the input of the role can be received and registered as group information.

[0757] The video distribution unit 311 distributes the video. The video distribution unit 311 generates (and encodes if necessary) the distribution video by synthesizing the action behavior (or multiple action behaviors) performed by the action processing unit 313 described later. In addition, the video delivery unit 311 can deliver the video to the user terminal 1 by sending the generated delivery video to the streaming server 2.

[0758] The activity acquisition unit 312 acquires an activity and stores the acquired activity content as activity information in the activity storage unit 334. Then, the user can set what kind of activity to acquire. The setting information indicating the type of activity to acquire can be stored in, for example, the memory 302 or the storage device 303. The activity acquisition unit 312 can register, for example, a key, touch, or click input by the viewer as user activity information. For example, in the case where the viewer uses a web browser to watch a distributed video, a script is set in advance to send the click activity occurring on the web browser to the streaming server 2 or the distributor device 3, so that the activity acquisition unit 312 can acquire the click activity via the streaming server 2, or directly acquire the click activity.

[0759] Also, the activity acquisition unit 312 can, for example, obtain the comments distributed by the viewer by calling the API when the streaming server 2 provides an API for obtaining distributed comments. In addition, the activity acquisition unit 312 can parse the comments and register the comments containing the specified keywords as user activity information.

[0760] In addition, the activity acquisition unit 312 may, for example, receive acquired voice data from the user terminal 1 , and analyze the received voice data to register a specific utterance as user activity information.

[0761] The sound may be analyzed at the user terminal 1 , and the activity acquisition unit 312 may receive the analysis result directly from the user terminal 1 or via the streaming media server 2 , and register the analysis result as user activity information.

[0762] The activity acquisition unit 312 may also receive a captured viewer image from the user terminal 1 and analyze the received image to acquire the viewer's posture, sight line, and gesture. In addition, the image may also be analyzed at the user terminal 1, and the activity acquisition unit 312 may receive the analysis result.

[0763] The activity acquisition unit 312 can periodically count the number of viewers and register the number in the system activity information. However, the image can be analyzed at the user terminal 1, and the activity acquisition unit 312 can receive the analysis result directly from the user terminal 1 or via the streaming media server 2, and register the analysis result as the user activity information.

[0764] For example, it is pre-set that a timeout activity can be obtained from a clock, and in this case, the event acquisition unit 312 can also register the time from the start of playing the distributed video to the time when the specified time has passed as system activity information. In addition, the activity acquisition unit 312 can also register a specified time point (for example, the time point when the date is changed, exactly 3 pm, etc.) as system activity information.

[0765] Also, the activity acquisition unit 312 may acquire weather information from, for example, a server of a weather company, and register weather elements of a specific area (eg, the location of each viewer or distributor, or a predetermined area) as system activity information.

[0766] Also, for example, when the material data is a 3D model, the activity acquisition unit may register system activity information that has determined the collision of objects in the distributed video as information.

[0767] The behavior processing unit 313 performs action behaviors on the material data. The behavior processing unit 313 receives the action behavior to be performed first and performs it. Since the action behavior also has the possibility of activating other action behaviors, in this case, the behavior processing unit 313 can continue to perform the action behaviors in sequence. In addition, the action behaviors can also be branched and executed in parallel.

[0768] In addition, the behavior processing unit 313 executes the action behavior corresponding to the activity. The behavior processing unit 313 counts the activity information of the corresponding period in the activity storage unit 334 for the behavior information stored in the behavior storage unit 333, and determines whether the conditions are met. If the conditions are met, the behavior processing unit 313 will execute the action behavior set in the behavior information. Therefore, the development of the video can be dynamically changed according to the activity.

[0769] The behavior processing unit 313 may also refer to the group to which the viewer belongs. That is, when the behavior information has a group set, the behavior processing unit 313 performs an action behavior corresponding to the activity information of the viewer belonging to the group.

[0770] For example, in the case of the rock-paper-scissors game, only the actions from the audience belonging to the winner group are performed. Therefore, when playing the rock-paper-scissors game, the actions from the loser are not considered, and the game can be played correctly.

[0771] The group setting unit 314 performs grouping operations on viewers.

[0772] In the seventh embodiment, the group setting unit 314 performs grouping of viewers every time the behavior processing unit 313 performs an action behavior. In addition, the group setting unit 314 may perform grouping at any timing.

[0773] For example, the activity acquisition unit 312 may perform the grouping operation when acquiring a pre-set activity (for example, a viewer responds to a posted comment) or every time a predetermined time has passed.

[0774] The group setting unit 312 searches for group condition information that satisfies the condition for each viewer among the group condition information registered in the group condition storage unit 335. Then, the group setting unit 312 determines whether the viewer belongs to the group set in the searched group condition information.

[0775] The group setting unit 314 generates group information corresponding to the determined viewers and registers it in the group storage unit 336 .

[0776] If the group information corresponding to the viewer has been previously registered in the group storage unit 336, the group setting unit 314 will update the information.

[0777] The total output unit 315 can output various totals. The total output unit 315 can calculate the number of viewers from the user activity information registered in the past, or for each specific word, calculate the number of viewers who have posted comments containing the specific word. In addition, the total output unit 315 can calculate, for example, the number of viewers belonging to each group from the group storage unit 336.

[0778] The total output unit 315 can output the totaled quantity. The quantity output from the total output unit 315 is sent to the user terminal 1 separately from the distribution video. Then, the quantity can be displayed on the user terminal 1 or superimposed on the distribution video.

[0779] The reward processing unit 316 performs processing to reward viewers according to the group. The reward processing unit 316 can, for example, only reward viewers belonging to a specific group, or can give different rewards according to the group. The reward processing performed by the reward processing unit 316 can be a general reward processing such as giving goods. Explanation is omitted here.

[0780] In the seventh embodiment, the reward processing unit 316 gives a reward to the winner of the rock-paper-scissors game, that is, executes rewarding each viewer belonging to the winner group.

[0781] Fig.63 A flowchart showing the processing performed by the video distribution system according to the seventh embodiment of the present disclosure.

[0782] The video distribution unit 311 divides the screen in the distribution video (S401). In the seventh embodiment, the video distribution unit 311 displays a plurality of animations and synthesizes them to realize the divided screen. The number of divided screens can be divided according to the number of groups.

[0783] The behavior processing unit 313 receives the first action behavior specified by each group to be executed (S402), and executes the specified action behavior (S403).

[0784] The video and sound output as a result of executing the action behavior are synthesized to generate video data.

[0785] The behavior processing unit 313 connects the screen to the group and the character corresponding to the material data used when the action behavior is performed (S404).

[0786] The video distribution unit 311 synthesizes the video data generated by each group into a distribution video of a divided display screen, and sends it to the streaming server 2 (S405).

[0787] The behavior processing unit 313 performs processing for each group such as Fig.64 The action behavior shown (S406).

[0788] The activity acquisition unit 312 will periodically acquire activities (S421)

[0789] For example, the activity acquisition unit 312 may acquire comments on the distributed video by calling an API provided by the streaming server 2 .

[0790] In addition, the activity acquisition unit 312 may utilize a timer function to acquire comments distributed after a predetermined time.

[0791] The behavior processing unit 313 reads the activity information corresponding to the group and belonging to the time and date during the judgment period from the activity storage unit 334 for each behavior activity of the group (S423). The behavior processing unit 313 determines whether the activity content of the read activity information satisfies the condition of the behavior information (S424).

[0792] In addition, when the behavior information contains information other than activity information and group information, and corresponds to conditions of information managed by the distributor device 3, or corresponds to conditions of information that can be obtained from other information processing devices, the behavior processing unit 313 obtains this information and determines whether the conditions are met.

[0793] If the activity satisfies the conditions (S425: YES), the behavior processing unit 313 executes the action included in the behavior information (S426).

[0794] Here, the activity processing unit 313 may stop the previously executed action behavior, or execute the previous action behavior and the new action behavior in parallel, or specify these action behaviors in the new action behavior.

[0795] The group setting unit 314 performs grouping of viewers based on the execution of the action ( S427 ).

[0796] Fig.65 An explanatory diagram showing a process of grouping viewers in accordance with Embodiment 7 is shown.

[0797] Group setting section 314 performs the following processing on each viewer of the event information.

[0798] The group setting unit 314 reads the group condition information from the group condition storage unit 335 (S441). Then, based on the read group condition information, the activity information corresponding to the viewer and the date and time within the judgment period is read from the activity storage unit 334 (S442).

[0799] If the read activity information has information that satisfies the group condition information (S443: YES), the group information is registered in the group storage unit 336 (S444). The group information has a viewer ID representing the viewer and a group of the group condition information. In the above manner, the viewers are grouped.

[0800] Back to Fig.64 , the behavior processing unit 313 obtains the role corresponding to the material data used when performing the action behavior from the material library 331, and associates the role with the group.

[0801] Each action will be processed by the above method. Fig.63 If the characters associated with each group are the same character, the video distribution unit 311 will unsegment the screen. That is, later, the video distribution unit 311 and the behavior processing unit 313 will create an image based on the material data and execute the operation material data for one screen (or a partially integrated screen).

[0802] If the roles in each screen are not consistent (S407: NO), the screen will be split (S409). If the behavior information does not terminate the distribution of the video (S431: NO), return to step S402 and repeat the process.

[0803] As described above, the video distribution system according to the seventh embodiment distributes videos to the user terminal 1 via the streaming server 2, and can change the distributed video being played in response to various events during the playback of the distributed video.

[0804] Therefore, while using the recorded video, various distribution videos can be developed based on the audience's response, and the distribution of videos in the streaming mode will not lose the sense of presence.

[0805] Furthermore, in the video distribution system of the seventh embodiment, the screen is divided, and each screen changes the development of the video according to the response of the viewers belonging to the corresponding group.

[0806] Since the development of the video changes according to different groups of each frame, it can bring unexpected stories.

[0807] Fig.66 An example of a distributed video screen 50 is shown. In the example of the screen 50, the distributed video is divided into two partial videos, namely, a partial video 52 and a partial video 53.

[0808] As shown in the comment display column 54, the viewer can post comments in the comment display column 54. The viewer is associated with each screen according to the group. Then, according to the viewer's comment, the action behavior is applied to the data material in the video data displayed on the screen corresponding to the group to which the viewer belongs.

[0809] From this point on, the partial video 52 and the partial video are independent, and the development of the video is changed according to the comments of the viewers to which the corresponding group belongs.

[0810] The plot development of partial video 52 and partial video 53 is independent and parallel, thus providing viewers with a new type of distributed video experience.

[0811] Furthermore, as described above, if the characters appearing in partial video 52 and partial video 53 overlap, the split state of distributed video 51 will be released and displayed as a single video. That is, if the plots independently developed by the partial videos overlap, the screen will be integrated, and if the plots are independent, the screen will be split.

[0812] In this way, the behaviors of multiple characters (which are intertwined with each other) will change according to the reactions of the audience, thus creating a less predictable storyline.

[0813] The above describes the video distribution system of the seventh embodiment. The above embodiment is only for the convenience of understanding the present invention and is not limited to the technical solution formed by a specific combination of the above technical features. The present invention can be modified and improved without departing from its intention, and the present invention includes its equivalent technical solutions.

[0814] For example, in this embodiment, the video sent by the distributor device 3 is distributed to the user terminal 1 via the streaming server 2. However, the video can also be distributed directly from the distributor device 3 to each user terminal 1.

[0815] Also, in the embodiment of the present invention, even if the video is playing, as long as the comment meets the conditions, it will migrate to the next component video data ( Fig.64 Step S426). However, it is not limited thereto, and the next action behavior may be executed after the action behavior being executed is completed.

[0816] This embodiment describes that the grouping operation will be performed every time an action is performed, but it is not limited thereto. It can also be determined whether the grouping operation is to be performed based on material data or the content of the action.

[0817] Also, in this embodiment, the video distribution unit 311 combines multiple videos and displays them simultaneously to achieve screen segmentation. However, it is not limited to this. For example, the screen can also be segmented on the user terminal 1, and then the video distribution unit 311 sends multiple videos to the user terminal 1 to achieve screen segmentation.

[0818] Explanation of symbols

[0819] 1 User Terminal

[0820] 2 Streaming Server

[0821] 3 Distributor Device

[0822] 311 Video Release Unit

[0823] 312 Comments acquisition unit

[0824] 313 Switching decision unit

[0825] 331 Video Library

[0826] 332 scene storage unit

[0827] 333 Conditional Storage Unit

[0828] 334 Comments Storage Unit

[0829] ==Second Embodiment==

[0830] 1 User Terminal

[0831] 2 Streaming Server

[0832] 3 Distributor Device

[0833] 311 Video Release Unit

[0834] 312 Activity Acquisition Unit

[0835] 313 Behavior Processing Unit

[0836] 331 Material Library

[0837] 333 Behavior storage part

[0838] 334 Active Storage Unit

[0839] ==Third Embodiment==

[0840] 1 User Terminal

[0841] 2 Streaming Server

[0842] 3 Distributor Device

[0843] 311 Music Distribution Unit

[0844] 312 Comments acquisition unit

[0845] 313 Switching decision unit

[0846] 331 Video Library

[0847] 332 scene storage unit

[0848] 333 Condition storage unit 334 Comment storage unit

[0849] ==Fourth Implementation Method==

[0850] 1 User Terminal

[0851] 2 Streaming Server

[0852] 3 Distributor Device

[0853] 311 Video Release Unit

[0854] 312 Comments acquisition unit

[0855] 313 Switching decision unit

[0856] 331 Video Library

[0857] 332 scene storage unit

[0858] 333 Conditional Storage Unit

[0859] 334 Comment storage unit 335 User information storage unit =Fifth embodiment==

[0860] 1 User Terminal

[0861] 2 Streaming Server

[0862] 3 Distributor Device

[0863] 311 Video Release Unit

[0864] 312 Activity Acquisition Unit

[0865] 313 Behavior Processing Unit

[0866] 331 Material Library

[0867] 333 behavior storage part 334 activity storage unit

[0868] ==Sixth Implementation Method==

[0869] 1 User Terminal

[0870] 2 Streaming Server

[0871] 3 Distributor Device

[0872] 311 Video Release Unit

[0873] 312 Activity Acquisition Unit

[0874] 313 Behavior Processing Unit

[0875] 314 Group Setting Unit

[0876] 315 Total Output Unit

[0877] 316 Reward Processing Unit

[0878] 331 Material Library

[0879] 333 Behavior storage part

[0880] 334 Active Storage Unit

[0881] 335 Group condition storage unit 336 Group storage unit

[0882] ==Seventh Implementation Method==

[0883] 1 User Terminal

[0884] 2 Streaming Server

[0885] 3 Distributor Device

[0886] 311 Video Release Unit

[0887] 312 Activity Acquisition Unit

[0888] 313 Behavior Processing Unit

[0889] 314 Group Setting Unit

[0890] 315 Total Output Unit

[0891] 316 Reward Processing Unit

[0892] 331 Material Library

[0893] 333 Behavior storage part

[0894] 334 Active Storage Unit

[0895] 335 Group condition storage unit 336 Group storage unit

Claims

1. A video distribution system, It is characterized in that include: Video library, storing multiple video data; A video distribution unit, which distributes the video data; a reaction acquisition unit, which acquires reaction information representing the reactions of a plurality of viewers at least during the playing of the first video data; a switching decision unit, which determines, according to the response information, second video data to be distributed after the first video data; A scene storage unit for storing information of the video data to be distributed after each of the video data; a condition storage unit for storing the condition of the reaction information and the information for distributing the video data in the next step; When the reaction information meets the condition, the switching decision unit will determine that the video data to be distributed after the first video data corresponding to the condition met by the reaction information is the second video data. When the reaction information does not meet the condition, the switching decision unit will determine from the scene storage unit that the video data to be distributed after the first video data is the second video data.

2. The video distribution system according to claim 1, It is characterized in that The video distribution unit sends the first video data to a video distribution server that distributes the video data to a user terminal of each of the viewers; The plurality of user terminals transmit the comments input by the viewers to the video distribution server; The reaction acquisition unit acquires the comment as the reaction information from the video distribution server; The switching decision unit determines to distribute the second video data based on the number of specific words included in the comments and / or based on the number of viewers who have posted the comments containing the specific words.

3. A music distribution system, It is characterized in that include: Music library, storing multiple music data; A music distribution unit, which distributes the music data; A reaction acquisition unit, which acquires reaction information representing the reactions of a plurality of viewers and listeners at least during the period of playing the first music data; a switching decision unit, which determines, according to the response information, second music data to be distributed after the first music data; A scene storage unit for storing information of the music data distributed after each of the music data; a condition storage unit storing the condition of the reaction information and the information that the music data will be distributed in the next step; When the reaction information meets the condition, the switching decision unit will determine that the music data to be distributed after the first music data corresponding to the condition met by the reaction information is the second music data. When the reaction information does not meet the condition, the switching decision unit will determine from the scene storage unit that the music data to be distributed after the first music data is the second music data.

4. The music distribution system according to claim 3, It is characterized in that The music distribution unit sends the first music data to a music distribution server that distributes the music data to a user terminal of each of the viewers; The plurality of user terminals transmit the comments input by the viewers to the music distribution server; The reaction acquisition unit acquires the comment as the reaction information from the music distribution server; The switching decision unit decides to distribute the second music data based on the number of specific words included in the comment.

5. A video distribution system, It is characterized in that include: Video library, storing multiple video data; A video distribution unit, which distributes the video data; a video reaction acquisition unit, which acquires reaction information of one or more viewers and listeners according to a priority order at least during the playing of the first video data; a switching decision unit, which determines, according to the response information, second video data to be distributed after the first video data; A scene storage unit for storing information of the video data to be distributed after each of the video data; a condition storage unit for storing the condition of the reaction information and the information for distributing the video data in the next step; When the reaction information meets the condition, the switching decision unit will determine that the video data to be distributed after the first video data corresponding to the condition met by the reaction information is the second video data. When the reaction information does not meet the condition, the switching decision unit will determine from the scene storage unit that the video data to be distributed after the first video data is the second video data.

6. The video distribution system according to claim 5, It is characterized in that The video distribution unit sends the first video data to a video distribution server that distributes the video data to a user terminal of each of the viewers; One or more of the user terminals transmit the comments input by the viewers to the video distribution server; The reaction acquisition unit acquires the comment as the reaction information from the video distribution server; The switching decision unit determines the second video data according to the comment.

7. The video distribution system according to claim 5, It is characterized in that The priority order is determined based on the payment amount of the viewer.

8. The video distribution system according to claim 5, It is characterized in that The priority order is determined based on the status information of the viewer.