Video generation system, video generation program, and video generation method

Abstract

To provide a video generation system, a video generation program, and a video generation method, related to creation of an on-demand video in which a viewer can participate.SOLUTION: In a video generation system for generating on-demand video content for which a response of a viewer can be browsed, an information processing apparatus includes a storage unit, a display medium acquisition unit, an action data acquisition unit, and a display unit. The storage unit stores video information for displaying on-demand video content. The display medium acquisition unit acquires a display medium indicating a video of a viewer or an image registered in advance for each viewer, or an avatar. The action data acquisition unit acquires, when the viewer views video content, action data indicating an action of the viewer with respect to the video content, in association with reproduction timing of the video content. The display unit displays on-demand video content including the display medium associated with the viewer, on the basis of the action data and the associated reproduction timing.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a video generation system, a video generation program, and a video generation method.

Background Art

[0002] Conventionally, techniques for allowing viewers to participate in video content have been known. For example, Patent Documents 1 and 2 propose an example of a technique for displaying a viewer's avatar together with a performer in live streaming.

Prior Art Literature

Patent Literature

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problem to be Solved by the Invention

[0004] On the other hand, in on-demand video content, unlike video content such as live streaming, playback timing differs for each viewer. Therefore, although on-demand video content can be played back any number of times without a viewing deadline, there has been a problem that the sense of unity among viewers that can be obtained in live streaming is impaired. Accordingly, there has been a demand for a technique for generating on-demand video content that achieves such a sense of unity among viewers.

[0005] In view of the above circumstances, an object of the present invention is to provide a novel technique related to generation of on-demand video content that allows viewers to participate.

Means for Solving the Problem

[0006] To solve the above problems, the present invention provides a video generation system for generating on-demand video content in which viewer reactions can be viewed, wherein the video generation system comprises a storage unit, a display medium acquisition unit, an action data acquisition unit, and a display unit, wherein the storage unit stores video information for displaying on-demand video content, the display medium acquisition unit acquires a display medium showing the viewer's video, or an image or avatar registered in advance for each viewer, the action data acquisition unit acquires action data indicating the viewer's actions toward the video content in association with the playback timing of the video content when the viewer views the video content, and the display unit processes the on-demand video content, including the display medium associated with the viewer, based on the action data and the associated playback timing, to display the video content.

[0007] Furthermore, the present invention relates to a video generation method for generating on-demand videos in which viewer reactions can be viewed, wherein the video generation system includes the steps of: storing video information for displaying on-demand video content; acquiring a display medium showing the viewer's image, or an image or avatar registered in advance for each viewer; acquiring behavioral data indicating the viewer's actions toward the video content in association with the playback timing of the video content when the viewer views the video content; and the display unit processing the on-demand video, including the display medium associated with the viewer, based on the behavioral data and the associated playback timing.

[0008] Furthermore, the present invention relates to a video generation program that generates on-demand videos in which viewer reactions can be viewed, and the computer functions as an information processing device that stores video information for displaying on-demand video content, acquires a display medium showing the viewer's image, or an image or avatar registered in advance for each viewer, acquires viewer behavior data associated with the playback timing of the video content when the viewer watches the video content, and processes the on-demand video including the display medium associated with the viewer based on the behavior data and the associated playback timing.

[0009] This configuration allows for the creation of on-demand videos that display viewers' actions on video content. This makes it possible to understand at what point in the video content viewers took action.

[0010] In a preferred embodiment of the present invention, the display unit displays a viewer list, which is a list of multiple viewer display media identified based on the behavioral data, arranged on the same screen, and the video content, in a switchable manner.

[0011] This configuration allows for switching between displaying the video content and the viewer who has watched it.

[0012] In a preferred embodiment of the present invention, the storage unit stores attribute information indicating the attributes of each viewer, and the display unit processes the display of a display medium that is highly relevant to the viewer from among a plurality of display media of the viewer who has viewed the on-demand video content, based on the attribute information of the viewer who is viewing the on-demand video content and the attribute information of viewers who have viewed the on-demand video content in the past.

[0013] This structure allows us to understand what kind of actions viewers with similar interests took in response to different types of video content.

[0014] In a preferred embodiment of the present invention, the storage unit stores date and time information indicating the viewing date and time for each viewer, and the display unit displays the display medium corresponding to the viewer having specific date and time information from among a plurality of display media based on the date and time information.

[0015] This configuration allows us to understand when and at what time viewers took action on the video content.

[0016] In a preferred embodiment of the present invention, the display unit processes the display of multiple display media and video content on the same screen based on the behavioral data.

[0017] This configuration allows for simultaneous monitoring of video content and viewer actions on that content. This makes it easy to determine at what point in the video playback viewer actions occurred.

[0018] In a preferred embodiment of the present invention, the video content consists of multiple contents, the behavior data acquisition unit acquires the behavior data and the contents in association based on the occurrence timing, which is the playback timing at which the behavior data is received, and the display unit processes the display medium to display the video content in a manner corresponding to the behavior data, based on the playback timing, contents, and behavior data of the video content.

[0019] This structure allows us to understand what actions viewers took in response to each type of video content.

[0020] In a preferred embodiment of the present invention, the behavioral data includes a departure timing indicating the timing at which each viewer has finished viewing, and the display unit processes the display medium at the playback timing after the departure timing in a manner different from the display medium at the playback timing before the departure timing, based on the departure timing.

[0021] With such a configuration, it can be easily confirmed which viewer stopped viewing the video content at which playback timing. This makes it possible to grasp which playback timing of the video content was unattractive to viewers.

[0022] In a preferred embodiment of the present invention, the behavior data further includes reaction information indicating an evaluation of the video received for each viewer, and based on the reaction information, on-demand video in which a mark corresponding to the reaction information is superimposed on the display medium is subjected to display processing.

[0023] With such a configuration, which viewer gave what kind of reaction can be easily grasped.

[0024] In a preferred embodiment of the present invention, the video content includes a plurality of contents, the contents include questions, the storage unit stores correct answer information for each question, and the display unit performs display processing on video content including a display medium in a mode corresponding to a combination of the reaction information and the correct answer information at a playback timing after the question, based on the question, the reaction information for an answer linked to the question, and the correct answer information.

[0025] With such a configuration, it is possible to grasp at which playback timing a viewer gave an incorrect answer.

[0026] The video content includes a plurality of questions, the storage unit stores correct answer information for each question, the display unit calculates a count for each question based on the question, the reaction information for an answer linked to the question, and the correct answer information, and performs display processing on video content including a total count obtained by respectively adding the counts calculated for each question before a specific playback timing at the specific playback timing.

[0027] With such a configuration, how many questions a viewer answered correctly can be grasped for each viewer. Effects of the Invention

[0028] This invention can provide a novel technology for generating on-demand videos in which viewers can participate. [Brief explanation of the drawing]

[0029] [Figure 1] A block diagram showing the system configuration in a subset of ABV. [Figure 2] Hardware configuration diagram of an information processing device in one embodiment of the present invention. [Figure 3] Functional block diagram of a system (information processing device) according to one embodiment of the present invention. [Figure 4] An example of information stored in a database in a system according to one embodiment of the present invention. [Figure 5] A processing flowchart for generating viewer-participation videos in a system relating to one embodiment of the present invention. [Figure 6] An illustrative diagram showing how viewer behavior data is registered in a system according to one embodiment of the present invention. [Figure 7] A processing flowchart for generating viewer-participation videos in a system relating to one embodiment of the present invention. [Figure 8] An illustrative diagram showing the process of displaying viewer-participation videos in a system relating to one embodiment of the present invention. [Figure 9] An example of screen display of viewer-participation video in a system according to one embodiment of the present invention. [Figure 10] Another example of screen display of viewer-participation video in a system according to another embodiment of the present invention. [Figure 11] Another example of screen display of viewer-participation video in a system according to another embodiment of the present invention. [Figure 12] Another example of screen display of viewer-participation video in a system according to another embodiment of the present invention. [Figure 13] Another example of screen display of viewer-participation video in a system according to another embodiment of the present invention. [Figure 14] Another example of screen display of viewer-participation video in a system according to another embodiment of the present invention. [Modes for carrying out the invention]

[0030] Further details will be provided below with reference to the attached screenshots. The drawings illustrate preferred embodiments. However, many different forms are possible and the embodiments are not limited to those described herein.

[0031] For example, in this embodiment, the configuration and operation of the video generation system will be described, but similar effects can be achieved by the method, device, computer program, etc. of execution. The program in this embodiment may be provided as a non-transient recording medium that can be read by a computer, or it may be provided so that it can be downloaded from an external server, or the program may be launched on an external computer in order to realize its functions on a client terminal (so-called cloud computing).

[0032] Furthermore, in this embodiment, "part" may include, for example, hardware resources implemented by circuits in a broad sense, and information processing of software that can be specifically realized by these hardware resources. In this embodiment, "information" can be represented, for example, by the physical values ​​of signal values ​​representing voltage and current, the high or low values ​​of signal values ​​as a set of binary bits composed of 0s or 1s, or by quantum superposition (so-called qubits), and communication and calculations can be performed on circuits in a broad sense. Circuits in a broad sense are circuits realized by appropriately combining circuits, circuits, processors, and memories, etc. That is, they include CPUs (Central Processing Units), GPUs (Graphics Processing Units), LSIs (Large Scale Integrations), ASICs (Application Specific Integrated Circuits), FPGAs (Field-Programmable Gate Arrays), etc.

[0033] (Embodiment 1) Hereinafter, Embodiment 1 of the present invention will be described with reference to the drawings. First, before describing the function of the present invention, a configuration that can effectively implement this function will be described with reference to Figures 1 and 2.

[0034] In the following, the viewer in this invention is defined as a viewer who inputs instructions for displaying video content and intends to watch the video content, and a viewer who has previously watched the video content. In the following, the former will be referred to as the "current viewer," and the latter as the "past viewer." Furthermore, unless there is a particular need to distinguish between them, the term "viewer" will be used.

[0035] <System Configuration> Figure 1 is a block diagram showing the configuration of a system according to one embodiment. As shown in Figure 1, the video generation system 0 comprises an information processing device 1 and a terminal device 9 (user terminal device 2). The information processing device 1 and the user terminal device 2 are configured to communicate with each other via a communication network NW. In this embodiment, the communication network NW is an IP (Internet Protocol) network, but there are no restrictions on the type of communication protocol, and furthermore, there are no restrictions on the type or size of the network.

[0036] Furthermore, a general-purpose server computer or personal computer can be used as the information processing device 1. It is also possible to configure the information processing device 1 using multiple computers. A smartphone, tablet, personal computer, wearable device, etc., can be used as the user terminal device 2. In this embodiment, the video generation system 0 is described as a server-client type system in which the information processing device 1 operates as a server and the user terminal device 2 operates as a client. The user terminal device 2 has an application (typically a web browser) for making requests to the information processing device 1 and receiving responses. For example, the information processing device 1 may be configured by installing a video generation program on terminal device 9.

[0037] <Hardware Configuration> Figure 2 is a hardware configuration diagram of the video generation system 0. Figure 2(a) is a diagram showing an example of the hardware configuration of the information processing device 1. The information processing device 1 comprises a control unit 101, a storage unit 102, and a communication unit 103 as its hardware configuration.

[0038] The control unit 101 includes one or more processors such as a CPU, and controls the entire operation of the information processing device 1 by executing the video generation program, OS, browser software, and other applications according to the present invention.

[0039] The storage unit 102 is an HDD, ROM, RAM, etc., and stores the video generation program according to the present invention and data used by the control unit 101 when it executes processing based on the program. The control unit 101 executes processing based on the video generation program stored in the storage unit 102, thereby realizing the functional configuration described later.

[0040] The communication unit 103 performs communication control with the communication network NW and provides inputs necessary for operating the information processing device 1, as well as outputs related to the operation results.

[0041] Figure 2(b) shows an example of the hardware configuration of terminal device 9 (user terminal device 2). Similarly, terminal device 9 also includes a control unit 91, a storage unit 92, a communication unit 93, an input unit 94, and an output unit 95 as its hardware configuration.

[0042] The control unit 91 of the terminal device 9 includes one or more processors such as a CPU and controls the entire operation of the terminal device 9. The storage unit 92 of the terminal device 9 is an HDD, ROM, RAM, etc., and stores applications for operating the information processing device 1. The communication unit 93 of the terminal device 9 controls communication with the communication network NW. The input unit 94 of the terminal device 9 is a touch panel, mouse, keyboard, etc., and inputs user operation requests to the control unit 91. The output unit 95 of the terminal device 9 is a display, etc., and displays the results of processing by the control unit 91.

[0043] Next, the functions of the present invention, which are realized by the coordinated operation of the above-mentioned components, will be explained with reference to Figures 3 and 4.

[0044] <Functions of Information Processing Device 1> As shown in Figure 3, the video generation system 0 includes a display medium acquisition unit 11, an action data acquisition unit 12, a display unit 13, and a database DB as functional components. In this embodiment, the video generation system 0 applies each functional component to on-demand video content stored in the database DB in advance and processes it. Furthermore, unless otherwise unclear, on-demand video content will be simply referred to as video content below.

[0045] The display medium acquisition unit 11 acquires a display medium showing the viewer's video, or an image or avatar specific to each viewer, and registers it in the database DB as user information.

[0046] The behavioral data acquisition unit 12 acquires behavioral data indicating the viewer's actions towards the video in accordance with the playback timing of the video content, and registers it in the database DB.

[0047] The display unit 13 processes the video content based on video information indicating the content of the video content at each playback timing. In addition to the video information, the display unit 13 also processes the video content, including the display medium associated with past viewers, based on the playback timing of the video content and behavioral data.

[0048] <Data Structure Diagram> The database DB contains user information, video information, and viewing information. All of this information may be stored in the storage unit 102, or some or all of it may be stored in a separate storage unit.

[0049] Figure 4 shows an example of information registered in the database DB. Figure 4(a) shows an example of user information. User information is data that shows the attributes of past viewers who have watched video content, and includes user identification information (user ID in the example), age, industry, job title, and display medium (MY avatar in the example).

[0050] Figure 4(b) shows an example of content information. The video is either a slideshow video content that sequentially switches between still images, or a video content that displays content by rapidly switching between continuously changing still images (a general video file using existing video formats, etc.). In this embodiment, the case of slideshow video content will be described. The content information is data for displaying the video content, and in this embodiment, it includes content identification information (content ID in the illustrated example), slide identification information (slide ID in the illustrated example), start time, and end time. The video content is created by combining multiple slides, and text associated with each slide is displayed, and audio that reads each text aloud is played.

[0051] In Figure 4(b), the video content consists of multiple segments. Here, "segment" refers to a section of the video content divided according to predetermined information types, and each segment has a playback time registered. Note that a slide may consist of a single segment, or a single segment may be formed from multiple slides SL. For example, in Figure 4(b), segments C1 and C2 are registered as linked to slide SL1 (one-to-many relationship between slides and content). Also, segment C3 is registered as linked to slide SL2 (one-to-one relationship between slide and content). Furthermore, segment C4 is registered as linked to slides SL3 and SL4 (many-to-one relationship between slides and content).

[0052] In this embodiment, each slide may include an interval time. Specifically, in this embodiment, the interval time is a predetermined time interval provided between each slide SL, during which audio is not played. The slide that was displayed immediately before the interval time is displayed. Audio may also be played during the interval time.

[0053] If the video content is a standard video file, the content information will include a content ID, start time, and end time. In this case, each segment of the playback time, divided according to the type of information, corresponds to the content. For example, the playback time from 00:00 to 00:30 of the video is content C1, and from 00:31 to 00:45 is content C2. Information that explains the meaning of the content (such as a content name or description) may also be associated with the content ID.

[0054] Figure 4(c) shows an example of viewer information. The viewing information includes user identification information, video identification information, viewing date (year, month, and day in the example) (date and time information), behavioral data, and timing of occurrence. Here, the behavioral data specifically includes response information received from the viewer and exit information indicating that viewing of the video content has ended.

[0055] Here, reaction information includes comments on the video and ratings (such as GOOD or BAD). The types of behavioral data can be optionally added or changed. Also, reaction information does not have to be registered as viewing information. In this embodiment, the timing at which a user leaves the video is registered as behavioral data is referred to as the departure timing.

[0056] Furthermore, in this embodiment, the occurrence timing is information indicating the playback timing of the video content, and it is information indicating the slide and the elapsed time since the slide was played. In Figure 4(c), "SL1-XX" indicates that it corresponds to slide SL1. For example, in Figure 4(c), it is shown that a past viewer with user ID "U1" watched video content with video ID "M1" and entered a GOOD rating 21 seconds after slide SL1 was played. In this embodiment, the occurrence timing may also be information indicating only the slide or only the elapsed time since the video content was played. Also, if the video content is a general video file, the occurrence timing is information indicating only the elapsed time since the video content was played.

[0057] <How to generate video content> Referring to Figures 5 and 6, we will explain the video generation method using the video generation system 0 and the processing details for each functional configuration.

[0058] <Display video content> Figure 5 is a flowchart of the process for generating video content that includes the viewing media of past viewers. First, in step S11 (hereinafter simply referred to as "SXXX"), the display unit 13 receives input from the current viewer via the input unit 94 to instruct the display process of the video content.

[0059] Next, in S12, the display unit 13 refers to the viewing information database DB corresponding to the video content for which the display processing has been received. If various viewing information is not registered in the database DB, in S13, the display unit 13 processes the video content based on the video information of the video content. The processing details (SD1) when viewing information is registered will be described later.

[0060] <User Information Registration> In S14, the display medium acquisition unit 11 receives and registers user information from the current viewer via the input unit 94, including age, industry, job title, and display medium. User information may be registered when processing the display of the video content, or at any point before viewing the video content. If the display medium is video, the display medium acquisition unit 11 acquires the video of the viewer while they are watching the video content and registers the video when they finish watching the video content.

[0061] <Registration of viewer behavior data> Next, in S15, the behavior data acquisition unit 12 receives behavior data input from the current viewer via the input unit 94 and registers it in association with the playback timing of the video content.

[0062] Specifically, we will explain the process of registering the current viewer's behavior data by referring to Figure 6. Figure 6 is an illustrative diagram of the process of registering the current viewer's behavior data for a slideshow-style video content displaying questions. Hereafter, we will use true / false questions.

[0063] The behavior data acquisition unit 12 registers the behavior data received from the current viewer via the input unit 94, along with the timing at which the behavior data occurred.

[0064] In Figure 6, the display unit 13 processes the display of slide AMC1 (playback time 30 seconds). The behavioral data acquisition unit 12 receives a response from the current viewer AU1, who is viewing slide AMC1, at playback timing VODT, 12 seconds after the start of playback of slide AMC1, indicating that the answer to the true / false question is "true". The behavioral data acquisition unit 12 then registers the received response information in association with the occurrence timing (A-12).

[0065] Furthermore, when the playback time for each slide ends, the display unit 13 processes the display of the slide that was playing immediately before, within the interval time. Then, when the behavior data acquisition unit 12 receives behavior data from the current viewer within the said interval time, it registers that behavior data in association with the slide that was displayed immediately before.

[0066] In Figure 6, the behavioral data acquisition unit 12 receives the input of the answer "correct" as response information at the playback timing VODT 10 seconds after the end of the playback time of slide AMC1, within the interval time of slide AMC1. The behavioral data acquisition unit 12 then registers the answer "correct" in association with the occurrence timing (A-40).

[0067] The interval time can be set arbitrarily for each slide, and may be set according to the weight indicating the difficulty of the true / false questions, or it may be set to a specific value such as 15 seconds. In addition, the behavior data acquisition unit 12 may register the timing of the occurrence of behavior data received within the interval time of each slide, starting from the time when the previously played slide ended.

[0068] Next, when the interval time for the previously displayed slide has elapsed, the display unit 13 processes the display of the next slide (BMC2 in the illustrated example) based on the video information. Then, the behavior data acquisition unit 12 registers the behavior data and the timing of the occurrence of the behavior data in association with the displayed slide. In particular, when the behavior data acquisition unit 12 accepts an input indicating departure as behavior data, this is done via an icon to end the video content or an icon to close the application itself.

[0069] The behavior data acquisition unit 12 processes the viewer behavior data described above and passes it to the display unit 13. The display unit 13 then processes the slides containing the behavior data in order based on the video information and processes the video content. When the behavior data acquisition unit 12 registers the behavior data, it may register it in the order in which it was received, or it may register it in batches by day or hour. In this embodiment, behavior data was registered for slides displaying questions, but behavior data indicating good or bad points may be registered not only for questions, but also for slides that provide explanations, such as lectures.

[0070] <Video content display processing> In the flowchart shown in Figure 5, once the processing up to S14 is completed, the display unit 13 displays the video content based on the video information, user information, and viewing information registered in the database DB. The processing details for displaying the video content based on the above information will be explained with reference to Figures 7 and 8.

[0071] Figure 7 shows an example of a flowchart for displaying video content based on various pieces of information. Note that Figure 7 illustrates the processing steps involved when displaying video content for a single slide.

[0072] In SD11, the display unit 13 compares the timing of the occurrence of the behavioral data with the playback timing of the video content. Then, it processes the video content (SD12) to display behavioral data from past viewers whose playback timing exceeds the occurrence timing (YES in SD11) and the display medium of the past viewer that corresponds to that behavioral data. On the other hand, if the playback timing does not exceed the occurrence timing (NO in SD11), in SD13, the display unit 13 processes the video content to display only the received display medium.

[0073] <Display processing for display media> Figure 8 is an illustrative diagram showing how display media are processed based on past viewer behavior data. Figure 8 explains the process of displaying media based on the behavior data used in Figure 6 to explain the behavior data registration process, and the timing of when the behavior data occurred.

[0074] The display unit 13 processes the display media of past viewers based on the behavior data and the timing of the occurrence of the behavior data. Specifically, the display unit 13 processes the display media in a manner corresponding to the behavior data, up to the playback timing VODT, which processes the slides associated with the behavior data based on the timing of occurrence.

[0075] In Figure 8, the reaction information of past viewer AU1 (occurrence timing A-12), past viewer AU2 (occurrence timing A-21), and past viewer AU3 (occurrence timing A-40) is registered in correspondence with slide AMC1. When the video playback timing exceeds each occurrence timing, the display unit 13 displays a display medium with marks corresponding to the reaction information superimposed for viewers AU1 and AU3, and a display medium colored in light gray for viewer AU2.

[0076] Then, when the playback timing of the video content exceeds the playback timing VODT for displaying slide AMC1, the display unit 13 processes the display medium in a manner corresponding to the behavioral data associated with slide BMC2. The manner corresponding to the behavioral data can be set arbitrarily.

[0077] <Processing for displaying video content that includes a list of viewers on the screen> Next, with reference to Figure 9, the screen of the video content in Embodiment 1, after performing the display processing of the display medium described in Figures 7 and 8, will be described.

[0078] <Switching between viewer list and video content> In the screen display example shown in Figure 9, the video content VOD includes a viewer list AUL or a slide SL and a playback timing TB. In this embodiment, the display unit 13 processes the video content display so that it can switch between displaying a viewer list AUL and a slide SL based on the user information and viewing information of past viewers.

[0079] In Figure 9(a), the display unit 13 places the viewer list AUL in the center of the video content VOD and processes the display. In Figure 9(b), the display unit 13 places the slide SL in the center of the video content VOD and processes the display. When the display unit 13 receives a selection from the switching unit SB via the input unit 94, it switches between the screens of Figure 9(a) and Figure 9(b) and processes the display of the video content VOD. In this embodiment, as shown in Figure 9, the switching unit SB is a thumbnail, but it may also be a button that can switch screens. In addition to or instead of the switching unit SB, the display unit 13 may process the display of the slide SL in the case of Figure 9(a) and the viewer list AUL in the case of Figure 9(b), each associated with the playback timing TB.

[0080] Furthermore, the display unit 13 may display the current viewer's display medium in the viewer list AUL. In this case, when the display unit 13 receives behavioral data from the current viewer, it processes the display of the current viewer's display medium in the viewer list AUL in a manner corresponding to the received behavioral data. If the display medium is video, the display medium acquisition unit 11 acquires the video of the current viewer who is watching video content and passes it to the display unit 13, thereby processing the display of the current viewer's display medium in the viewer list AUL.

[0081] <Changes to the layout of the viewer list> Furthermore, in this embodiment, the display unit 13 rearranges and arranges multiple past viewer display media based on behavioral data as viewing information. Specifically, the display unit 13 changes the display position of multiple past viewer display media based on behavioral data as viewing information and displays the viewer list AUL.

[0082] In this embodiment, the display unit 13 arranges display media for past viewers whose behavioral data matches adjacently on one side of the inside of the viewer list AUL (Audio Object). The display unit 13 may also arrange display media for past viewers whose behavioral data matches using the same color. Furthermore, if the behavioral data does not match, the display unit 13 displays the display media associated with each behavioral data randomly, or in order of the degree of relevance of the behavioral data.

[0083] <Changing the arrangement of the viewer list based on the specified viewing date> In this embodiment, the display unit 13 arranges multiple display media based on the viewing dates of past viewers as viewing information. In this embodiment, the video generation system 0 receives a date specification from the current viewer via the input unit 94. The display unit 13 then arranges only the display media of past viewers that are associated with viewing information having a viewing date that matches the received date. The viewing date specification may be a date or an arbitrary period.

[0084] In another embodiment, the display unit 13 also displays display media of past viewers associated with viewing dates that do not match the specified date. In this case, the display unit 13 places the display media of past viewers corresponding to each viewing date next to each other. Alternatively, the display unit 13 may arrange the display media in order of proximity of the viewing date, starting from the display media of past viewers associated with viewing dates that match the specified date.

[0085] <Changing the arrangement of the viewer list based on attribute specification> In this embodiment, the display unit 13 arranges multiple display media for past viewers based on the attributes of past viewers. Specifically, in this embodiment, the video generation system 0 receives an age specification from the current viewer via the input unit 94. The display unit 13 then arranges only the display media for past viewers that are associated with user information having an age that matches the specified age. Note that "age matching" can be preferably set to match the age itself, the age group matching, etc.

[0086] In other embodiments, the display unit 13 also displays display media for past viewers whose ages do not match the specified age. In Figure 9, the display unit 13 places display media for past viewers whose ages match next to each other. Although not shown in the figure, the display unit 13 may also arrange display media for past viewers whose ages do not match the specified age, starting from the display media for past viewers whose ages match the specified age, in order of relevance, i.e., proximity of age.

[0087] Furthermore, the display unit 13 may arrange the display media of past viewers based on attributes other than age, namely, industry or job title. For example, only past viewers whose attributes all match may be displayed, and the viewer list AUL may be processed.

[0088] <Change the placement of the list of viewers without a specified designation> In another embodiment, the display unit 13 changes the arrangement of display media without accepting attribute specifications from the current viewer. In this case, the display unit 13 arranges multiple display media for past viewers based on the degree of relevance between the attributes of the current viewer and the attributes of past viewers. Specifically, the display unit 13 arranges only the display media for past viewers whose age matches that of the current viewer.

[0089] Alternatively, a numerical value calculated using regression analysis may be used to indicate the degree of relevance. Specifically, one or more pieces of information representing viewer attributes, such as age, industry, and job title, are input as input data, a numerical value indicating relevance is calculated from this input data as output data, and viewers with similar numerical values ​​are judged to have a high degree of relevance.

[0090] Furthermore, the display unit 13 changes the arrangement of the display media without accepting a viewing date specification from the current viewer. In this case, the display unit 13 arranges the viewing dates of past viewers in order of proximity to the current viewing date, starting from the date the current viewer is viewing (current viewing date), and displays the display media of past viewers.

[0091] In this embodiment, the display unit 13 may not only change the arrangement, but also arrange display media for past viewers who match in terms of each piece of information in the same manner. For example, the display unit 13 may arrange display media for past viewers who match in age, displaying them in the same color.

[0092] (Embodiment 2) Next, in Embodiment 2, the process of displaying video content that includes slides and a viewer list on the same screen will be described with reference to Figures 10 to 14. Note that the process by which the system in Embodiment 2 enables each functional configuration and generates the video is the same as that of the system in Embodiment 1, so it will be omitted.

[0093] <Display processing for video content that includes slides and a viewer list on the same screen> In the display examples of this embodiment, the process of displaying the display medium in a manner corresponding to the behavioral data may be performed until the end of playback of the slide associated with the behavioral data, or until the video content ends. The former will be described below with reference to Figures 10 to 12, and the latter with reference to Figures 13 and 14.

[0094] <Display processing for video content that reflects behavioral data associated with each slide> First, referring to Figures 10 to 12, we will explain the case in this embodiment where the process of displaying the display medium in a manner corresponding to the behavioral data is performed until the end of playback of the slide associated with the behavioral data. Note that Figures 10 and 11 may also adopt a similar configuration in Embodiment 1.

[0095] In the screen display example shown in Figure 10, the display unit 13 processes an image resembling a school lecture hall as the background for the video content VOD. The display unit 13 is also positioned at the top of the video content VOD and processes the slide SL. Furthermore, the display unit 13 is positioned at the bottom of the video content VOD and processes the viewer list AUL based on the timing of the generation of past viewer behavior data, the display medium, and the playback timing.

[0096] In Figure 10, the display unit 13 processes the display data of past viewers who entered "true" as the answer to a true / false question, and displays a mark corresponding to the answer "true" in the form of a speech bubble, based on the display medium of a past viewer whose timing for playback of video content VOD has passed the timing of occurrence. In other embodiments, not only the speech bubble but also audio may be played.

[0097] <Display process for video content sorted by viewer list> Next, we will explain the display process for video content, which has been sorted into viewer lists, as a display screen. Note that this configuration may also be adopted in the case of Embodiment 1.

[0098] In the example screen display in Figure 11, the video content VOD includes the first viewer group AUG1, the second viewer group AUG2, the third viewer group AUG3, slide SL, the number of display media included in the first viewer group AUG1 NAU1, and the number of display media included in the second viewer group AUG2 NAU2, categorized by behavioral data.

[0099] In this embodiment, the display unit 13 is positioned in the center of the video content VOD and processes the display of slide SL. The display unit 13 is also positioned on either the top, bottom, left, or right sides outside of slide SL to process the display of the first viewer group AUG1, the second viewer group AUG2, and the third viewer group AUG3. Furthermore, the display unit 13 is positioned in correspondence with viewer group AUG1 and viewer group AUG2 to process the display of the number of display media NAU1 and the total number of display media, and the number of display media NAU2 and the total number of display media.

[0100] In this embodiment, the display unit 13 places display media for past viewers AUG1-3 whose video content VOD playback timing has not passed the drop-off timing and whose drop-off has not been recorded as behavioral data. Specifically, the display unit 13 determines which viewer group a display media associated with the behavioral data belongs to based on the behavioral data received from the past viewer and the timing of the occurrence of the behavioral data, and places the display media accordingly.

[0101] In Figure 11, the display unit 13 determines that display media that have received input of "true" as the answer to a true / false question from past viewers, as behavioral data whose playback timing has passed the timing of the occurrence of behavioral data, belong to the first viewer group AUG1 and places them in viewer group AUG1. The display unit also determines that display media that have received input of "false" as the answer to a question from viewers belong to the second viewer group AUG2, and display media that have not received an answer from past viewers belong to the third viewer group AUG3, and places them accordingly. The number of viewer groups can be suitably changed in accordance with the types of behavioral data to be displayed.

[0102] Furthermore, in this embodiment, the display unit 13 processes the display of the number of display media NAU1-NAU2 and the total number of display media to be displayed, based on the playback timing of the video content VOD and the timing of the generation of behavioral data. In Figure 11, the display unit 13 processes the display of the total number of display media (20 in the illustrated example), the number of display media NAU1 belonging to the first viewer group (10 in the illustrated example), and the number of display media NAU2 belonging to the first viewer group (4 in the illustrated example).

[0103] In this embodiment, the display unit 13 places the display media at a position corresponding to the two choices (true or false) when it receives a choice, and at a position corresponding to an unanswered question when it does not receive a choice. However, there may be three or more choices, and the display media may be placed at a position corresponding to the choice. Furthermore, the display media for unanswered questions does not have to be displayed at all times, or it may be hidden when a choice is received. In addition, when an answer is selected by the current viewer, only the display media of past viewers who selected the same answer may be displayed.

[0104] <Display process for video content showing a list of viewers in chronological order> In the screen display example shown in Figure 12, the video content VOD includes slide SL, viewer list AUL, action timeline ATL, and occurrence timeline OTL. In this embodiment, the display unit 13 is positioned to the left of the video content VOD and displays slide SL. The display unit 13 also displays the viewer list AUL, action timeline ATL, and occurrence timeline OTL from left to right of the video content VOD.

[0105] In Figure 12, the display unit 13 arranges the occurrence timings in the occurrence time series OTL from top to bottom in order of earliest occurrence timing. The display unit 13 also arranges the behavior data and display media in the behavior time series ATL and viewer list AUL, respectively, in correspondence with the occurrence timing, and performs display processing. Here, the shaded display media in the viewer list AUL indicate that they are display media scheduled for display processing.

[0106] Furthermore, in this embodiment, the display unit 13 arranges the display media based on the order of the timing of the occurrence of behavioral data and the upper limit of the number of display media to be displayed. Specifically, based on the order of the timing of the occurrence of behavioral data and the setting of the upper limit of the number of display media to be displayed in the viewer list AUL, if the number exceeds the upper limit, the display unit 13 changes the display media to be displayed in the viewer list AUL each time the timing of the occurrence of behavioral data for the display media scheduled to be displayed has passed when the playback timing of the video content VOD is reached.

[0107] In Figure 12, the display unit 13 determines that the number of display media to be processed is the maximum number (6 in the illustrated example). When the playback timing of the video content VOD has passed the timing of the occurrence of behavioral data associated with the shaded display media, the display unit 13 replaces the display media located one position below the top of the viewer list AUL with the display media located one position below it. The display unit 13 then performs the above placement process for all display media located consecutively below the said display media, thereby placing the shaded display media at the bottom of the viewer list AUL. Simultaneously with placing each display media, the display unit 13 places the behavioral data and occurrence timing associated with each display media and displays them.

[0108] <Display processing of video content that reflects all behavioral data associated with the played slide> Next, with reference to Figures 13 and 14, we will describe the case in which the process of displaying the display medium in a manner corresponding to the reaction information is performed until the video content ends. Note that a similar configuration may be adopted in the case of Embodiment 1 as well as in Figure 13.

[0109] <Video content display process that changes the viewer list in accordance with the answers to true / false questions> In the screen display example shown in Figure 13, the video content VOD includes a slide SL and a viewer list AUL. In this embodiment, the display unit 13 is positioned to the left of the video content VOD and processes the display of the slide SL. The display unit 13 is also positioned to the right of the video content VOD and processes the display of the viewer list AUL.

[0110] In this embodiment, the display unit 13 processes the display medium in a manner corresponding to the combination of the reaction information and the correct answer information at the playback timing from slide SL onward, which is linked to the reaction information. Here, the correct answer information is set for each question and indicates the correct answer option among the choices. Points may also be set for each question in addition to the correct answer information. The display unit 13 may perform display processing based on point information instead of the correct answer information. Point information is information indicating the points set for each choice.

[0111] In Figure 13, if the past viewer's response information (answer to a true / false question) is incorrect, the display unit 13 processes the display medium of that viewer in the viewer list AUL so that the timing of the occurrence of the response information can be identified. For example, in Figure 13, the display unit 13 colors the display medium in light gray to indicate the slide that received an incorrect answer (question X in the illustrated example), and further processes the display by overlaying text such as "Missed (question X)". If the past viewer's answer is correct, the display medium may be displayed as is, or the display medium may be colored according to the number of matches between the correct answer information and the answer. Here, an "incorrect" answer and a "correct" answer refer to an answer that matches the "correct answer" in the correct answer information and an answer that does not match the "correct answer" in the correct answer information, respectively.

[0112] Furthermore, in this embodiment, the display unit 13 places the display medium lower on the viewer list AUL the earlier the playback timing of the slide SL associated with the incorrect response information. For example, in Figure 13, the display unit 13 places the display medium of the viewer who entered the incorrect answer at the very bottom of the viewer list AUL for the slide SL with the earliest playback timing (the first question in the illustrated example) among the slide SLs that received the incorrect answer.

[0113] In the screen display example shown in Figure 14, the video content VOD includes slide SL, viewer list AUL, and score list SCL. In this embodiment, the display unit 13 is positioned to the left of the video content VOD and processes the display of slide SL. The display unit 13 is also positioned to the right of the video content VOD and processes the display of viewer list AUL and score list SCL from left to right.

[0114] In this embodiment, the display unit 13 arranges and displays the total count and display medium in association with the correct answer information for each slide, the count set for each slide, and the action data. Specifically, the display unit 13 assigns a count to each slide based on the combination of action data and correct answer information, and at a specific playback timing, it displays the total count obtained by summing the counts for each slide played up to that playback timing.

[0115] In Figure 14, the display unit 13 calculates the counts for each display medium corresponding to slides SL that were played before the currently displayed slide SL, that had SL and received action data and a correct answer, and displays the result of this calculation on the score list SCL. The display unit 13 also arranges the total scores from the top of the score list SCL in descending order of total score and displays the score list SCL. Then, the display unit 13 arranges the display media corresponding to the total score and displays the viewer list AUL. The score set for each slide can be optionally set.

[0116] In this embodiment, the display unit 13 calculates the total score for each question based on the correct answer information or scoring information for which points are assigned to each question, and places the total score in the score list SCL for display.

[0117] Furthermore, in this embodiment, the display unit 13 accepts answers to questions with a correct answer, such as true / false questions, and displays the total score. However, for questions without a correct answer, such as personality tests, it may also accept answers from multiple choices and display the total score. In this case, the memory unit 14 stores scoring information, which includes multiple categories and points assigned to each choice for each category. When the display unit 13 receives a choice, it calculates the points corresponding to that choice for each category based on the scoring information and displays the total score for each category in the score list SCL. The display unit 13 may also display a radar chart based on the total score for each category. Moreover, the display unit 13 may determine the diagnostic result based on the total score for each category and display it for each viewer, either in place of or in addition to the score list SCL. [Explanation of Symbols]

[0118] 0: Video generation system 1: Information Processing Device 11:Display medium acquisition section 12: Behavioral Data Acquisition Unit 13: Display section 101: Control Unit 102: Storage section 103: Communications Department 2: User terminal device 9: Terminal device 91: Control Unit 92: Storage section 93: Communications Department 94: Input section 95: Output section NW: Communication Network

Claims

1. A video generation system that generates on-demand videos in which viewer reactions can be viewed, The video generation system comprises a storage unit, a display medium acquisition unit, an action data acquisition unit, and a display unit. The aforementioned storage unit stores video information for displaying on-demand video content. The aforementioned video content is composed of multiple sections, Each of the multiple sections has a playback time corresponding to the content to be played for each section. The aforementioned display medium acquisition unit acquires a display medium that shows the viewer's video, or an image or avatar that has been registered in advance for each viewer. The behavior data acquisition unit acquires behavior data indicating the viewer's actions toward the video content when the viewer watches the video content, associating the occurrence timing indicating the playback timing at which the behavior data was received with the section of the video content. The display unit processes the on-demand video, including the display medium in a manner corresponding to the behavior data associated with each section, within the playback time for each section, based on the behavior data, the section of the video content to which the behavior data is associated, and the timing of the occurrence of the behavior data. Video generation system.

2. The aforementioned storage unit stores attribute information indicating the attributes of each viewer, The display unit processes the display medium from among a plurality of the display media of the viewer who is viewing the video content, which is highly relevant to the viewer, based on the attribute information of the viewer who is viewing the video content and the attribute information of the viewer who has previously viewed the video content. The video generation system according to claim 1.

3. The aforementioned storage unit stores date and time information indicating the viewing date and time for each viewer. The display unit processes the display medium corresponding to a viewer having specific date and time information from among a plurality of display media, based on the date and time information. The video generation system according to claim 1 or claim 2.

4. The display unit, based on the behavioral data, identifies the audience group to which the display medium belongs based on the behavioral data associated with the display medium, and processes the on-demand video in which the display medium is placed in different areas according to the audience group. A video generation system according to any one of claims 1 to 3.

5. The aforementioned behavioral data includes exit timings that indicate when each viewer ends watching the content. The display unit, based on the departure timing, processes the display medium associated with past viewers in different ways before and after the playback timing corresponding to the departure timing. A video generation system according to any one of claims 1 to 4.

6. The aforementioned behavioral data further includes, for each section, reaction information indicating the evaluation of the video received by each viewer, The display unit processes the display medium to display an on-demand video in which marks corresponding to the reaction information are superimposed, based on the reaction information. A video generation system according to any one of claims 1 to 5.

7. A video generation method for generating on-demand videos that allow viewers to view reactions, The video generation system A step of storing video information for displaying video content of on-demand videos composed of multiple sections, Each of the multiple sections has a playback time corresponding to the content to be played for each section. The steps include obtaining a display medium that represents an avatar using the viewer's video or an image pre-registered for each viewer, The steps include: when a viewer watches video content, acquiring behavioral data indicating the viewer's actions toward the video content, associating this with the occurrence timing indicating the playback timing at which the behavioral data was received, and the section of the video content; The process includes the steps of displaying an on-demand video, including the display medium in a manner corresponding to the behavioral data associated with each section, within the playback time for each section, based on the behavioral data, the section of the video content to which the behavioral data is associated, and the timing of the occurrence of the behavioral data. Video generation method.

8. A video generation program that generates on-demand videos in which viewer reactions can be viewed, The aforementioned video generation program causes the computer to function as a storage unit, a display medium acquisition unit, an action data acquisition unit, and a display unit. The aforementioned storage unit stores video information for displaying video content of on-demand videos composed of multiple sections. Each of the multiple sections has a playback time corresponding to the content to be played for each section. The aforementioned display medium acquisition unit acquires a display medium that shows the viewer's video, or an image or avatar that has been registered in advance for each viewer. The behavior data acquisition unit acquires behavior data indicating the viewer's actions toward the video content when the viewer watches the video content, associating the occurrence timing indicating the playback timing at which the behavior data was received with the section of the video content. The display unit processes the on-demand video, including the display medium in a manner corresponding to the behavior data associated with each section, within the playback time for each section, based on the behavior data, the section of the video content to which the behavior data is associated, and the timing of the occurrence of the behavior data. A video generation program.

Images