Video generation system, video generation program, and video generation method

Abstract

To provide a video generation system, a video generation program, and a video generation method, related to creation of an on-demand video in which a viewer can participate.SOLUTION: In a video generation system for generating on-demand video content for which a response of a viewer can be browsed, an information processing apparatus includes a storage unit, a display medium acquisition unit, an action data acquisition unit, and a display unit. The storage unit stores video information for displaying on-demand video content. The display medium acquisition unit acquires a display medium indicating a video of a viewer or an image registered in advance for each viewer, or an avatar. The action data acquisition unit acquires, when the viewer views video content, action data indicating an action of the viewer with respect to the video content, in association with reproduction timing of the video content. The display unit displays on-demand video content including the display medium associated with the viewer, on the basis of the action data and the associated reproduction timing.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a video generation system, a video generation program, and a video generation method. [Background technology]

[0002] Conventionally, techniques for allowing viewers to participate in video content have been known. Examples of techniques for displaying avatars of viewers together with performers in live streaming have been proposed in, for example, Patent Documents 1 and 2. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2020-107264 [Patent Document 2] Japanese Patent Application Laid-Open No. 2012-120098 Summary of the Invention [Problem to be solved by the invention]

[0004] On the other hand, unlike video content such as live streaming, on-demand video content has different playback timing for each viewer. Therefore, there is no viewing limit and the content can be played multiple times, but there is a problem that the sense of unity among viewers that is present in live streaming is lost. Therefore, there is a need for technology to generate on-demand video content that can realize this sense of unity among viewers.

[0005] In view of the above circumstances, an object of the present invention is to provide a novel technique for generating on-demand video content that allows viewer participation. [Means for solving the problem]

[0006] In order to solve the above problem, the present invention provides a video generation system that generates on-demand video content that allows viewers' reactions to be viewed, the video generation system comprising a memory unit, a display medium acquisition unit, a behavioral data acquisition unit, and a display unit, wherein the memory unit stores video information for displaying on-demand video content, the display medium acquisition unit acquires a display medium showing a video of the viewer or an image or avatar pre-registered for each viewer, the behavioral data acquisition unit acquires behavioral data showing the viewer's actions with respect to the video content when the viewer watches the video content, in association with the playback timing of the video content, and the display unit displays on-demand video content including the display medium associated with the viewer based on the behavioral data and the associated playback timing.

[0007] The present invention also provides a video generation method for generating on-demand video that allows viewers' reactions to be viewed, the method comprising the steps of: the video generation system storing video information for displaying on-demand video content; acquiring a display medium showing a video of the viewer or an image or avatar pre-registered for each viewer; acquiring, when the viewer watches the video content, behavioral data showing the viewer's actions with respect to the video content in association with the playback timing of the video content; and the display unit displaying the on-demand video including the display medium associated with the viewer based on the behavioral data and the associated playback timing.

[0008] The present invention also provides a video generation program for generating on-demand video in which the viewer's reactions can be viewed, which causes a computer to function as an information processing device that stores video information for displaying on-demand video content, acquires a display medium showing the viewer's image or an image or avatar registered in advance for each viewer, acquires viewer behavior data associated with the playback timing of the video content when the viewer watches the video content, and displays and processes the on-demand video including the display medium associated with the viewer based on the behavior data and the associated playback timing.

[0009] This configuration makes it possible to generate on-demand video that displays the viewer's actions on the video content, thereby enabling the viewer to understand at what timing during playback of the video content the viewer took an action.

[0010] In a preferred embodiment of the present invention, the display unit switches between displaying a viewer list on the same screen that lists the display media of multiple viewers identified based on the behavioral data and the video content.

[0011] With this configuration, it is possible to switch between displaying the video content and the multiple viewers who have viewed the video content.

[0012] In a preferred embodiment of the present invention, the memory unit stores attribute information indicating the viewer's attributes for each viewer, and the display unit displays, based on the attribute information of the viewer viewing the on-demand video content and the attribute information of viewers who have viewed the on-demand video content in the past, the display medium that is most relevant to the viewer viewing the content, among the display media of the multiple viewers who have viewed the content.

[0013] By adopting such a configuration, it is possible to understand what actions closely related viewers have taken in relation to what video content.

[0014] In a preferred form of the present invention, the memory unit stores date and time information indicating the viewing date and time for each viewer, and the display unit displays and processes the display medium corresponding to a viewer having specific date and time information from among the multiple display media based on the date and time information.

[0015] By adopting such a configuration, it is possible to know in what period or on what date and time the viewer took action on the video content.

[0016] In a preferred embodiment of the present invention, the display unit displays the plurality of display media and video content on the same screen based on the behavioral data.

[0017] This configuration allows the user to simultaneously check the video content and the viewer's actions on the video content, making it easy to check at what timing of playback of the video content the viewer's actions on the video content were performed.

[0018] In a preferred embodiment of the present invention, the video content consists of multiple contents, and the behavioral data acquisition unit acquires the behavioral data and the contents in association with each other based on the occurrence timing, which is the playback timing at which the behavioral data is received, and the display unit displays and processes the display medium in a manner corresponding to the behavioral data based on the playback timing, content, and behavioral data of the video content.

[0019] With this configuration, it is possible to grasp what actions viewers have taken with respect to each piece of video content.

[0020] In a preferred embodiment of the present invention, the behavioral data includes a departure timing indicating the timing at which each viewer finished viewing, and the display unit, based on the departure timing, displays the display medium at the playback timing after the departure timing in a manner different from the display medium at the playback timing before the departure timing.

[0021] With this configuration, it is possible to easily check which viewer stopped watching the video content at which playback timing, thereby understanding which playback timing of the video content was not appealing to the viewer.

[0022] In a preferred embodiment of the present invention, the behavioral data further includes reaction information indicating the evaluation of the video received for each viewer, and based on the reaction information, an on-demand video is displayed on the display medium with a mark corresponding to the reaction information superimposed on it.

[0023] By adopting such a configuration, it is possible to easily grasp which viewer reacted in what way.

[0024] In a preferred embodiment of the present invention, the video content is made up of a plurality of contents, the contents including questions, the memory unit stores correct answer information for each question, and the display unit displays the video content including the display medium in a manner corresponding to the combination of the reaction information and correct answer information at the playback timing after the question, based on the question, the reaction information for the answer linked to the question, and the correct answer information.

[0025] By adopting such a configuration, it is possible to know at what playback timing the viewer got the answer wrong.

[0026] The video content consists of a plurality of questions, the memory unit stores correct answer information for each question, and the display unit calculates a count for each question based on the question, the reaction information for the answer linked to the question, and the correct answer information, and at a specific playback timing, displays the video content including a total count obtained by adding up the counts calculated for each question before the playback timing.

[0027] By adopting such a configuration, it is possible to grasp how many questions each viewer answered correctly. [Effects of the Invention]

[0028] The present invention provides a novel technique for generating on-demand video with viewer participation. [Brief explanation of the drawings]

[0029] [Figure 1] FIG. 1 is a block diagram showing the configuration of a system according to an embodiment of the present invention. [Figure 2] FIG. 1 is a hardware configuration diagram of an information processing apparatus according to an embodiment of the present invention. [Figure 3] FIG. 1 is a functional block diagram of a system (information processing device) according to an embodiment of the present invention. [Figure 4] 10 is an example of information stored in a database in a system according to an embodiment of the present invention. [Figure 5] 10 is a flowchart showing a process for generating a viewer-participatory video in a system according to an embodiment of the present invention. [Figure 6] FIG. 10 is an image diagram illustrating the process of registering viewer behavior data in a system according to an embodiment of the present invention. [Figure 7] 10 is a flowchart showing a process for generating a viewer-participatory video in a system according to an embodiment of the present invention. [Figure 8] FIG. 10 is an image diagram illustrating a process for displaying a viewer-participatory video in a system according to an embodiment of the present invention. [Figure 9] 10 is an example of a screen display of a viewer-participatory video in a system according to an embodiment of the present invention. [Figure 10] 10 is another example of a screen display of a viewer-participatory video in a system according to another embodiment of the present invention. [Figure 11] 10 is another example of a screen display of a viewer-participatory video in a system according to another embodiment of the present invention. [Figure 12] 10 is another example of a screen display of a viewer-participatory video in a system according to another embodiment of the present invention. [Figure 13] 10 is another example of a screen display of a viewer-participatory video in a system according to another embodiment of the present invention. [Figure 14] 10 is another example of a screen display of a viewer-participatory video in a system according to another embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0030] The present invention will be described in more detail below with reference to the accompanying drawings, in which preferred embodiments are shown, but which may be embodied in many different forms and are not limited to the embodiments set forth herein.

[0031] For example, although the configuration, operation, etc. of a video generation system are described in this embodiment, similar effects can be achieved by an executed method, device, computer program, etc. The program in this embodiment may be provided as a non-transitory computer-readable recording medium, or may be provided so as to be downloadable from an external server, or the program may be started on an external computer to realize its functions on a client terminal (so-called cloud computing).

[0032] In this embodiment, the term "unit" may also include, for example, hardware resources implemented by a broadly defined circuit and software information processing that can be specifically realized by these hardware resources. In this embodiment, "information" is represented by, for example, physical signal values ​​representing voltage or current, high or low signal values ​​as a binary bit set consisting of 0 or 1, or quantum superposition (so-called quantum bits), and communication and calculations can be performed on the broadly defined circuit. A broadly defined circuit is a circuit realized by appropriately combining a circuit, circuitry, processor, memory, etc., including a central processing unit (CPU), a graphics processing unit (GPU), a large-scale integration (LSI), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), etc.

[0033] (Embodiment 1) A first embodiment of the present invention will be described below with reference to the drawings. First, before describing the functions of the present invention, a configuration that can effectively implement these functions will be described with reference to FIGS. 1 and 2.

[0034] In the following description of the present invention, viewers include viewers who input instructions for displaying video content and intend to view the video content, and viewers who have viewed the video content before the viewers. Hereinafter, the former will be referred to as "current viewers" and the latter as "past viewers." When there is no particular need to distinguish between the two, the term "viewers" will be used simply.

[0035] <System configuration> Fig. 1 is a block diagram showing the configuration of a system according to one embodiment. As shown in Fig. 1, the video generation system 0 includes an information processing device 1 and a terminal device 9 (user terminal device 2). The information processing device 1 and the user terminal device 2 are configured to be able to communicate with each other via a communication network NW. In this embodiment, the communication network NW is an IP (Internet Protocol) network, but there are no restrictions on the type of communication protocol, and there are also no restrictions on the type or scale of the network.

[0036] It is possible to use a general-purpose server computer or a personal computer as the information processing device 1. It is also possible to configure the information processing device 1 using multiple computers. The user terminal device 2 can be a smartphone, a tablet terminal, a personal computer, a wearable device, or the like. In this embodiment, the video generation system 0 will be described as a server-client type system in which the information processing device 1 operates as a server and the user terminal device 2 operates as a client. The user terminal device 2 has an application (typically a web browser) for making requests to the information processing device 1 and receiving responses. For example, the information processing device 1 may be configured by installing a video generation program in the terminal device 9.

[0037] <Hardware configuration> Fig. 2 is a hardware configuration diagram of the video generation system 0. Fig. 2(a) is a diagram showing an example of the hardware configuration of the information processing device 1. The information processing device 1 includes, as its hardware configuration, a control unit 101, a storage unit 102, and a communication unit 103.

[0038] The control unit 101 includes one or more processors such as a CPU, and controls the overall operation and processing of the information processing device 1 by executing the video generation program according to the present invention, an OS, browser software, and other applications.

[0039] The storage unit 102 is a HDD, ROM, RAM, etc., and stores the video generation program according to the present invention and data used when the control unit 101 executes processing based on the program. The control unit 101 executes processing based on the video generation program stored in the storage unit 102, thereby realizing the functional configuration described below.

[0040] The communication unit 103 controls communication with the communication network NW, and performs input necessary to operate the information processing device 1 and output related to the operation results.

[0041] 2(b) is a diagram showing an example of the hardware configuration of the terminal device 9 (user terminal device 2). Similarly, the terminal device 9 also includes, as its hardware configuration, a control unit 91, a storage unit 92, a communication unit 93, an input unit 94, and an output unit 95.

[0042] The control unit 91 of the terminal device 9 includes one or more processors such as a CPU, and controls the overall operation and processing of the terminal device 9. The storage unit 92 of the terminal device 9 is an HDD, ROM, RAM, etc., and stores applications and the like for operating the information processing device 1. The communication unit 93 of the terminal device 9 controls communication with the communication network NW. The input unit 94 of the terminal device 9 is a touch panel, mouse, keyboard, etc., and inputs operation requests from the user to the control unit 91. The output unit 95 of the terminal device 9 is a display, etc., and displays the results of processing by the control unit 91, etc.

[0043] Next, the functions of the present invention that are realized by the interlocking of the above-mentioned components will be described with reference to FIGS.

[0044] <Functions of information processing device 1> As shown in Fig. 3, the video generation system 0 includes, as functional components, a display medium acquisition unit 11, a behavioral data acquisition unit 12, a display unit 13, and a database DB. In this embodiment, the video generation system 0 applies each functional component to on-demand video content stored in advance in the database DB to perform processing. In the following, unless otherwise clear, on-demand video content will simply be referred to as video content.

[0045] The display medium acquisition unit 11 acquires display media showing a video of a viewer, or an image or avatar of each viewer, and registers the acquired display media as user information in the database DB.

[0046] The behavioral data acquisition unit 12 acquires behavioral data indicating the viewer's actions with respect to the video in association with the playback timing of the video content, and registers the data in the database DB.

[0047] The display unit 13 displays the video content based on the video information indicating the content of the video content for each playback timing. The display unit 13 also displays the video content including the display medium associated with the past viewer based on the playback timing of the video content and the behavior data in addition to the video information.

[0048] <Data structure diagram> The database DB includes user information, video information, and viewing information. All of these may be stored in the storage unit 102 or the like, or some or all of these may be stored in another storage unit.

[0049] FIG. 4 is a diagram illustrating an example of information registered in the database DB. 4(a) is a diagram showing an example of user information. The user information is data indicating the attributes of past viewers who have viewed video content, and includes user identification information (user ID in the illustrated example), age, industry, job title, and display medium (MY avatar in the illustrated example).

[0050] FIG. 4(b) is a diagram showing an example of content information. The video is video content in a slideshow format that switches still images sequentially, or video content in a format that displays content by rapidly switching continuously changing still images (a general video file in an existing video format, etc.). In this embodiment, the case of video content in a slideshow format will be described. The content information is data for displaying the video content, and in this embodiment, includes content identification information (content ID in the illustrated example), slide identification information (slide ID in the illustrated example), start time, and end time. Video content is created by combining multiple slides, and text associated with each slide is displayed and audio reading each text is played.

[0051] Also, in FIG. 4(b), the video content is made up of multiple contents. Here, a content represents a section of the video content divided into predetermined information types, and a playback time is registered for each content. Note that a slide may be formed of a single content, or one content may be formed from multiple slides SL. For example, in FIG. 4(b), contents C1 and C2 are linked to slide SL1 and registered (a one-to-many relationship between slides and contents). Content C3 is also linked to slide SL2 and registered (a one-to-one relationship between slides and contents). Furthermore, content C4 is also linked to slides SL3 and SL4 and registered (a many-to-one relationship between slides and contents).

[0052] In this embodiment, each slide may include an interval time. Specifically, in this embodiment, the interval time is a predetermined time interval provided between each slide SL, during which no audio is played. During the interval time, the slide that was displayed immediately before the interval time is displayed. Note that audio may also be played during the interval time.

[0053] If the video content is a general video file, the content information registered will be a content ID, start time, and end time. In this case, the content corresponds to a section of the playback time divided by information type. For example, the video playback time from 00:00 to 00:30 is content C1, and the video playback time from 00:31 to 00:45 is content C2. Information explaining the meaning of the content (such as the content name or content description) may be linked to the content ID.

[0054] 4(c) is a diagram showing an example of a viewer's viewing information. The viewing information includes user identification information, video identification information, viewing date (in the illustrated example, year, month, and day) (date and time information), behavioral data, and occurrence timing. Here, the behavioral data specifically includes reaction information that accepts input from the viewer, and withdrawal, etc., which indicates that viewing of the video content has ended.

[0055] Here, reaction information includes comments on videos and ratings (GOOD, BAD, etc.). The types of behavioral data can be suitably added or changed. Furthermore, reaction information does not have to be registered as viewing information. Here, in this embodiment, the timing at which a withdrawal is registered as behavioral data is particularly referred to as the withdrawal timing.

[0056] In this embodiment, the occurrence timing is information indicating the playback timing of the video content, and is information indicating a slide and the elapsed time since the slide was played. "SL1-XX" in FIG. 4(c) indicates that it corresponds to slide SL1. For example, FIG. 4(c) indicates that a past viewer with user ID "U1" watched video content with video ID "M1" and entered a rating of "GOOD" 21 seconds after slide SL1 was played. Note that in this embodiment, the occurrence timing may be information indicating only the slide or only the elapsed time since the video content was played. Furthermore, if the video content is a general video file, the occurrence timing is information indicating only the elapsed time since the video content was played.

[0057] <How to generate video content> A moving image generation method using the moving image generation system 0 and processing contents of each functional configuration will be described with reference to FIGS.

[0058] <Displaying video content> 5 is a process flowchart for generating video content including display media of past viewers. First, in step S11 (hereinafter simply referred to as "SXXX"), the display unit 13 receives an input from the current viewer via the input unit 94 instructing the display processing of the video content.

[0059] Next, in S12, the display unit 13 refers to the database DB of viewing information corresponding to the video content for which display processing has been accepted. If the various types of viewing information are not registered in the database DB, in S13 the display unit 13 performs display processing of the video content based on the video information of the video content. Note that the processing content (SD1) when viewing information is registered will be described later.

[0060] <User information registration> In S14, the display medium acquisition unit 11 receives and registers user information, such as age, industry, job title, and display medium, from the current viewer via the input unit 94. The user information may be registered when the video content is being displayed, or at any time, such as before the video content is viewed. If the display medium is video, the display medium acquisition unit 11 acquires video of the viewer viewing the video content, and registers the video when the viewer finishes viewing the video content.

[0061] <Registering viewer behavior data> Next, in S15, the behavior data acquisition unit 12 accepts input of behavior data from the current viewer via the input unit 94, and registers the data in association with the playback timing of the video content.

[0062] The process of registering current viewer behavior data will be described in detail with reference to Fig. 6. Fig. 6 is an image diagram of registering current viewer behavior data for video content in slideshow format that displays questions. True or false questions will be used as the questions below.

[0063] The behavioral data acquisition unit 12 registers the behavioral data received from the current viewer via the input unit 94 in association with the timing at which the behavioral data occurred.

[0064] 6, the display unit 13 processes and displays slide AMC1 (playback time 30 seconds). Then, the behavioral data acquisition unit 12 receives, as response information, the answer to the true / false question "true" from the current viewer AU1 viewing slide AMC1 at playback timing VODT, which is 12 seconds after the start of playback of slide AMC1. Then, the behavioral data acquisition unit 12 associates the received response information with the occurrence timing (A-12) and registers it.

[0065] When the playback time for each slide ends, the display unit 13 displays the slide that was being played just before within the interval time. When the behavioral data acquisition unit 12 receives behavioral data from the current viewer within the interval time, the behavioral data acquisition unit 12 registers the behavioral data in association with the slide that was displayed just before.

[0066] 6, the behavioral data acquiring unit 12 receives the input of the answer "check mark" to the question as response information at the playback timing VODT 10 seconds after the end of the playback time of slide AMC1, which is within the interval time of slide AMC1. Then, the behavioral data acquiring unit 12 registers the answer "check mark" in association with the occurrence timing (A-40).

[0067] The interval time can be set arbitrarily for each slide, and may be set, for example, according to the weight indicating the difficulty of the true or false question, or specifically, may be set to 15 seconds, etc. Furthermore, the behavioral data acquiring unit 12 may register the occurrence timing of the behavioral data received within the interval time of each slide, starting from the point in time when the slide that was being played immediately before ended.

[0068] Next, when the interval time for the previously displayed slide has elapsed, the display unit 13 displays the next slide (BMC2 in the illustrated example) based on the video information. Then, the behavioral data acquisition unit 12 registers the behavioral data and the timing of occurrence of the behavioral data in association with the slide that has been displayed. Here, particularly when the behavioral data acquisition unit 12 receives an input of withdrawal as behavioral data, this is done via an icon for ending the video content or an icon for closing the application itself.

[0069] The behavioral data acquisition unit 12 performs a process of registering the above-mentioned behavioral data of the viewer and transfers it to the display unit 13. The display unit 13 then displays slides containing the behavioral data in order based on the video information, and displays the video content. When the behavioral data acquisition unit 12 registers the behavioral data, it may register the behavioral data in the order in which it is received, or it may register the behavioral data collectively by day or by hour. In addition, in this embodiment, behavioral data is registered for slides that display questions, but behavioral data indicating whether a slide is good or bad may also be registered for slides that provide explanations, such as lectures, rather than questions.

[0070] <Video content display processing> In the flowchart shown in Fig. 5, when the processing up to S14 is completed, the display unit 13 displays the video content based on the video information, user information, and viewing information registered in the database DB. The processing for displaying the video content based on the above information will be described with reference to Figs. 7 and 8.

[0071] Fig. 7 is a diagram showing an example of a flowchart when video content is displayed based on each piece of information. Fig. 7 shows the processing details when video content is displayed for one slide.

[0072] In SD11, the display unit 13 compares the occurrence timing of the behavioral data with the playback timing of the video content. Then, among the registered past behavioral data of the viewer, the display unit 13 displays the video content including the behavioral data whose playback timing exceeds the occurrence timing (YES in SD11) and the display medium of the past viewer corresponding to the behavioral data (SD12). On the other hand, if the playback timing does not exceed the occurrence timing (NO in SD11), in SD13 the display unit 13 displays the video content including only the received display medium.

[0073] <Display processing for display media> Fig. 8 is an image diagram of display processing of a display medium based on past viewer behavior data. Fig. 8 explains the processing content of display processing of a display medium based on the behavior data used to explain the behavior data registration processing in Fig. 6 and the timing of occurrence of the behavior data.

[0074] The display unit 13 displays the display media of past viewers based on the behavioral data and the timing of occurrence of the behavioral data. Specifically, the display unit 13 displays the display media in a manner corresponding to the behavioral data based on the timing of occurrence until the playback timing VODT at which the slides corresponding to the behavioral data are displayed.

[0075] 8, past reaction information of viewer AU1 (occurrence timing A-12), past reaction information of viewer AU2 (occurrence timing A-21), and past reaction information of viewer AU3 (occurrence timing A-40) are registered in association with slide AMC1. Then, when the playback timing of the video passes each occurrence timing, the display unit 13 displays a display medium on which a mark corresponding to the reaction information is superimposed for viewers AU1 and AU3, and a display medium colored in light ink for viewer AU2.

[0076] When the playback timing of the video content exceeds the playback timing VODT for displaying the slide AMC1, the display unit 13 displays the display medium in a manner corresponding to the behavioral data associated with the slide BMC2. Note that the manner corresponding to the behavioral data can be set arbitrarily.

[0077] <Displaying video content including a list of viewers on the screen> Next, with reference to FIG. 9, a screen of video content obtained by executing the display process of the display medium described with reference to FIGS. 7 and 8 in the first embodiment will be described.

[0078] <Switching between viewer list and video content> 9, the video content VOD includes a viewer list AUL or a slide SL and a playback timing TB. In this embodiment, the display unit 13 performs a video content display process in a manner that allows switching between the viewer list AUL and the slide SL, which are displayed based on the user information and viewing information of past viewers.

[0079] In FIG. 9(a), the display unit 13 places the viewer list AUL in the center of the video content VOD and displays it. In FIG. 9(b), the display unit 13 places the slide SL in the center of the video content VOD and displays it. Then, when the display unit 13 receives a selection of the switching unit SB via the input unit 94, it switches between the screens of FIG. 9(a) and FIG. 9(b) and displays the video content VOD. In this embodiment, the switching unit SB is a thumbnail as shown in FIG. 9, but it may also be a button that can switch the screen. Furthermore, instead of or in addition to the switching unit SB, the display unit 13 may display the slide SL in the case of FIG. 9(a) or the viewer list AUL in the case of FIG. 9(b) in association with the playback timing TB.

[0080] Furthermore, the display unit 13 may display the display medium of the current viewer in the viewer list AUL. In this case, when the display unit 13 receives behavioral data from the current viewer, it displays the display medium of the current viewer in the viewer list AUL in a manner corresponding to the received behavioral data. Note that if the display medium is video, the display medium acquisition unit 11 acquires video of the current viewer who is watching video content and passes it to the display unit 13, thereby displaying the display medium of the current viewer in the viewer list AUL.

[0081] <Change the layout of the viewer list> Furthermore, in this embodiment, the display unit 13 rearranges and arranges the display media of multiple past viewers based on the behavioral data as viewing information. Specifically, the display unit 13 changes the display positions of the display media of multiple past viewers based on the behavioral data as viewing information, and displays the viewer list AUL.

[0082] In this embodiment, the display unit 13 arranges display media of past viewers whose behavioral data match adjacently on either the top, bottom, left, or right side of the inside of the viewer list AUL. Note that the display unit 13 may arrange display media of past viewers whose behavioral data match in the same color. Furthermore, if the behavioral data do not match, the display unit 13 displays the display media linked to each behavioral data randomly or in order of the highest relevance of the behavioral data.

[0083] <Changing the viewer list layout by specifying the viewing date> In this embodiment, the display unit 13 arranges multiple display media based on viewing dates of past viewers as viewing information. In this embodiment, the video generation system 0 accepts a date specification from a current viewer via the input unit 94. The display unit 13 then arranges only display media of past viewers associated with viewing information having a viewing date that matches the accepted date. Note that the viewing date specification may be a date or an arbitrary period.

[0084] In another embodiment, the display unit 13 also displays display media of past viewers associated with viewing dates that do not match the specified date. In this case, the display unit 13 arranges display media of past viewers corresponding to each viewing date next to each other. The display unit 13 may also arrange display media in order of closest viewing dates, starting from the display media of past viewers associated with viewing dates that match the specified date.

[0085] <Changing the layout of the viewer list by specifying attributes> In this embodiment, the display unit 13 arranges display media of multiple past viewers based on the attributes of the past viewers. Specifically, in this embodiment, the video generation system 0 accepts an age specification from a current viewer via the input unit 94. Then, the display unit 13 arranges only display media of past viewers associated with user information having an age that matches the specified age. Note that matching ages can be suitably set to cases where the ages themselves match, where the age groups match, or the like.

[0086] In another embodiment, the display unit 13 also displays display media of past viewers associated with ages that do not match the specified age. In Fig. 9, the display unit 13 arranges display media of past viewers whose ages match next to each other. Although not shown in the figure, the display unit 13 may arrange display media of past viewers whose ages do not match the specified age in order of increasing relevance, i.e., decreasing in order of decreasing age.

[0087] The display unit 13 may arrange the display media of past viewers based on attributes other than age, i.e., industry or job title. For example, the viewer list AUL may be displayed by arranging only past viewers who match all attributes.

[0088] <Change the layout of the viewer list without a specific setting> In another embodiment, the display unit 13 changes the layout of the display media without accepting attribute designation from the current viewer. In this case, the display unit 13 arranges display media of multiple past viewers based on the degree of relevance between the attributes of the current viewer and the attributes of past viewers. Specifically, the display unit 13 arranges only display media of past viewers whose ages match the age of the current viewer.

[0089] Furthermore, a numerical value calculated using regression analysis may be used as the degree of relevance. Specifically, one or more pieces of information on viewer attributes, such as age, industry, and job title, are input as input data, and a numerical value indicating relevance is calculated as output data from the input data, and viewers with similar numerical values ​​are determined to be highly relevant.

[0090] Furthermore, the display unit 13 changes the arrangement of the display media without accepting a viewing date designation from the current viewer. In this case, the display unit 13 arranges the viewing dates of past viewers in order of proximity to the current viewing date, starting from the viewing date of the current viewer (current viewing date), and displays the display media of past viewers.

[0091] In this embodiment, the display unit 13 may not only change the layout but also layout the display media of past viewers who match in each piece of information in the same manner. For example, the display unit 13 may layout the display media of past viewers who match in age in the same color.

[0092] (Embodiment 2) Next, in the second embodiment, a process of displaying video content including slides and a viewer list on the same screen will be described with reference to Fig. 10 to Fig. 14. Note that the process of the system according to the second embodiment causing each functional configuration to function and generating a video is the same as that of the system according to the first embodiment, and therefore will not be described here.

[0093] <Displaying video content including slides and a list of viewers on the same screen> In the display example of this embodiment, the process of displaying the display medium in a manner according to the behavioral data may be continued until the playback of the slide linked to the behavioral data ends, or until the video content ends. The former will be described below with reference to Figures 10 to 12, and the latter with reference to Figures 13 and 14.

[0094] <Display processing of video content that reflects behavioral data associated with each slide> First, a case where the process of displaying the display medium in a manner according to the behavioral data in this embodiment is performed until the playback of the slide linked to the behavioral data ends will be described with reference to Figures 10 to 12. Note that the same configurations as those in Figures 10 and 11 may also be adopted in the case of the first embodiment.

[0095] In the screen display example of Fig. 10, the display unit 13 displays an image simulating a school lecture room as the background of the video content VOD. The display unit 13 also displays a slide SL, which is placed in the upper part of the video content VOD. Furthermore, the display unit 13 displays a viewer list AUL, which is placed in the lower part of the video content VOD, based on the timing of generation of past viewer behavior data, the display medium, and the playback timing.

[0096] 10, the display unit 13 displays a mark corresponding to the answer "true" in the form of a speech bubble from the display medium of a past viewer who entered the answer "true" to a true or false question as behavioral data after the playback timing of the video content VOD has passed. Note that in other embodiments, not only the form of a speech bubble but also sound may be played back.

[0097] <Displaying video content sorted into viewer lists> Next, a display process of video content for which a viewer list has been allocated will be described as a display screen. Note that this configuration may also be adopted in the first embodiment.

[0098] In the screen display example of Figure 11, the video content VOD includes, by behavioral data, a first viewer group AUG1, a second viewer group AUG2, a third viewer group AUG3, a slide SL, the number of display media NAU1 included in the first viewer group AUG1, and the number of display media NAU2 included in the second viewer group AUG2.

[0099] In this embodiment, the display unit 13 displays the slide SL by arranging it in the center of the video content VOD. The display unit 13 also displays the first viewer group AUG1, the second viewer group AUG2, and the third viewer group AUG3 by arranging them on either the top, bottom, left, or right sides of the outside of the slide SL. Furthermore, the display unit 13 displays the number of display media NAU1 and the total number of display media, and the number of display media NAU2 and the total number of display media by arranging them in association with the viewer group AUG1 and the viewer group AUG2, respectively.

[0100] In this embodiment, the display unit 13 arranges display media of past viewers whose playback timing of the video content VOD has not passed the withdrawal timing and whose withdrawal has not been accepted as behavioral data in each viewer group AUG1-3. Specifically, the display unit 13 determines to which viewer group the display media linked to the behavioral data belongs based on the behavioral data accepted from the past viewers and the timing of occurrence of the behavioral data, and arranges the display media.

[0101] 11, the display unit 13 determines that display media that have received a "true" answer to a true / false question from a viewer in the past, as behavioral data whose playback timing has passed the generation timing of the behavioral data, belong to the first viewer group AUG1, and places them in the viewer group AUG1. The display unit also determines that display media that have received a "false" answer from a viewer belong to the second viewer group AUG2, and that display media that have not received an answer from a viewer in the past belong to the third viewer group AUG3, and places them respectively. The number of viewer groups can be suitably changed in accordance with the type of behavioral data to be displayed.

[0102] In this embodiment, the display unit 13 displays the numbers of display media NAU1-NAU2 and the total number of display media indicating the total number of display media to be displayed, based on the playback timing of the video content VOD and the generation timing of the behavioral data. In Fig. 11, the display unit 13 displays the total number of display media (20 in the illustrated example), the number of display media NAU1 belonging to the first viewer group (10 in the illustrated example), and the number of display media NAU2 belonging to the first viewer group (4 in the illustrated example).

[0103] In this embodiment, when the display unit 13 receives two selections of true or false, it places the display medium in a position corresponding to the selection, and when it does not receive a selection, it places the display medium in a position corresponding to the unanswered answer. However, there may be three or more options, and the display medium may be placed in a position corresponding to the selection. Also, the display medium for the unanswered answer does not have to be displayed at all times, or may be hidden when a selection is received. Also, when an answer selection is received from a current viewer, it may display only the display media of past viewers who selected the same answer as the selection.

[0104] <Displaying video content with a chronological viewer list> 12, the video content VOD includes a slide SL, a viewer list AUL, an action timeline ATL, and an occurrence timeline OTL. In this embodiment, the display unit 13 places the slide SL on the left side of the video content VOD and processes its display. The display unit 13 also places the viewer list AUL, the action timeline ATL, and the occurrence timeline OTL on the right side of the video content VOD, in that order from left to right, and processes their display.

[0105] 12, the display unit 13 arranges occurrence timings in the occurrence time series OTL in order of earliest occurrence timing from the top. The display unit 13 also arranges the behavioral data and display media in the behavioral time series ATL and viewer list AUL, respectively, in association with the occurrence timing, and performs display processing. Here, the shaded display media in the viewer list AUL indicate the display media scheduled for display processing.

[0106] Furthermore, in this embodiment, the display unit 13 arranges the display media based on the order of occurrence timing of the behavioral data and the upper limit number of display media to be displayed. Specifically, based on the order of occurrence timing of the behavioral data and the setting of the upper limit number of display media to be displayed in the viewer list AUL, the display unit 13 arranges the display media by changing the display media to be displayed in the viewer list AUL every time the playback timing of the video content VOD passes the occurrence timing of the behavioral data of the display medium to be displayed.

[0107] In FIG. 12, the display unit 13 determines that the number of display media to be processed for display is the upper limit (6 in the illustrated example). Then, when the playback timing of the video content VOD passes the occurrence timing of the behavioral data linked to the shaded display medium, the display unit 13 replaces the display medium that was placed at the top of the viewer list AUL with the display medium that was placed one position below it. Then, the display unit 13 performs the above-mentioned placement process on all display media that are placed consecutively below the display medium, thereby placing the shaded display medium at the bottom of the viewer list AUL. Then, while placing each display medium, the display unit 13 also places the behavioral data and occurrence timing associated with each display medium in association with each display medium and performs display processing.

[0108] <Displaying video content that reflects all behavioral data linked to the played slide> Next, a case where the process of displaying the display medium in a manner according to the reaction information is performed until the video content ends will be described with reference to Fig. 13 and Fig. 14. Note that a similar configuration may be adopted in the first embodiment as well, with respect to Fig. 13.

[0109] <Display process for video content that changes the viewer list according to the answer to the true or false question> 13, the video content VOD includes a slide SL and a viewer list AUL. In this embodiment, the display unit 13 displays the slide SL by arranging it on the left side of the video content VOD. The display unit 13 also displays the viewer list AUL by arranging it on the right side of the video content VOD.

[0110] In this embodiment, the display unit 13 processes the display medium to display a mode corresponding to the combination of the reaction information and the correct answer information based on the reaction information and the correct answer information at the playback timing after the slide SL linked to the reaction information. Here, the correct answer information is set for each question and is information indicating the correct answer option among the options. A score may also be set for the correct answer information for each question. The display unit 13 may perform display processing based on score information instead of the correct answer information. The score information is information indicating the score set for each option.

[0111] In FIG. 13, if a viewer's past response information (answer to a true / false question) is incorrect, the display unit 13 displays the display medium of the viewer in the viewer list AUL so that the timing of the response information is identifiable. For example, in FIG. 13, the display unit 13 displays the display medium in a light black color and further overlays text such as "Dropped (Question X)" so that the slide on which the incorrect answer was received (Question X in the illustrated example) can be identified. Note that if the viewer's past answer was correct, the display medium may be displayed as is, or may be displayed in a color corresponding to the number of matches between the correct answer information and the answer. Here, an "incorrect" answer and a "correct" answer refer to an answer that matches the "correct answer" in the correct answer information and an answer that does not match the "correct answer" in the correct answer information, respectively.

[0112] In this embodiment, the earlier the playback timing of a slide SL associated with incorrect reaction information, the lower the display medium is arranged in the viewer list AUL by the display unit 13. For example, in Fig. 13, the display unit 13 arranges the display medium of the viewer who entered the incorrect answer for the slide SL with the earliest playback timing (the first question in the illustrated example) among the slides SL that received the incorrect answer, at the lowest position in the viewer list AUL.

[0113] 14, the video content VOD includes a slide SL, a viewer list AUL, and a score list SCL. In this embodiment, the display unit 13 displays the slide SL by arranging it on the left side of the video content VOD. The display unit 13 also displays the viewer list AUL and score list SCL by arranging them on the right side of the video content VOD, in that order from left to right.

[0114] In this embodiment, the display unit 13 associates and arranges the total count and the display medium based on the correct answer information for the true or false questions for each slide, the count set for each slide, and the behavioral data, and performs display processing. Specifically, the display unit 13 assigns a count to each slide based on a combination of the behavioral data and the correct answer information, and at a specific playback timing, displays the total count obtained by adding up the counts for each slide played before that playback timing.

[0115] In Figure 14, the display unit 13 totals, for each display medium, the counts corresponding to slides SL that were played before the slide SL being displayed and that received behavioral data and correct answers, and displays the total result in a score list SCL. The display unit 13 also arranges the total points from the top of the score list SCL in descending order of total points, and displays the score list SCL. The display unit 13 then arranges the display media in association with the total points, and displays the viewer list AUL. The points set for each slide can be set as desired.

[0116] In this embodiment, the display unit 13 totals the points for each question based on correct answer information or point allocation information in which a point is set for each question, and arranges and displays the total points in a point list SCL.

[0117] Furthermore, in this embodiment, the display unit 13 accepts answers to questions with a correct answer, such as true or false questions, and displays the total score. However, for questions without a correct answer, such as personality tests, the display unit 13 may accept answers from multiple options and display the total score. In this case, the storage unit 14 stores point allocation information in which multiple categories and points corresponding to each category are set for each option. Upon accepting an option, the display unit 13 totals the points corresponding to the option for each category based on the point allocation information, and arranges and displays the total points for each category in the point list SCL. The display unit 13 may also display a radar chart based on the total points for each category. Furthermore, the display unit 13 may determine a diagnosis result based on the total points for each category and display it for each viewer instead of or in addition to the point list SCL. [Explanation of symbols]

[0118] 0: Video generation system 1: Information processing equipment 11:Display medium acquisition section 12: Behavioral data acquisition unit 13: Display section 101: Control unit 102: Storage section 103: Communications Department 2: User terminal device 9: Terminal device 91: Control unit 92: Storage section 93: Communications Department 94: Input section 95: Output section NW: Communication network

Claims

1. A video generation system for generating on-demand videos in which viewers' reactions can be viewed, comprising: The video generation system includes a storage unit, a display medium acquisition unit, a behavior data acquisition unit, and a display unit, The storage unit stores video information for displaying on-demand video content, The video content is made up of a plurality of contents each having a predetermined playback time range, The display medium acquisition unit acquires a display medium showing a video of a viewer, or an image or an avatar registered in advance for each viewer, the behavioral data acquisition unit acquires, when a viewer watches video content, behavioral data indicating an action taken by the viewer with respect to the video content, in association with a generation timing indicating a playback timing at which the behavioral data was accepted and with a content of the video content; the display unit performs display processing of an on-demand video including the display medium in a manner corresponding to the behavioral data for each of the contents displayed in one video content, based on the behavioral data, the contents of the video content to which the behavioral data is associated, and the occurrence timing of the behavioral data. Video generation system.

2. The storage unit stores attribute information indicating attributes of the viewer for each viewer, the display unit performs display processing for a display medium highly related to the viewer, among the display media of the plurality of viewers who have viewed the video content, based on attribute information of the viewer who views the video content and attribute information of viewers who have viewed the video content in the past; The video production system of claim 1 .

3. The storage unit stores date and time information indicating a viewing date and time for each viewer, the display unit performs display processing on a display medium corresponding to a viewer having specific date and time information among the plurality of display media based on the date and time information; The video generation system according to claim 1 or 2.

4. The display unit identifies a viewer group to which the display medium belongs based on the behavior data associated with the display medium, and displays the on-demand video with the display medium arranged in different areas according to the viewer group. The video generation system according to any one of claims 1 to 3.

5. The behavior data includes a leaving timing indicating a playback timing at which each viewer finished viewing, the display unit performs display processing on the display medium associated with the past viewer based on a departure timing in a manner different from before and after the playback timing corresponding to the departure timing. The video generation system according to any one of claims 1 to 4.

6. The behavioral data further includes reaction information indicating an evaluation of the video received for each viewer, The display unit performs processing to display an on-demand video on the display medium on which a mark corresponding to the reaction information is superimposed based on the reaction information. The video generation system according to any one of claims 1 to 5.

7. A video generation method for generating on-demand videos in which a viewer's reaction can be viewed, comprising the steps of: The video production system storing video information for displaying video content of on-demand video having a plurality of contents each having a predetermined playback time range; obtaining a display medium showing an image of a viewer or an avatar of a viewer that has been preregistered; acquiring, when a viewer views video content, behavioral data indicating an action of the viewer with respect to the video content in association with a generation timing indicating a playback timing at which the behavioral data was received and a content of the video content; and displaying an on-demand video including the display medium in a manner corresponding to the behavioral data for each of the contents displayed in one video content based on the behavioral data, the contents of the video content to which the behavioral data is associated, and the occurrence timing of the behavioral data. Video generation method.

8. A video generation program for generating on-demand videos in which the reactions of viewers can be viewed, the video generation program causes a computer to function as a storage unit, a display medium acquisition unit, a behavioral data acquisition unit, and a display unit; The storage unit stores video information for displaying on-demand video content, The video content is made up of a plurality of contents each having a predetermined playback time range, The display medium acquisition unit acquires a display medium showing a video of a viewer, or an image or an avatar registered in advance for each viewer, the behavioral data acquisition unit acquires, when a viewer watches video content, behavioral data indicating an action taken by the viewer with respect to the video content, in association with a generation timing indicating a playback timing at which the behavioral data was accepted and with a content of the video content; the display unit performs display processing of an on-demand video including the display medium in a manner corresponding to the behavioral data for each of the contents displayed in one video content, based on the behavioral data, the contents of the video content to which the behavioral data is associated, and the occurrence timing of the behavioral data. Video generation program.

Images