Program, information processing device, method, and system

Abstract

The object is to make it easier to access a desired playback point in video content. [Solution] A program for operating a computer including a processor and a memory causes the processor to execute the steps of: displaying, on a display device, thumbnail information including summary information for multiple content sections associated along a playback time axis of video content; and, when a specific thumbnail information displayed on the display device is selected, accessing a playback location in the video content of the content section corresponding to the specific thumbnail information.

Description

[Technical Field]

[0001] The present disclosure relates to a program, an information processing device, a method, and a system. [Background technology]

[0002] In recent years, with information-dense video content such as lectures and seminars provided on online learning platforms, viewers tend to repeatedly watch specific important parts or explanations that were difficult to understand the first time. To support this viewing behavior, general video players are equipped with seek bars, playback speed adjustment functions, chapter functions, etc.

[0003] Patent Document 1 discloses a technique that allows viewers to specify a playback start point after pausing or rewinding and then resume playback in a real-time distributed seminar or the like. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2024-100075 Summary of the Invention [Problem to be solved by the invention]

[0005] However, with the technology described in Patent Document 1, the viewer has to search for the playback point by themselves and perform pause and rewind operations, making it difficult to efficiently find the desired playback point while overlooking the entire video configuration. In particular, for video content such as lectures or seminars with high information density, there is a demand for information that more accurately represents the content of the desired playback point.

[0006] An object of the present disclosure is to facilitate access to a desired playback point in video content. [Means for solving the problem]

[0007] In order to solve the above problem, one aspect of the program of the present disclosure is a program for operating a computer having a processor and a memory, the program causing the processor to execute the steps of displaying thumbnail information including summary information for multiple content sections associated along the playback time axis of video content on a display device, and when specific thumbnail information displayed on the display device is selected, accessing the playback location of the content section in the video content corresponding to the specific thumbnail information. [Effects of the Invention]

[0008] According to the present disclosure, it is possible to easily access a desired playback location in video content. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a block diagram showing the overall configuration of a system 1. FIG. [Figure 2] 2 is a block diagram showing an example of the functional configuration of a terminal device 10. FIG. [Figure 3] 2 is a block diagram showing an example of the functional configuration of a server 20. FIG. [Figure 4] 3 is a block diagram showing an example of the functional configuration of a management device 30. FIG. [Figure 5] FIG. 2 is a diagram showing the data structure of a content section information table 2021. [Figure 6] FIG. 10 is a diagram showing the data structure of a log table 2022. [Figure 7] FIG. 2 is a diagram illustrating an example of a processing flow in the system 1. [Figure 8] FIG. 10 is a diagram illustrating an example screen of the present disclosure. [Figure 9] FIG. 10 is a diagram illustrating an example screen of the present disclosure. [Figure 10] FIG. 10 is a diagram illustrating an example screen of the present disclosure. [Figure 11] FIG. 9 is a block diagram showing the basic hardware configuration of a computer 90. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In all drawings describing the embodiments, common components are designated by the same reference numerals, and repeated description will be omitted. Note that the following embodiments do not unduly limit the content of the present disclosure described in the claims. Furthermore, not all components shown in the embodiments are necessarily essential components of the present disclosure. Furthermore, each drawing is a schematic diagram and is not necessarily a precise illustration.

[0011] In the following description, a "processor" refers to one or more processors. The at least one processor is typically a microprocessor such as a CPU (Central Processing Unit), but may also be another type of processor such as a GPU (Graphics Processing Unit). The at least one processor may be single-core or multi-core.

[0012] Furthermore, the at least one processor may be a processor in the broad sense, such as a hardware circuit (for example, a field-programmable gate array (FPGA) or an application-specific integrated circuit (ASIC)) that performs part or all of the processing.

[0013] In the following explanation, information that produces an output for an input may be described using expressions such as "xxx table," but this information may be data of any structure, or may be a learning model such as a neural network that produces an output for an input. Therefore, an "xxx table" may be referred to as "xxx information."

[0014] Furthermore, in the following description, the configuration of each table is an example, and one table may be divided into two or more tables, or all or part of two or more tables may be one table.

[0015] In addition, in the following explanation, processing may be described using the "program" as the subject, but since a program is executed by a processor to perform specified processing while appropriately using a memory unit and / or an interface unit, etc., the subject of the processing may also be the processor (or a device such as a controller that has that processor).

[0016] The program may be installed in a device such as a computer, or may be stored in, for example, a program distribution server or a computer-readable (e.g., non-transitory) recording medium. Also, in the following description, two or more programs may be realized as one program, or one program may be realized as two or more programs.

[0017] Furthermore, in the following description, identification numbers are used as identification information for various objects, but other types of identification information (for example, identifiers including alphabetic characters or symbols) may also be used.

[0018] In addition, in the following description, when describing elements of the same type without distinguishing between them, reference symbols (or common symbols among the reference symbols) may be used, and when describing elements of the same type with distinction between them, the identification numbers (or reference symbols) of the elements may be used.

[0019] In the following description, the control lines and information lines are those that are considered necessary for the description, and do not necessarily represent all the control lines and information lines in the product. All components may be interconnected.

[0020] Each information processing device is configured by a computer equipped with an arithmetic unit and a storage device. The basic hardware configuration of the computer and the basic functional configuration of the computer realized by the hardware configuration will be described later. For each of the terminal device 10, the server 20, and the management device 30, descriptions that overlap with the basic hardware configuration and basic functional configuration of the computer will be omitted.

[0021] (First embodiment) <1. Overview> The system according to this embodiment displays thumbnail information including summary information for multiple content sections associated along the playback time axis of video content on a display device, and when specific thumbnail information displayed on the display device is selected, accesses the playback location of the content section in the video content corresponding to the specific thumbnail information. Thumbnail information refers to information that combines summary information (text) indicating the contents of the content section and a representative image. The representative image included in the thumbnail information may include an image of a presentation slide associated with the content section, or an image capturing a scene from the video of the content section. Furthermore, the representative image is not limited to a still image, but may also be a moving image or animation.

[0022] Here, the content section in this embodiment refers to any partial section defined along the playback time axis of video content, and can be defined, for example, by any of the following or a combination thereof: a section mechanically divided into sections at predetermined time intervals (e.g., every 3 minutes) from the start of the video, a section semantically divided by automatically detecting a turning point in the topic of the video content using AI or the like, or a section divided by a change in presentation slides accompanying the video content or a chapter set in advance by the content provider.

[0023] <2. Overall system configuration> Fig. 1 is a block diagram showing an example of the overall configuration of system 1. System 1 is, for example, a system for providing a viewing support service for video content. The viewing support service is a service that helps viewers easily access desired parts of video content and supports content providers in evaluating or improving content by visualizing viewing logs.

[0024] 1 includes, for example, a terminal device 10, a server 20, and a management device 30. The terminal device 10, the server 20, and the management device 30 are connected for communication via a network 80, for example.

[0025] 1, for the sake of simplicity, an example is shown in which the system 1 includes one terminal device 10. However, in reality, the system 1 may include multiple terminal devices 10 for use by multiple viewers.

[0026] 1 shows an example in which the system 1 includes one server 20, but for example, a collection of multiple devices may be one server 20. The way in which the multiple functions required to realize the server 20 are allocated to one or multiple pieces of hardware can be determined appropriately depending on the processing capacity of each piece of hardware and / or the specifications required for the server 20.

[0027] The terminal device 10 is, for example, an information processing device operated by a viewer. The terminal device 10 may be realized by, for example, a mobile terminal such as a smartphone or a tablet, or a desktop personal computer (PC), a laptop PC, or the like.

[0028] The terminal device 10 includes a communication IF (Interface) 12, an input device 13, an output device 14, a memory 15, a storage 16, and a processor 19. The input device 13 is a device (for example, a touch panel, a touch pad, a pointing device such as a mouse, a keyboard, etc.) for receiving input operations (thumbnail selection, etc.) from a viewer. The output device 14 is a device (display, speaker, etc.) for presenting information (video content, a thumbnail list, etc.) to the viewer.

[0029] The server 20 is, for example, an information processing device for managing and operating a video content viewing support service, and is an information processing device realized by a computer connected to a network 80. The server 20 may be, for example, an API (Application Programming Interface) server. As shown in FIG. 1 , the server 20 includes a communication IF 22, an input / output IF 23, a memory 25, a storage 26, and a processor 29. The input / output IF 23 functions as an input device for receiving input operations from an administrator who manages the video content viewing support service, and as an interface for an output device for outputting information to the administrator.

[0030] The management device 30 is an information processing device used by a content provider. The management device 30 displays various information provided by the server 20 and performs management operations such as registering or editing content, managing live distribution, and viewing viewing log analysis results. The management device 30 is realized by a stationary PC (Personal Computer), a laptop PC, or the like. The management device 30 may also be a portable computer such as a smartphone or a tablet terminal. The specific configuration of the management device 30 will be described later.

[0031] Each information processing device, such as the terminal device 10, the server 20, and the management device 30, may be configured by a computer 90 equipped with an arithmetic unit and a storage device. The basic hardware configuration of the computer 90 and the basic functional configuration of the computer 90 realized by the basic hardware configuration will be described later. Note that for each of the terminal device 10, the server 20, and the management device 30, descriptions that overlap with the basic hardware configuration and basic functional configuration of the computer 90 will be omitted.

[0032] <3. Configuration of terminal device> Fig. 2 is a block diagram showing an example of the functional configuration of the terminal device 10. As shown in Fig. 2, the terminal device 10 includes a communication unit 120, an input device 13, an output device 14, an audio processing unit 17, a microphone 171, a speaker 172, a camera 160, a position information sensor 150, a storage unit 180, and a control unit 190. The blocks included in the terminal device 10 are electrically connected by, for example, a bus or the like.

[0033] The communication unit 120 performs processing such as modulation and demodulation for the terminal device 10 to communicate with other devices. The communication unit 120 performs transmission processing on the signal generated by the control unit 190 and transmits it to the outside (for example, the server 20). The communication unit 120 performs reception processing on the signal received from the outside and outputs it to the control unit 190.

[0034] The input device 13 is a device through which a viewer operating the terminal device 10 inputs instructions or information. The input device 13 is realized, for example, by a touch-sensitive device 131 or the like, which inputs instructions by touching the operation surface. If the terminal device 10 is a PC or the like, the input device 13 may be realized by a reader, keyboard, mouse, or the like. The input device 13 converts instructions input by the viewer into electrical signals and outputs the electrical signals to the control unit 190. The input device 13 may include, for example, a receiving port that receives electrical signals input from an external input device.

[0035] The output device 14 is a device for presenting information to a viewer operating the terminal device 10. The output device 14 is realized, for example, by a display 141 or the like. The display 141 displays data according to the control of the control unit 190. The display 141 is realized, for example, by an LCD (Liquid Crystal Display) or an organic EL (Electro-Luminescence) display or the like.

[0036] The audio processing unit 17 performs, for example, digital-to-analog conversion processing of an audio signal. The audio processing unit 17 converts a signal provided from the microphone 171 into a digital signal and provides the converted signal to the control unit 190. The audio processing unit 17 also provides the audio signal to the speaker 172. The audio processing unit 17 is realized, for example, by a processor for audio processing. The microphone 171 receives audio input and provides an audio signal corresponding to the audio input to the audio processing unit 17. The speaker 172 converts the audio signal provided from the audio processing unit 17 into audio and outputs the audio to the outside of the terminal device 10.

[0037] The camera 160 is a device that receives light with a light receiving element and outputs the light as an image capturing signal.

[0038] The position information sensor 150 is a sensor that detects the position of the terminal device 10, and is, for example, a GPS (Global Positioning System) module. The GPS module is a receiving device used in a satellite positioning system. In the satellite positioning system, signals are received from at least three or four satellites, and the current position of the terminal device 10 equipped with the GPS module is detected based on the received signals. The position information sensor 150 may detect the current position of the terminal device 10 from the position of the wireless base station to which the terminal device 10 is connected.

[0039] The storage unit 180 is realized by, for example, the memory 15, the storage 16, etc., and stores data and programs used by the terminal device 10. The storage unit 180 stores, for example, user information 181.

[0040] The user information 181 includes, for example, information about the viewer who uses the terminal device 10. The information about the viewer includes, for example, the viewer's name, age, address, date of birth, contact information, and the like.

[0041] The control unit 190 is realized by the processor 19 reading a program stored in the storage unit 180 and executing instructions included in the program. The control unit 190 controls the operation of the terminal device 10. The control unit 190 functions as an operation reception unit 191, a transmission / reception unit 192, and a presentation control unit 193 by operating in accordance with the program.

[0042] The operation reception unit 191 performs processing for receiving instructions or information input from the input device 13. Specifically, for example, the operation reception unit 191 receives instructions input from the touch-sensitive device 131 or the like, or information such as thumbnail selection.

[0043] Furthermore, the operation reception unit 191 receives voice instructions input from the microphone 171. Specifically, for example, the operation reception unit 191 receives a voice signal that is input from the microphone 171 and converted into a digital signal by the voice processing unit 17.

[0044] The transmitting / receiving unit 192 performs processing for the terminal device 10 to transmit and receive data to and from an external device such as the server 20 in accordance with a communication protocol. Specifically, for example, the transmitting / receiving unit 192 transmits information input by a viewer or instructions from the viewer to the server 20. In addition, the transmitting / receiving unit 192 receives information provided by the server 20.

[0045] The presentation control unit 193 controls the output device 14 (particularly the display 141) to display thumbnail information including summary information for multiple content sections associated along the playback time axis of the video content, which has been received from the server 20 or generated within the terminal device 10, on the output device 14. When specific thumbnail information is selected, the presentation control unit 193 controls the video player displayed on the output device 14 to access the playback point of the corresponding content section and start playback of the video, or move the playback position.

[0046] <4. Server configuration> 3 is a block diagram showing an example of the functional configuration of the server 20. As shown in FIG. 3, the server 20 includes a communication unit 201, a storage unit 202, and a control unit 203 including a processor 29.

[0047] The communication unit 201 corresponds to the communication IF 22 and performs processing for communicating with external devices such as the terminal device 10 and the management device 30 via the network 80 .

[0048] The memory unit 202 corresponds to the memory 25 and the storage 26, and stores an OS, a program related to the present disclosure, and various databases or tables. The memory unit 202 stores, for example, a content section information table 2021 and a log table 2022. The memory unit 202 may also store viewer attribute information. The viewer attribute information stores attribute information of a viewer of video content (for example, the company they belong to, their job title, areas of interest, or preference information based on past viewing history) in association with a viewer ID, etc.

[0049] The content section information table 2021 stores summary information and representative images (e.g., related slide images, video capture images) included in thumbnail information for each content section of video content. The summary information may be automatically generated by, for example, the server 20 transcribing the video data of each content section using a machine learning model such as a generation AI (large-scale language model) and then summarizing the transcription results using the generation AI. Alternatively, the summary information may be registered or edited by the content provider via the management device 30, which will be described later.

[0050] The log table 2022 stores a viewing log for each content section and an operation log for the content section being viewed. Specifically, the log stores a viewing ratio log showing the viewing ratio of the actual viewing time to the total playback time of each content section, a viewing transition log showing the order in which the viewer viewed multiple content sections, a clipping log showing clipping operations performed by the viewer while viewing video content, and operation logs such as play, stop, and seek, in association with a viewer ID, content ID, section ID, etc. A clipping operation is an operation to specify a content section in which the viewer is interested in order to save or share that section.

[0051] The control unit 203 is realized by the processor 29 executing a program stored in the storage unit 202, and controls the overall operation of the server 20. The control unit 203 includes, as main functional units in this embodiment, a transmission control module 2031, an access control module 2032, a log acquisition module 2033, a personalization processing module 2034, a content processing module 2035, and a presentation module 2036, for example. These module names are merely examples, and the actual module configurations and names are not limited to these. Furthermore, these functions may be implemented as a single module or may be divided into multiple modules.

[0052] The transmission control module 2031 performs a process of acquiring various information from the storage unit 202 and transmitting it to the requesting device in response to a request from the terminal device 10 or the management device 30. For example, in response to a request from the terminal device 10, it acquires thumbnail information including summary information for multiple content sections associated along the playback time axis of the video content, transmits it to the terminal device 10, and displays it on the display 141. In addition, in response to a request from the management device 30, it transmits analysis results of the viewing log, etc.

[0053] When specific thumbnail information is selected on the terminal device 10, the access control module 2032 receives the information, identifies the playback location of the content section in the video content that corresponds to the specific thumbnail information, and transmits control information (e.g., playback start time) so that the video player on the terminal device 10 can access the playback location.

[0054] The log acquisition module 2033 acquires viewing logs for each content segment (including viewing ratio logs, viewing transition logs, clipping logs, etc.) or operation logs for the content segment being viewed, which are transmitted from the terminal device 10, and stores them in the log table 2022. Furthermore, the log acquisition module 2033 can also perform analysis processing based on the collected and stored viewing logs or operation logs, such as calculating the evaluation of the video content or the degree of interest of viewers, or identifying content segments with a high dropout rate despite being accessed by more than a predetermined number of people.

[0055] The server 20 may optionally include a personalization processing module 2034. The personalization processing module 2034 performs processing to dynamically change at least one of the content, level of detail, and length of the summary information to be displayed on the display 141 of the terminal device 10, and the representative image included in the thumbnail information, based on the acquired viewing log or attribute information of the viewer.

[0056] The server 20 may optionally include a content processing module 2035. Based on instructions from the management device 30, the content processing module 2035 registers video content, sets and edits content segments, generates thumbnail information in real time during live streaming, and generates and edits archive content. For example, during live streaming of video content, thumbnail information including summary information and a representative image may be generated in real time for each content segment. This generation may be performed manually by the distributor via the management device 30 or based on real-time analysis of the video content. Furthermore, when generating thumbnail information after the live streaming has ended, the server 20 may accept a hide setting for specific content segments from the content provider via the management device 30, and generate archive content for on-demand viewing by combining the distributed video data with the thumbnail information for each identified content segment, reflecting this setting.

[0057] The presentation module 2036 performs processing to convert the video content evaluation, viewer interest level, identified departure section, etc. into a format that can be displayed on the terminal device 10 or the management device 30 (for example, a dashboard-style graph or list) based on the log acquired by the log acquisition module 2033, and transmit it.

[0058] <5. Management Device Configuration> 4 is a block diagram showing an example of the functional configuration of the management device 30. The management device 30 is an information processing device that allows a content provider to use the system 1 to manage video content, edit it, view analysis results, and the like. The management device 30 is typically implemented by a personal computer, laptop computer, tablet terminal, smartphone, or the like operated by the content provider. As shown in FIG. 4, the management device 30 includes at least a communication unit 320, an input device 33, an output device 34, a storage unit 380, and a control unit 390.

[0059] The communication unit 320 performs processing for the management device 30 to communicate with other devices such as the server 20 via the network 80. The communication unit 320 performs transmission processing on signals generated by the control unit 390 (for example, content registration information, editing instructions, analysis result viewing requests, etc.) and transmits them to the server 20. The communication unit 320 also performs reception processing on signals received from the server 20 (for example, operation interface information, analysis result data, etc.) and outputs them to the control unit 390.

[0060] The input device 33 is a device through which a content provider operating the management device 30 inputs instructions or information. The input device 33 is realized, for example, by a touch-sensitive device 331 or the like, which inputs instructions by touching the operation surface. The content provider performs operations such as uploading content, inputting metadata, setting content segments, issuing instructions to control live streaming, and specifying display filtering conditions for analysis results via the input device 33. The input device 33 converts instructions input by the content provider into electrical signals and outputs the electrical signals to the control unit.

[0061] The output device 34 is a device for presenting information to a content provider who operates the management device 30. The output device 34 is realized by, for example, a display 341. The display 341 displays information received from the server 20 or an operation interface (management screen) generated within the management device 30 in accordance with the control of the control unit. This management screen displays a list of contents, an editing form, a live distribution control panel, viewing log analysis results (graphs, charts, tables, etc.), etc.

[0062] The storage unit 380 stores programs (such as an operating system and a web browser) or data necessary for the management device 30 to operate. It can also store data that the content provider is temporarily editing, or analysis reports downloaded from the server 20. The application program may be pre-stored in the storage unit, or may be downloaded from the server 20 or the like via the communication unit. The application program may include an interpreter-type programming language such as JavaScript (registered trademark) that is executed on a web browser application stored in the management device 30.

[0063] The control unit 390 is realized by the processor executing a program stored in the storage unit, and controls the overall operation of the management device 30. The control unit 390 operates in accordance with the program, thereby fulfilling the functions of an operation reception unit 391, a transmission / reception unit 392, and a presentation control unit 393.

[0064] The operation reception unit 391 performs processing for receiving instructions or information (for example, content registration information, editing instructions, analysis result viewing requests, etc.) input from the input device 33. Specifically, for example, the operation reception unit 391 receives instructions or information related to content management input from the input device 33, etc.

[0065] The transmitting / receiving unit 392 performs processing for the management device 30 to transmit and receive data to and from external devices such as the server 20 in accordance with a communication protocol. Specifically, for example, the transmitting / receiving unit 392 transmits information received by the operation receiving unit 391 or information processed within the management device 30 to the server 20. The transmitting / receiving unit 392 also receives information provided from the server 20 (for example, operation interface information, analysis result data, etc.).

[0066] The presentation control unit 393 controls the output device 34 (mainly the display 341) and displays an operation interface (management screen) on the output device 34 for content provider content management, based on information received by the transmission / reception unit 392 from the server 20 (e.g., information based on the content section information table 2021 or the log table 2022, analysis results of viewing logs, etc.) or information generated within the management device 30. Through this operation interface, the content provider performs content registration and management operations such as uploading video files or presentation slides, and registering and editing meta information such as titles and descriptions. The content provider also performs content section setting and editing operations such as setting the start and end times of content sections, registering and editing representative images or summary information, and confirming and correcting automatically generated summary information proposed by the server 20. Furthermore, the content provider performs live streaming management operations such as controlling the start and end of live streaming, specifying content breaks in real time, and setting markers. The content provider also performs archive editing and public setting operations such as hiding specific content sections and setting the public range and period for the entire content. Then, a viewing log analysis result viewing operation can be performed to view the analysis results such as the number of views of the entire video content, the viewing rate for each content section, viewing transition patterns, or sections with high dropout rates in graph or table format.

[0067] <6. Data Structure> The main data structures used in this embodiment will be described.

[0068] FIG. 5 shows an example of the data structure of the content section information table 2021. This table stores information about each content section constituting video content. Specifically, each record corresponds to a content section, and it can be conceptualized as a management table having columns such as "content ID," "section ID," "section definition," "summary information," and "representative image information." The "content ID" item stores identification information for uniquely identifying the video content to which the section belongs. The "section ID" item is a section ID that uniquely identifies the section. The "section definition" item stores section definition information indicating the start and end times of the section. The "summary information" item stores text information of a summary indicating the content of the section. The summary information may hold multiple summary pieces of different lengths or levels of detail for a single content section depending on the desired display mode or the personalization function described below. The "representative image information" item includes information about the representative image included in the thumbnail information (e.g., a slide image, a path or data of a video capture image), etc.

[0069] FIG. 6 is a diagram showing an example of the data structure of the log table 2022. The log table 2022 stores a viewing log for each content segment and an operation log for the content segment being viewed. Specifically, the log table 2022 can be conceptualized as a management table having columns for, for example, a "log ID," a "viewing log," an "operation log," and a "timestamp." The "log ID" item is identification information for uniquely identifying each log and may include, for example, a combination of a viewer ID, a content ID, and a segment ID. The "viewing log" item stores the viewing ratio when the content segment was viewed, or viewing transition information (e.g., previous segment ID, next segment ID, repeat viewing flag, etc.) indicating the order in which the viewer viewed multiple content segments. The "operation log" item stores the details of operations performed during viewing, such as play, pause, seek, and clipping operations (including clip range, etc.). The "timestamp" item stores the date and time when the log was recorded.

[0070] <7.Operation> The operation of the information processing system in this embodiment will be described with reference to the flowchart in Fig. 7. It is assumed that the definition of each content section of the video content, and summary information or thumbnail representative images showing the content of each section, are stored in advance in the content section information table 2021 of the server 20. This information is either set by the content provider using the management device 30, or automatically generated by the system and confirmed by the provider.

[0071] First, in step S1, in response to a video content viewing request from a viewer, the server 20 performs a process of displaying thumbnail information including summary information for multiple content sections associated along the playback time axis of the video content on the display device (display 141) of the viewer's terminal device 10. Specifically, when the viewer operates the terminal device 10 to request viewing of specific video content, the transmission control module 2031 of the server 20 obtains thumbnail information for all sections of the content from the content section information table 2021 and transmits the thumbnail information to the terminal device 10. Based on the received information, the presentation control unit 193 of the terminal device 10 displays a viewing screen on the display 141 of the terminal device 10, displaying a list of thumbnail information for all sections of the content. The summary information may be embedded in a representative image, or summary information corresponding to the thumbnail under the cursor may be dynamically displayed as the viewer moves the cursor in the thumbnail list.

[0072] Next, in step S2, when specific thumbnail information displayed on the display device is selected, the server 20 performs a process of accessing a playback position of a content section in the video content corresponding to the specific thumbnail information. Specifically, when a viewer selects a specific thumbnail from the list of thumbnail information, the operation reception unit 191 of the terminal device 10 detects this. The terminal device 10 identifies playback start position information of the content section corresponding to the selected thumbnail information, and the presentation control unit 193 controls the video player area 1412 to start playback of the video from the identified position or move the playback position. Note that the process of step S2 is performed in cooperation with the access control module 2032 of the server 20 in a configuration in which the terminal device 10 cannot identify the playback position by itself, such as when video content is streamed from the server 20.

[0073] Next, in step S3, a process is performed to acquire a viewing log for each content segment or an operation log for the content segment being viewed. Specifically, the control unit 190 of the terminal device 10 collects various logs related to the video content being viewed and transmits them to the server 20. The log acquisition module 2033 of the server 20 receives the logs and stores them in the log table 2022. The acquired viewing logs include at least one of a viewing proportion log indicating the viewing proportion of each content segment when viewed, a viewing transition log indicating the order in which the viewer viewed multiple content segments, and a clipping log indicating clipping operations performed by the viewer while viewing the video content. Furthermore, for example, the log acquisition module 2033 may, based on the viewing logs, identify content segments that have a dropout proportion greater than or equal to a predetermined number of users despite being accessed by more than a predetermined number of users, or content segments where dropouts occurred within a predetermined time from the start of video content viewing. Here, "within a predetermined time from the start of video content viewing" refers, for example, to a case where the order in which the viewer accessed the content segment after starting the session is within a predetermined number of times (e.g., three). Alternatively, it may refer to a section included in a period in which the elapsed time from the start of the session is within a predetermined time (e.g., 1 minute), or in which the proportion of the playback time of the entire video content is within a predetermined proportion (e.g., 10%).

[0074] Finally, in step S4, the server 20 performs a process of visualizing and presenting the evaluation of the video content or the viewer's interest level based on at least one of the viewing log and the operation log. Specifically, the presentation module 2036 of the server 20 formats the analysis results (e.g., evaluation of the video content, viewer interest level score, identified withdrawal segment) by the log acquisition module 2033 or the control unit 203 into a format that can be displayed on the management device 30 and transmits it to the content provider. The transmission / reception unit 392 of the management device 30 receives this and displays it on the display 341. Furthermore, these analysis results can be presented via the viewer's terminal device 10.

[0075] <8. Screen Examples> An example of the screen of the display 141 of the terminal device 10 and the display 341 of the management device 30 in the present disclosure will be described.

[0076] 8 shows an example of a video player displayed on the terminal device 10 and a viewing screen showing a list of thumbnails with summary information for each content section. A thumbnail list display area 1411 on the left side of the screen displays a list of multiple thumbnails, each containing information indicating the content of each content section (e.g., title, representative image, summary information, etc.). When the viewer selects a specific thumbnail, the playback position of the video content corresponding to that thumbnail jumps in a video player area 1412 on the right side of the screen. Information about the video content, such as the content name or presenter name, is displayed at the bottom 1413 of the video player.

[0077] FIG. 9 is an example of a report screen of the viewing behavior of an individual viewer displayed on the management device 30. In the upper portion 3411 of the screen, aggregated information, such as the viewing score and number of clicks for each of multiple content segments within a specific video content, is displayed along with a representative image showing the content of each segment. In FIG. 9, the following viewing scores are displayed, from left to right: segment 5 (viewing score: 15.0, number of clicks: 8), segment 6 (viewing score: 13.5, number of clicks: 5), and segment 8 (viewing score: 9.4, number of clicks: 1). Each segment has a "Details" button, allowing access to more detailed information. This type of report screen can also be used by content providers to understand the aggregated overall trends of viewers or individual viewing behavior through a management screen on the management device 30.

[0078] The bottom part of the screen 3412 displays a bar graph visually showing a viewing score calculated based on the viewing rate and number of viewings of each content section in the video content, a line graph of viewing transitions (viewing flow) showing the order in which the viewer viewed the content sections, and whether or not there was repeated viewing, etc. Specifically, in FIG. 9, sections 1 to 9 are displayed, and representative images showing the content of each section are displayed above the bar graphs corresponding to sections 5, 6, and 8, which are the top three sections with the highest viewing scores. Furthermore, the line graph of the "viewing flow" in FIG. 9 shows that the viewer first watched sections 1 to 9 in a row, then watched sections 5 to 9, and then watched sections 2 to 6. This allows the content provider to grasp in detail the level of interest each viewer had in each content section and the type of viewing behavior (including repeated viewing) they engaged in.

[0079] FIG. 10 is another example of a screen displayed on the management device 30. It is an example of a dashboard screen that allows a content provider to grasp the overall viewing status of an event or detailed analysis results for each video content. The filtering area 3413 at the top of the screen includes viewer attribute selection items, such as "industry," "job title," "corporation," and "area," as well as a "filter" button. This allows for filtering of the displayed data based on these criteria. The summary area 3414 displays overall audience size or key indicators, such as "number of on-demand viewers," "number of live viewers," and "average viewership." The content viewership area 3415 displays the amount of interest generated in each content segment, such as "segment 1" through "segment 7," using a vertical bar graph or other display showing the viewership rate for each content segment, allowing users to visually grasp which parts of the overall content are being viewed most frequently. The popular segment ranking area 3416 displays the most popular content segments viewed by viewers in a ranking format, for example, based on a viewing score or viewing percentage. 10, detailed information such as a representative image, summary information, viewing score, click rate, and clip rate is displayed for each of the top-ranked content segments. This allows a content provider to select a specific viewer attribute (e.g., job title or industry) in the narrowing area 3413, and easily identify, through the popular segment ranking area 3416, etc., what content segments viewers with that attribute were particularly interested in.

[0080] <9.Summary> As described above, in the above embodiment, video content is divided into multiple content segments, and thumbnails containing summary information indicating the content of each content segment are displayed in the list display unit. When a viewer selects a specific thumbnail, they can instantly access the corresponding playback point in the video content. This allows viewers to efficiently find and view information that matches their interests or needs, even from long video content.

[0081] In this embodiment, a viewing log for each content segment or an operation log for the content segment being viewed is further acquired. The viewing log includes at least one of a viewing ratio log indicating the viewing ratio of each content segment when viewed, a viewing transition log indicating the order in which the viewer viewed multiple content segments, and a clipping log indicating clipping operations performed by the viewer while viewing the video content. Based on at least one of these acquired viewing logs and operation logs, the evaluation of the video content or the viewer's interest level is visualized and presented. Furthermore, based on the acquired viewing log, content segments with a high dropout rate despite being accessed by a predetermined number of people or content segments where dropout occurs early in the session are identified. This allows content providers to quantitatively grasp viewing trends, such as which content segments viewers are most interested in and which segments they drop out of, based on objective data. As a result, it becomes easier to evaluate content or identify areas for improvement, enabling the provision of high-quality video content that better meets viewer needs.

[0082] <Modification> In the above embodiment, the collection and analysis of viewing logs and the visualization of the results were mainly described, but the present disclosure is not limited to this, and it is also possible to realize more advanced functions by utilizing the collected viewing logs and viewer attribute information.

[0083] (Personalization function) In this modification, the server 20 optimizes the information to be displayed for each individual based on the viewing log and the viewer's attribute information. In this process, the personalization processing module 2034 first receives a viewer ID from the terminal device 10, and reads out the viewer's attribute information, past viewing logs, and preset preference profile (e.g., keywords of interest, preferred information granularity, etc.) associated with the ID from the storage unit 202.

[0084] Next, the personalization processing module 2034 dynamically changes the thumbnail information displayed on the display unit of the terminal device 10 using this information. For example, if the viewer's job title in the attribute information is "management," a short summary focusing on the business impact or conclusion is selected or generated. On the other hand, if the job title is "engineer," a detailed summary focusing on the technical background or specifications is selected or generated. To achieve this processing, the server 20 may store multiple summary patterns for each content segment in advance. Furthermore, if a viewing log indicates that a viewer repeatedly viewed a portion of a video in which a specific presentation slide is displayed, the image of that slide is set as the representative image for that segment. Furthermore, if the keyword "supply chain" is registered in the viewer's preference profile, a content segment containing this keyword in the summary information or segment title is identified, and the sort order is determined so that the segment is displayed higher on the thumbnail list screen. The personalized thumbnail information (display order, summary information for each segment, representative image, etc.) is transmitted to the terminal device 10 via the transmission control module 2031. This allows information that is estimated to be of high interest to each viewer to be presented preferentially.

[0085] The server 20 may also comprehensively analyze the viewer's attribute information, viewing log, and preference profile to present recommended information. This process is performed in cooperation with the personalization processing module 2034 and the presentation module 2036. Specifically, the personalization processing module 2034 first initiates a process for identifying recommendation candidates triggered by the viewer's current viewing behavior (e.g., completion of viewing a specific content segment). For example, the personalization processing module 2034 analyzes the log table 2022 and extracts "content or segments subsequently viewed by other viewers who have the same attribute as the viewer (e.g., manufacturing industry) and who have viewed the same segment" using collaborative filtering. Alternatively, the server 20 may refer to the content segment information table 2021 and use content-based filtering to identify unviewed segments or other video content that have metadata similar to the metadata assigned to the completed segment (e.g., the tag "#quality control"). Next, based on the results of these analyses, the personalization processing module 2034 generates a list of recommendation candidates (a list of other video content IDs or segment IDs within the same content) in descending order of recommendation score. The presentation module 2036 then receives this list of recommendation candidates and generates display data to be presented on the screen of the terminal device 10. For example, a UI element is constructed by combining thumbnails, titles, and portions of summary information of the recommendation candidates together with a heading such as "Recommendations for viewers of this video," and the display data is transmitted to the terminal device 10. This allows viewers to more easily encounter content that is likely to match their interests.

[0086] (Application to live streaming) In this modification, the functions of this embodiment are applied to video content that is live-streamed. The content processing module 2035 of the server 20 generates thumbnail information including summary information and a representative image for each content segment in real time during the live streaming of video content. The generation is performed by manual operation by the distributor via the management interface on the management device 30, or based on the results of real-time analysis of the video content. The generated thumbnail information is sequentially transmitted to the viewer's terminal device 10 and displayed in synchronization with the live video. This allows the viewer, while watching the live streaming, to check summary information of the content streamed a short time ago in the thumbnail, jump to the playback position of that portion, and watch it again (so-called section movement during chase playback).

[0087] After the live distribution ends, the server 20 can generate archive content for on-demand viewing. In this generation process, the server 20 first accepts, via the management device 30, a hide setting for a specific video section from the content provider. Next, the server 20 generates new thumbnail information for each content section from the video that reflects the hide setting. Finally, the server 20 synchronizes and combines the thumbnail information generated in this way with the video that reflects the hide setting to generate archive content for on-demand viewing from which unnecessary sections (for example, sections where the presentation was not smooth) have been removed.

[0088] (Application to external platforms) Furthermore, while the above embodiment mainly describes operations that are completed within the system itself, it is also possible to consider a configuration in which the functions of the present disclosure are applied to video content uploaded to external video platforms, etc. For example, when a viewer enters the URL of an external video, the content processing module 2035 of the server 20 analyzes the video content, automatically divides it into content segments, and generates thumbnail information including summary information, providing a viewing experience similar to that of the present embodiment. This allows the convenience of the present disclosure to be applied to a wider range of video content.

[0089] The above-described modifications may be implemented singly or in appropriate combination, and are intended to be included within the scope and spirit of the present disclosure, as well as within the scope of the claims and their equivalents.

[0090] <Basic computer hardware configuration> 11 is a block diagram showing the basic hardware configuration of a computer 90. The computer 90 includes at least a processor 901, a main memory device 902, an auxiliary memory device 903, and a communication IF 991 (interface), which are electrically connected to one another by a communication bus.

[0091] The processor 901 is hardware for executing an instruction set written in a program, and is composed of an arithmetic unit, registers, peripheral circuits, and the like.

[0092] The main memory device 902 is used to temporarily store programs, data to be processed by the programs, etc. For example, it is a volatile memory such as a DRAM (Dynamic Random Access Memory).

[0093] The auxiliary storage device 903 is a storage device for saving data and programs, such as a flash memory, a hard disk drive (HDD), a magneto-optical disk, a CD-ROM, a DVD-ROM, or a semiconductor memory.

[0094] The communication IF 991 is an interface for inputting and outputting signals for communicating with other computers via a network using wired or wireless communication standards. The network is composed of the Internet, a LAN, various mobile communication systems constructed by wireless base stations, etc. For example, the network includes 3G, 4G, and 5G mobile communication systems, LTE (Long Term Evolution), and wireless networks (e.g., Wi-Fi (registered trademark)) that can connect to the Internet via a predetermined access point. In the case of a wireless connection, communication protocols include, for example, Z-Wave (registered trademark), ZigBee (registered trademark), and Bluetooth (registered trademark). In the case of a wired connection, the network also includes a direct connection using a USB (Universal Serial Bus) cable, etc.

[0095] It should be noted that the computer 90 can be virtually realized by distributing all or part of each hardware configuration across multiple computers 90 and interconnecting them via a network. In this way, the computer 90 is a concept that includes not only a computer 90 housed in a single housing or case, but also a virtualized computer system.

[0096] <Basic functional configuration of computer 90> The following describes the functional configuration of a computer realized by the basic hardware configuration (FIG. 11) of the computer 90. The computer includes at least the functional units of a control unit, a storage unit, and a communication unit.

[0097] The functional units of the computer 90 can also be realized by distributing all or part of the functional units among multiple computers 90 interconnected via a network. The computer 90 is a concept that includes not only a single computer 90 but also a virtualized computer system.

[0098] The control unit is realized by the processor 901 reading out various programs stored in the auxiliary storage device 903, expanding them in the main storage device 902, and executing processing in accordance with the programs. The control unit can realize functional units that perform various types of information processing depending on the type of program. In this way, the computer is realized as an information processing device that performs information processing.

[0099] The storage unit is realized by a main storage device 902 and an auxiliary storage device 903. The storage unit stores data, various programs, and various databases. Furthermore, the processor 901 can allocate a storage area corresponding to the storage unit in the main storage device 902 or the auxiliary storage device 903 in accordance with the programs. Furthermore, the control unit can cause the processor 901 to execute processes for adding, updating, and deleting data stored in the storage unit in accordance with the various programs.

[0100] A database refers to a relational database, which manages data sets called masters and tables in a tabular format structurally defined by rows and columns, by relating them to each other. In a database, a table is called a table, a master, a column in a table is called a column, and a row in a table is called a record. In a relational database, relationships between tables and masters can be set and associated. Typically, each table and each master has a column set as a primary key to uniquely identify a record, but setting a primary key to a column is not essential. The control unit can cause the processor 901 to add, delete, or update records in specific tables and masters stored in the storage unit according to various programs. Furthermore, by storing data, various programs, and various databases in the storage unit, it can be considered that the information processing device and information processing system according to the present disclosure have been manufactured.

[0101] Note that the databases and masters in this disclosure may include any data structure (list, dictionary, associative array, object, etc.) in which information is structurally defined. The data structure also includes data that can be considered as a data structure by combining data with functions, classes, methods, etc. written in any programming language.

[0102] The communication unit is realized by the communication IF 991. The communication unit realizes a function of communicating with other computers 90 via a network. The communication unit can receive information transmitted from other computers 90 and input the information to the control unit. The control unit can cause the processor 901 to execute information processing on the received information in accordance with various programs. In addition, the communication unit can transmit information output from the control unit to other computers 90.

[0103] Furthermore, the above-described configurations, functions, processing units, processing means, etc. may be partially or entirely implemented in hardware, for example, by designing them as integrated circuits. The present invention can also be realized by software program code that implements the functions of the embodiments. In this case, a storage medium on which the program code is recorded is provided to a computer, and a processor included in the computer reads the program code stored in the storage medium. In this case, the program code itself read from the storage medium implements the functions of the above-described embodiments, and the program code itself and the storage medium on which it is stored constitute the present invention. Examples of storage media for providing such program code include flexible disks, CD-ROMs, DVD-ROMs, hard disks, SSDs, optical disks, magneto-optical disks, CD-Rs, magnetic tape, non-volatile memory cards, and ROMs.

[0104] Furthermore, the program code that realizes the functions described in this embodiment can be implemented in a wide range of program or script languages, such as assembler, C / C++, perl, Shell, PHP, and Java (registered trademark).

[0105] Furthermore, the program code of the software that realizes the functions of the embodiments may be distributed via a network and stored in a storage means such as a computer's hard disk or memory, or in a storage medium such as a CD-RW or CD-R, and the processor of the computer may read and execute the program code stored in the storage means or storage medium.

[0106] The functions performed by the components described herein may be implemented in circuitry or processing circuitry, including general-purpose processors, application-specific processors, integrated circuits, ASICs (Application Specific Integrated Circuits), a CPU (a Central Processing Unit), conventional circuits, and / or combinations thereof, programmed to perform the described functions. A processor includes transistors and other circuits and is considered to be circuitry or processing circuitry. A processor may also be a programmed processor that executes programs stored in memory. In this specification, a circuitry, unit, or means is hardware that is programmed to realize or performs the described functions, which may be any hardware disclosed herein or any hardware known to be programmed to realize or perform the described functions. If the hardware is a processor considered to be a type of circuitry, the circuitry, means, or unit is a combination of the hardware and software used to configure the hardware and / or processor.

[0107] Although several embodiments of the present disclosure have been described above, these embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and modifications are intended to be included in the scope of the inventions and their equivalents as defined in the claims, as well as in the scope and spirit of the inventions.

[0108] (Addendum) The matters described in the above embodiments will be supplemented below.

[0109] (Appendix 1) A program for operating a computer including a processor and a memory, the program causing the processor to: displaying, on a display device, thumbnail information including summary information for a plurality of content sections associated along a playback time axis of the video content; When specific thumbnail information displayed on the display device is selected, a step of accessing a playback location of a content section in the video content corresponding to the specific thumbnail information is performed. (Appendix 2) A program as described in Appendix 1, wherein the representative image included in the thumbnail information for each content section includes an image of a presentation slide associated with the content section, or an image capturing a scene from a video of the content section. (Appendix 3) The processor further includes a step of acquiring viewing logs or attribute information of viewers of the video content; A program described in (Appendix 1) or (Appendix 2) that executes a step of dynamically changing at least one of the content, level of detail, length of the summary information to be displayed on the display device, and the representative image included in the thumbnail information, based on the acquired viewing log or attribute information of the viewer. (Appendix 4) The program according to any one of (Supplementary Note 1) to (Supplementary Note 3), further causing the processor to execute a step of acquiring a viewing log for each content segment or an operation log for the content segment being viewed. (Appendix 5) The program described in (Appendix 4), wherein in the step of acquiring the viewing log or the operation log during viewing, the viewing log includes a viewing proportion log indicating the viewing proportion when each content section was viewed. (Appendix 6) The program described in (Appendix 4), wherein in the step of acquiring the viewing log or the operation log during viewing, the viewing log further includes a viewing transition log indicating the order in which the viewer viewed the multiple content sections. (Appendix 7) The program described in Appendix 4 further causes the processor to execute a step of identifying, based on the viewing log, content sections where a predetermined percentage or more of users have left despite being accessed by a predetermined number of users, or content sections where users have left within a predetermined time from the start of the video content. (Appendix 8) The program described in (Appendix 4), wherein in the step of acquiring the viewing log or the operation log, the operation log includes a clipping log indicating clipping operations performed by the viewer while watching the video content. (Appendix 9) The program described in Appendix 4 further causes the processor to execute a step of visualizing and presenting the evaluation of the video content or the viewer's level of interest based on the acquired log. (Appendix 10) The processor further generates the thumbnail information for the content section in real time during live distribution of the video content; The program according to any one of (Supplementary Note 1) to (Supplementary Note 9), which executes a step of displaying the thumbnail information on a display device of a viewer in synchronization with a live streaming video. (Appendix 11) The processor further includes a step of receiving a setting by a content provider to hide a specific video section after the live distribution of the video content; generating the thumbnail information for the content section from the video that reflects the non-display setting; A program described in any one of (Appendix 1) to (Appendix 10) that executes a step of synchronizing the thumbnail information with video that reflects the hidden setting and generating archive content for on-demand viewing. (Appendix 12) An information processing device comprising a processor and a memory, wherein the processor executes all steps in a program according to any one of (Supplementary Note 1) to (Supplementary Note 11). (Appendix 13) A method executed by a computer having a processor and a memory, wherein the processor executes all steps of a program described in any one of (Appendix 1) to (Appendix 11). (Appendix 14) A system comprising means for executing all steps in the program described in any one of (Appendix 1) to (Appendix 11). [Explanation of symbols]

[0110] 1. System 10...Terminal device 120…Communications Department 13...Input device 14...Output device 15...Memory 16…Storage 19...Processor 20...Server 22...Communication IF 23...Input / output interface 25…Memory 26…Storage 29...Processor 30…Management device

Claims

1. A program for operating a computer including a processor and a memory, the program causing the processor to: displaying, on a display device, thumbnail information including a representative image showing the content of each of a plurality of content sections associated along a playback time axis of the video content and text information summarizing the content of the content section; When specific thumbnail information displayed on the display device is selected, a step of accessing a playback location of a content section in the video content corresponding to the specific thumbnail information is performed.

2. The program according to claim 1 , wherein the representative image included in the thumbnail information for each content section includes an image of a presentation slide associated with the content section, or an image capturing a scene from a video of the content section.

3. The processor further includes a step of acquiring viewing logs or attribute information of viewers of the video content; The program of claim 1, which executes a step of dynamically changing at least one of the content, level of detail, length of the text information to be displayed on the display device, and the representative image included in the thumbnail information based on the acquired viewing log or attribute information of the viewer.

4. The program according to claim 1 , further causing the processor to execute a step of acquiring a viewing log for each content segment or an operation log for a content segment being viewed.

5. 5. The program according to claim 4, wherein in the step of acquiring the viewing log or the operation log during viewing, the viewing log includes a viewing ratio log indicating a viewing ratio when each of the content segments is viewed.

6. The program of claim 4, wherein in the step of acquiring the viewing log or the operation log during viewing, the viewing log further includes a viewing transition log indicating the order in which the viewer viewed the multiple content sections.

7. The program of claim 4, further causing the processor to execute a step of identifying, based on the viewing log, a content section where a predetermined percentage or more of users have left despite being accessed by a predetermined number of users, or a content section where users have left within a predetermined time from the start of the video content.

8. 5. The program according to claim 4, wherein in the step of acquiring the viewing log or the operation log, the operation log includes a clipping log indicating clipping operations performed by the viewer while viewing the video content.

9. The program according to claim 4 , further causing the processor to execute a step of visualizing and presenting an evaluation of the video content or a viewer's level of interest in the video content based on the acquired log.

10. The processor further generates the thumbnail information for the content section in real time during live distribution of the video content; 2. The program according to claim 1, further comprising: a step of displaying the thumbnail information on a display device of a viewer in synchronization with a live broadcast video.

11. The processor further includes a step of receiving a setting by a content provider to hide a specific video section after the live distribution of the video content; generating the thumbnail information for the content section from the video that reflects the non-display setting; 2. The program according to claim 1, further comprising: a step of synchronizing the thumbnail information with the video reflecting the non-display setting, and generating archive content for on-demand viewing.

12. An information processing device comprising a processor and a memory, wherein the processor executes all steps of the program according to any one of claims 1 to 11.

13. A computer-implemented method comprising a processor and a memory, wherein the processor executes all the steps of the program of any one of claims 1 to 11.

14. A system comprising means for executing all steps of the program according to any one of claims 1 to 11.

Images