Content management system, content management method, content management program, and user terminal
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-04-04
- Publication Date
- 2026-03-12
AI Technical Summary
Existing systems lack effective methods to support access to specific scenes of video content across different terminals.
A content management system that generates and displays marks on a second terminal in response to user operations on a first terminal, allowing synchronized access to scene information.
Enables users on different terminals to access and interact with specific scenes of video content through marks, enhancing information accessibility and interaction.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[Technical field]
[0001] One aspect of the present disclosure relates to a content management system, a content management method, a content management program, and a user terminal. [Background technology]
[0002] There is known a technique for recording information about a scene of a video content being displayed. For example, Patent Document 1 describes an information processing system having a terminal that captures video content being played and generates a screenshot in response to a user's instruction. Patent Document 2 describes a server that generates a gift based on a part of a live broadcast recorded during the playback of video data and performs a process for granting the gift to a user who generated the gift during the playback of the video data. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Patent Publication No. 2021-121125 [Patent Document 2] Patent No. 7071718 Summary of the Invention [Problem to be solved by the invention]
[0004] It is desirable to facilitate access to information about specific scenes of video content. [Means for solving the problem]
[0005] A content management system according to an aspect of the present disclosure includes at least one processor that displays video content generated by a first terminal on a second terminal, and in response to a user operation accepted at the first terminal while the video content is being displayed, generates a mark associated with a scene of the video content corresponding to a timing of the user operation, and displays the mark on the second terminal together with the video content.
[0006] In such an aspect, in response to a user operation performed on the first terminal while the video content is being displayed, a mark of a scene corresponding to the operation is displayed on the second terminal. This mark provides information about the scene to the second terminal other than the first terminal that accepted the user operation, thereby helping the user of the second terminal to access the information. Effect of the Invention
[0007] According to one aspect of the present disclosure, it is possible to assist in accessing information regarding a particular scene of video content. [Brief description of the drawings]
[0008] [Figure 1] FIG. 1 illustrates an example of an application of a content management system. [Diagram 2] FIG. 2 is a diagram illustrating an example of a hardware configuration related to a content management system. [Diagram 3] FIG. 2 is a diagram illustrating an example of a functional configuration related to a content management system. [Figure 4] FIG. 11 is a sequence diagram showing an example of an operation of the content management system. [Diagram 5] FIG. 13 is a diagram illustrating an example of mark generation. [Figure 6] FIG. 13 is a diagram showing an example of a marking operation. [Figure 7] FIG. 13 is a diagram showing another example of a mark operation. [Figure 8] FIG. 13 is a diagram showing an example of mark display. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In the description of the drawings, the same or equivalent elements are designated by the same reference numerals, and duplicated descriptions will be omitted.
[0010] [System Overview] The content management system according to the present disclosure is a computer system that manages content to be distributed to users. Content refers to information provided by a computer or computer system and recognizable by humans. Electronic data indicating content is called content data. In one example, the content is video content expressed by video that may include audio. Video content may include video generated by an imaging device such as a camera, may include computer graphics (CG), or may include both. Content can be used for various types of information transmission or communication, and may be used in various situations or purposes such as news, education, medical care, games, chat, business transactions, lectures, seminars, training, concerts, and surveys. Content distribution refers to a process performed to provide content to a user, for example, a process of transmitting information to a user via a communication network.
[0011] The content management system provides video content to a user by transmitting content data indicating the video content to the user terminal. In one example, the video content is provided by a distributor. A distributor is a person who intends to provide information to a viewer through the content management system, and is a sender of the video content. A viewer is a person who intends to obtain information through the content management system, and is a user of the video content. The content management system transmits the content data provided from the distributor terminal to the viewer terminal. The viewer terminal processes the content data and displays the video content on a screen. In the present disclosure, the distributor and the viewer are sometimes collectively referred to as users, and the distributor terminal and the viewer terminal are sometimes collectively referred to as user terminals.
[0012] In one example, the content management system may perform real-time distribution. In this case, for example, the distributor terminal processes the captured video to generate content data and transmits the content data to the content management system in real time. The content management system receives the content data and transmits the content data to the viewer terminal in real time. This is one aspect of live Internet broadcasting. The content data may be generated in the content management system. That is, the content management system may process real-time video provided from the distributor terminal to generate content data and transmit the content data to the viewer terminal in real time. The content management system may be used for time shifting, which allows content to be viewed for a given period of time after real-time distribution.
[0013] The content management system may perform on-demand distribution, allowing viewers to view content at any time. In this case, for example, the content management system may store content data generated by processing previously captured video in a storage device such as a database. The content management system may transmit the stored content data to a viewer terminal in response to a viewer request.
[0014] The content management system displays video content generated by a first terminal on a second terminal. The first terminal is, for example, a distributor terminal, and the second terminal is, for example, a viewer terminal.
[0015] In one example, the content management system generates a mark related to a scene of the video content corresponding to the timing of the event in response to an event acquired in the first terminal while the video content is being displayed. The mark is a sign for visually conveying information related to the scene to the user, and is information independent of the video content. Electronic data indicating the mark is called mark data. The mark may be configured to include at least one of a still image (photograph, illustration, etc.), a moving image (video or animation), an emoji, and a character (text), for example. As one example, the mark may be a screenshot image including at least a part of the scene. The "scene (of the video content) corresponding to the timing of the event" may be, for example, a scene that was being displayed at the time when the event occurred. An event refers to a predetermined phenomenon that occurs in a computer, and functions as a trigger for marking in the content management system. Examples of events include the occurrence of a user operation and the satisfaction of a condition related to a predetermined parameter.
[0016] In one example, the content management system displays the generated mark together with the video content on the second terminal. That is, the content management system displays the generated mark together with the video content. "Displaying the mark together with the video content" refers to a process of displaying both the mark and the video content on the same screen. The mark may be displayed without overlapping with the video content, or may be displayed so that at least a portion of the mark overlaps with the video content.
[0017] Hereinafter, the process of generating and displaying a mark is also referred to as marking. As described above, in one example, the content management system displays the mark on the second terminal in response to a user operation on the first terminal. If the mark is a screenshot image, the screenshot image is displayed on the second terminal other than the first terminal, not on the first terminal that accepted the user operation for marking. Therefore, such marking performed by the content management system is different from conventional screenshot, which is a closed process within a certain terminal.
[0018] The user terminal may display a seek bar indicating the progress of the video content together with the video content. In this case, the content management system may display a mark of a scene corresponding to the timing of an event at a position on the seek bar corresponding to the timing.
[0019] [System configuration] FIG. 1 is a diagram showing an application of a content management system 1 according to an example. In this example, the content management system 1 includes a server 10. The server 10 is a computer that distributes content data. The server 10 is connected to one or more distributor terminals 20 (first terminals) and one or more viewer terminals 30 (second terminals) via a communication network N. The server 10 is also connected to a user database 40 via the communication network N. The communication network N may be configured to include the Internet or an intranet.
[0020] The distributor terminal 20 is a computer used by a distributor. In one example, the distributor terminal 20 has a function of generating video content and a function of accessing the content management system 1 and transmitting content data indicating the video content. The distributor terminal 20 may be a shooting system having functions of shooting, recording, and transmitting video. Alternatively, the distributor terminal 20 may be a portable terminal such as a high-performance mobile phone (smartphone), a tablet terminal, a wearable terminal (e.g., a head-mounted display (HMD), smart glasses, etc.), a laptop personal computer, or a mobile phone. Alternatively, the distributor terminal 20 may be a stationary terminal such as a desktop personal computer.
[0021] The viewer terminal 30 is a computer used by a viewer. In one example, the viewer terminal 30 has a function of accessing the content management system 1 to receive and display content data. The viewer terminal 30 may be a portable terminal such as a high-performance mobile phone (smartphone), a tablet terminal, a wearable terminal (e.g., a head-mounted display (HMD), smart glasses, etc.), a laptop personal computer, or a mobile phone. Alternatively, the viewer terminal 30 may be a stationary terminal such as a desktop personal computer.
[0022] A distributor operates the distributor terminal 20 to log in to the content management system 1, thereby enabling the viewer to provide video content to the viewer. A viewer operates the viewer terminal 30 to log in to the content management system 1, thereby enabling the viewer to view the content. In this disclosure, it is assumed that the viewer and distributor of the content management system 1 are already logged in. Viewers may be omitted from logging in to the content management system 1. In other words, the content management system 1 may transmit content data to the viewer terminal 30 of a general viewer who is not logged in. In this case, general viewers who are not logged in can also view the content.
[0023] The user database 40 is a non-transient storage device that stores user data related to users who use the content management system 1. In one example, each record of the user data includes a user ID that is an identifier that uniquely identifies an individual user, and attribute information that indicates the attributes of the user. The attributes of the user refer to information that indicates the characteristics or nature of the user. For example, the attribute information may include a name, age, sex, one or more content IDs that are identifiers of the content viewed by the user, or the number of times each content has been viewed. The attribute information may include an icon that the user can use. The icon of the user may be created by the user, may be provided to the user by another person as a gift, or may be able to be provided by the user to another person as a gift. The icon as a gift may have a special display mode different from a normal icon, or may have a function of giving a reward such as money to the recipient of the gift. The attribute information may be stored in an area other than the user database 40. For example, the attribute information may be stored in a cookie area of the browser in the viewer terminal 30. The attribute information may include information indicating whether the user is logged in to the content management system 1.
[0024] User database 40 may be constructed as a single database or may be a collection of multiple databases. User database 40 may be a component of content management system 1, or may be provided in a computer system separate from content management system 1.
[0025] Fig. 2 is a diagram showing an example of a hardware configuration related to the content management system 1. Fig. 2 shows a server computer 100 functioning as the server 10, and a terminal computer 200 functioning as the distributor terminal 20 or the viewer terminal 30.
[0026] As an example, the server computer 100 includes a processor 101, a main memory unit 102, an auxiliary memory unit 103, and a communication unit 104 as hardware components. The processor 101 is a computing device that executes an operating system and application programs, and is, for example, a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit). The main memory unit 102 is a device that stores programs to be executed, calculation results, and the like, and is, for example, composed of a ROM (Read Only Memory) or a RAM (Random Access Memory). The auxiliary memory unit 103 is a device that can generally store a larger amount of data than the main memory unit 102, and is, for example, composed of a non-volatile storage medium such as a hard disk or a flash memory. The auxiliary memory unit 103 stores a server program P1 and various data for making the server computer 100 function as the server 10. The communication unit 104 is a device that executes data communication with other computers via a communication network N, and is, for example, composed of a network card or a wireless communication module.
[0027] In this embodiment, the content management program is implemented as a server program P1. Each functional element of the server 10 is realized by loading the server program P1 onto the processor 101 or the main memory unit 102 and having the processor 101 execute the program. The server program P1 includes code for realizing each functional element of the server 10. The processor 101 operates the communication unit 104 in accordance with the server program P1, and executes reading and writing of data in the main memory unit 102 or the auxiliary memory unit 103.
[0028] The server 10 may be composed of one or more computers. When multiple computers are used, these computers are connected to each other via a communication network N to logically configure one server 10.
[0029] As an example, the terminal computer 200 includes a processor 201, a main memory unit 202, an auxiliary memory unit 203, a communication unit 204, an input interface 205, an output interface 206, and an imaging unit 207 as hardware components. The processor 201 is a computing device that executes an operating system and an application program, and is, for example, a CPU or a GPU. The main memory unit 202 is a device that stores a program to be executed, a computation result, and the like, and is, for example, composed of a ROM or a RAM. The auxiliary memory unit 203 is a device that can generally store a larger amount of data than the main memory unit 202, and is, for example, composed of a non-volatile storage medium such as a hard disk or a flash memory. The auxiliary memory unit 203 stores a client program P2 and various data for causing the terminal computer 200 to function as the distributor terminal 20 or the viewer terminal 30. The communication unit 204 is a device that executes data communication with other computers via the communication network N, and is, for example, composed of a network card or a wireless communication module. The input interface 205 is a device that accepts data based on a user's operation or action, and is composed of at least one of a keyboard, an operation button, a pointing device, a touch panel, a microphone, a sensor, and a camera, for example. The output interface 206 is a device that outputs data processed by the terminal computer 200, and is composed of a display device such as a monitor, a touch panel, and an HMD, for example. The imaging unit 207 is a device that captures an image (video or photo) of the real world, and is, for example, a camera. The imaging unit 207 can also function as the input interface 205.
[0030] Each functional element of the distributor terminal 20 or the viewer terminal 30 is realized by loading a corresponding client program P2 into the processor 201 or the main memory unit 202 and having the processor 201 execute the program. The client program P2 includes code for realizing each functional element of the distributor terminal 20 or the viewer terminal 30. The processor 201 operates the communication unit 204, the input interface 205, the output interface 206, or the imaging unit 207 in accordance with the client program P2, and reads and writes data in the main memory unit 202 or the auxiliary memory unit 203.
[0031] At least one of the server program P1 and the client program P2 may be provided in a state of being non-temporarily recorded on a tangible recording medium such as a CD-ROM, a DVD-ROM, a semiconductor memory, etc. Alternatively, at least one of these programs may be provided as a data signal superimposed on a carrier wave via the communication network N. These programs may be provided separately or together.
[0032] 3 is a diagram showing an example of a functional configuration related to the content management system 1. The server 10 includes, as functional elements, a content transfer unit 11 and a mark control unit 12. The content transfer unit 11 is a functional element that receives content data transmitted from the distributor terminal 20 and transmits the content data to the viewer terminal 30. The mark control unit 12 is a functional element that executes marking in the distributor terminal 20 or the viewer terminal 30 in response to an event in the distributor terminal 20 or the viewer terminal 30.
[0033] The distributor terminal 20 includes functional elements including a content generating unit 21, a content display unit 22, a screen control unit 23, a marking request unit 24, and a mark display unit 25. The content generating unit 21 is a functional element that generates video content and transmits content data indicating the video content to the server 10. The content display unit 22 is a functional element that displays the generated video content on the screen of the distributor terminal 20. The screen control unit 23 is a functional element that controls the display of the screen in response to a user operation on a mark. The marking request unit 24 is a functional element that acquires an event related to marking and transmits a marking request to the server 10 to request the generation and display of a mark. The event acquired by the distributor terminal 20 is, for example, a user operation accepted by the distributor terminal 20. The mark display unit 25 is a functional element that receives mark data from the server 10 and displays a mark on the screen based on the mark data.
[0034] The viewer terminal 30 includes functional elements including a content display unit 31, a screen control unit 32, a marking request unit 33, and a mark display unit 34. The content display unit 31 is a functional element that receives content data from the server 10 and displays video content based on the content data. The screen control unit 32 is a functional element that controls the display of the screen in response to a user operation on a mark. The marking request unit 33 is a functional element that obtains an event related to marking and transmits a marking request to the server 10. An event obtained by the viewer terminal 30 is, for example, a user operation accepted by the viewer terminal 30. The mark display unit 34 is a functional element that receives mark data from the server 10 and displays a mark on the screen based on the mark data.
[0035] [System Operation] The operation of the content management system 1 and an example of a content management method will be described with reference to Fig. 4. Fig. 4 is a sequence diagram showing an example of the operation of the content management system 1 as a process flow S1.
[0036] In step S101, the content generating unit 21 of the distributor terminal 20 generates video content. In one example, the content generating unit 21 starts generating video content in response to a user operation by the distributor to start distribution. For example, the content generating unit 21 may generate video content including video captured by the imaging unit 207, or may generate video content based on content material stored in the auxiliary storage unit 203.
[0037] In step S102, the content generation unit 21 transmits content data indicating the video content to the server 10. In one example, the content generation unit 21 continuously transmits content data to the server 10 in response to generation of video content based on shooting of a video. In the server 10, the content transfer unit 11 receives the content data.
[0038] In step S103, the content transfer unit 11 transmits the content data to the viewer terminal 30. As an example, the content transfer unit 11 starts transmitting the content data to the viewer terminal 30 in response to a content request from the viewer terminal 30. The content request is a data signal for requesting the server 10 to play back video content. As an example, the content transfer unit 11 continuously transmits the content data to the viewer terminal 30. In the viewer terminal 30, the content display unit 31 receives the content data transmitted from the content transfer unit 11.
[0039] In step S104, the content display unit 22 of the distributor terminal 20 displays the video content generated by the content generation unit 21 on the screen. If the video content includes audio, the content display unit 22 may output the audio included in the video content from a speaker. The content display unit 22 may also display a seek bar on the screen together with the video content.
[0040] In step S105, the content display unit 31 of the viewer terminal 30 processes the received content data and displays the video content on the screen. If the video content includes audio, the content display unit 31 may output the audio included in the video content from a speaker. The content display unit 31 may also display a seek bar on the screen together with the video content.
[0041] If an event related to marking occurs while video content is being displayed on distributor terminal 20, steps S106 and S107 are executed.
[0042] In step S106, the marking request unit 24 acquires an event related to marking. As an example, the marking request unit 24 acquires a predetermined user operation on the broadcaster terminal 20 by the broadcaster as the event. The user operation may be, for example, a tap or click operation on a predetermined position on the screen, a predetermined command input, or a voice input. The marking request unit 24 may further receive an input for designating the broadcaster terminal 20 as the user terminal on which the mark is to be displayed. This input is performed when the broadcaster wants to display the mark only on his / her own terminal.
[0043] In step S107, the marking request unit 24 transmits a marking request to the server 10. For example, the marking request unit 24 generates a marking request including the time when an event related to marking occurred. Hereinafter, this time is also referred to as the "event time." In addition to the event time, the marking request unit 24 may generate a marking request that further indicates at least one of the user terminal on which the mark is to be displayed and the mark. The marking request unit 24 transmits the generated marking request. In the server 10, the mark control unit 12 receives the marking request.
[0044] If an event relating to marking occurs while video content is being displayed on the viewer terminal 30, steps S108 and S109 are executed.
[0045] In step S108, the marking request unit 33 acquires an event related to marking. As an example, the marking request unit 33 acquires a predetermined user operation on the viewer terminal 30 by the viewer as the event. As with the distributor terminal 20, the user operation may be, for example, a tap or click operation on a predetermined position on the screen, a predetermined command input, or a voice input. The marking request unit 33 may further receive an input for designating the viewer terminal 30 as the user terminal on which the mark is to be displayed. This input is performed when the viewer wants the mark to be displayed only on his / her own terminal.
[0046] In step S109, the marking request unit 33 transmits a marking request to the server 10. For example, the marking request unit 33 generates a marking request including an event time. The marking request unit 33 may generate a marking request that further indicates at least one of the user terminal on which the mark is to be displayed and the mark in addition to the event time. The marking request unit 33 transmits the generated marking request. In the server 10, the mark control unit 12 receives the marking request.
[0047] In step S110, the mark control unit 12 generates mark data based on the marking request received from the distributor terminal 20 or the viewer terminal 30. For example, the mark control unit 12 includes an event time indicated by the marking request, that is, a time when an event related to marking occurred in the distributor terminal 20 or the viewer terminal 30. The mark control unit 12 may generate mark data further including a mark indicated by the marking request. Alternatively, the mark control unit 12 may identify a scene of the video content corresponding to the event time, generate a mark indicating the scene, and generate mark data further including the mark. Alternatively, the mark control unit 12 may refer to the user database 40 to obtain an icon of a user corresponding to the marking request, that is, a user who performed a user operation that is the basis of the marking request, and generate mark data further including the icon as a mark.
[0048] In step S111, the mark control unit 12 transmits the mark data to a user terminal that is to display the mark. If a user terminal that is to display the mark is not specified, the mark control unit 12 may transmit the mark data to the distributor terminal 20 and each viewer terminal 30 that are displaying the video content. If a user terminal is specified, the mark control unit 12 transmits the mark data to that user terminal. In process flow S1, the mark control unit 12 transmits the mark data to the distributor terminal 20 and the viewer terminal 30.
[0049] In step S112, the mark display unit 25 of the distributor terminal 20 displays a mark on the screen based on the mark data received from the server 10. In one example, the mark display unit 25 identifies a position on the seek bar corresponding to the event time indicated by the mark data, for example a position on the seek bar corresponding to the timing of a user operation, and displays a mark at that position. If the mark data includes a mark, the mark display unit 25 displays the mark. If the mark data does not include a mark, the mark display unit 25 may identify a scene of the video content corresponding to the event time, generate a mark indicating the scene, and display the mark.
[0050] In step S113, the mark display unit 34 of the viewer terminal 30 displays a mark on the screen based on the mark data received from the server 10. The mark display unit 34 displays the mark in the same manner as the distributor terminal 20. The mark display unit 34 may display the mark at a position on the seek bar corresponding to the event time indicated by the mark data. The mark display unit 34 may display the mark included in the mark data, or may identify a scene of the video content corresponding to the event time and display a mark indicating that scene.
[0051] In step S114, the screen control unit 23 controls the display of the screen in response to a user operation on the mark. The user operation may be, for example, a tap or click operation on the mark displayed on the screen of the distributor terminal 20. As an example, the screen control unit 23 may play back the video content from a scene corresponding to the operated mark. Alternatively, the screen control unit 23 may enlarge and display the operated mark.
[0052] In step S115, the screen control unit 32 controls the display of the screen in response to a user operation on the mark. The user operation may be, for example, a tap or click operation on the mark displayed on the screen of the viewer terminal 30. As with the distributor terminal 20, the screen control unit 32 may play back the video content from a scene corresponding to the operated mark, or may enlarge and display the operated mark.
[0053] In process flow S1, the server 10 transmits various data such as content data and mark data to a target terminal (distributor terminal 20 or viewer terminal 30) and causes the target terminal to control the display of video content and marks. Such control of the target terminal by the server 10 is an example of the server 10 (content management system 1) displaying video content and marks on the target terminal.
[0054] [Mark control example] Various examples of mark control will be described with reference to Figures 5 to 8. Figure 5 is a diagram showing an example of mark generation and display on the distributor side, and Figures 6 to 8 are diagrams showing examples of screen control by mark display and operation on the viewer side. Figure 5 shows a smartphone used as the distributor terminal 20, and Figures 6 to 8 show a laptop personal computer as the viewer terminal 30, but it should be noted that the examples shown in these figures can be similarly executed by replacing each other.
[0055] 5, distributor terminal 20 displays screen 300 including content area 301 displaying video content 310, seek bar 320 indicating the progress of video content 310, and comment list 330 displaying comments posted by users while video content 310 is being displayed. Seek bar 320 and comment list 330 are displayed superimposed on content area 301.
[0056] A comment is information input by a user and independent of video content. The content management system 1 (server 10) displays the comment input at the distributor terminal 20 (first terminal) or the viewer terminal 30 (second terminal) while the video content 310 is being displayed, together with the video content 310, on at least one of the distributor terminal 20 and the viewer terminal 30.
[0057] In this example, the content area 301 displays a live broadcast of a family's daily life as video content 310. On the seek bar 320, marks 341, 342, and 343 related to scenes of the video content 310, a scroller 321 indicating the current playback position of the video content 310, and a camera icon 322 are displayed. The marks are screenshot images, and include at least a part of the scene of the video content 310 corresponding to the timing of the user operation to generate the mark. On the seek bar 320, each mark is displayed at a position corresponding to the timing. In the comment list 330, the posted comments are arranged in chronological order, and are displayed so as to flow from bottom to top as new comments are posted. The video content 310, the seek bar 320, and the comment list 330 are also distributed to one or more viewer terminals 30, and therefore the distributor and the viewer share this information simultaneously or almost simultaneously.
[0058] In this example, it is assumed that the distributor performs a user operation to generate a new mark 344. The user operation may be, for example, a tap or click on the camera icon 322 displayed on the screen 300. The marking request unit 24 of the distributor terminal 20 accepts the user operation (step S106). Then, the marking request unit 24 generates a marking request including the time of the user operation, and transmits the marking request to the server 10 (step S107). In the server 10, the mark control unit 12 generates mark data based on the marking request, and transmits the mark data to the distributor terminal 20 and the viewer terminal 30 (steps S110 and S111). In the distributor terminal 20, the mark display unit 25 displays the mark 344 on the screen 300 based on the mark data (step S112). The mark display unit 25 displays the mark 344 at a position on the seek bar 320 corresponding to the timing of the user operation, using a method similar to that of the marks 341 to 343. In the example of FIG. 5, the mark 344 is a screenshot image including at least a part of a scene of the video content 310 corresponding to the timing at which the user operation was performed.
[0059] Fig. 6 shows an example of screen control in response to a viewer's operation on a mark. In this example, the viewer terminal 30 displays a screen 400 similar to the screen 300 of the distributor terminal 20 in the example of Fig. 5. The screen 400 further includes a pointer 303 that can be operated by a pointing device such as a mouse.
[0060] In the example of FIG. 6, assume that the viewer places the pointer 303 on the mark 342 and taps or clicks. The screen control unit 32 of the viewer terminal 30 accepts the user operation and controls the screen 400 (step S115). That is, the screen control unit 32 displays the scene of the video content 310 related to the mark 342 in the content area 301, and plays the video content 310 from that scene. The screen control unit 32 also moves the scroller 321 to the position of the mark 342. The screen control unit 32 may change the comments in the comment list 330 in conjunction with the scene of the video content 310. That is, the screen control unit 32 may display the comment list 330 in accordance with the scene in the content area 301.
[0061] FIG. 7 shows another example of screen control in response to a viewer's operation on a mark. In this example, the viewer terminal 30 also displays a screen 400 similar to the screen 300 of the distributor terminal 20 in the example of FIG. 5. In this example, it is assumed that the viewer places the pointer 303 on the mark 341. The screen control unit 32 of the viewer terminal 30 accepts the user's operation and controls the screen 400 (step S115). As an example, the screen control unit 32 enlarges and displays the mark 341 (mark 341'). As a further example, the screen control unit 32 displays a comment 331 corresponding to a scene related to the mark 341 together with the mark 341'. The comment 331 corresponds to, for example, a scene of the video content 310 at the time the mark 341 is generated. The comment 331 may be a comment that was actually displayed on the viewer terminal 30 together with the video content 310 when the mark 341 was generated. Alternatively, the comment 331 may be a comment that would have been displayed if the video content 310 had been displayed on the viewer terminal 30 when the mark 341 was generated. Therefore, even if the viewer watches the video content 310 from a point after the scene related to the mark 341 , the viewer can operate the mark 341 to check the comment 331 .
[0062] In the example of Fig. 7, the screen control unit 32 may display multiple comments together with the mark. For example, the screen control unit 32 may display the multiple comments simultaneously or sequentially. Alternatively, the screen control unit 32 may display, among the multiple comments, comments with reactions such as "Like" in preference to other comments.
[0063] In the examples shown in Figs. 5 to 7, the marks are displayed on the seek bar 320, but the marks may be displayed in a place other than the seek bar. Fig. 8 is a diagram showing an example of mark display. A screen 400A on the viewer terminal 30 shown in this figure can be said to be a modification of the screen 400 shown in Figs. 6 and 7. The screen 400A includes a mark area 323 for displaying one or more marks such as marks 341 to 344 instead of the seek bar 320, and a seek bar 324 independent of the mark area 323. The mark area 323 does not have a role of indicating the progress of the video content 310, and this role is taken on by the seek bar 324. The seek bar 324 includes a scroller 325 that indicates the current playback position of the video content 310.
[0064] The display positions of the marks 341 to 344 do not need to indicate the timing at which the marks were generated. In the example of Fig. 8, the mark display unit 34 displays the marks 341 to 344 on the mark area 323 in the order in which the marks were generated.
[0065] The content management system 1 may display the mark at a different position, without being limited to the examples in Figures 5 to 8. For example, the mark control unit 12 may display the mark at a position designated by a user operation such as drag and drop.
[0066] [User device] A user terminal according to an aspect of the present disclosure is a user terminal that is connected to other terminals via a communication network and includes at least one processor. The at least one processor displays video content on a screen, and displays a mark generated in response to a user operation received at the other terminal while the video content is being displayed, the mark being related to a scene of the video content corresponding to the timing of the user operation, together with the video content, on the screen. That is, the user terminal according to an aspect of the present disclosure includes a user terminal that can access the above-mentioned content management system. In this case, the user terminal and the other terminal may be either a first terminal (distributor terminal 20) or a second terminal (viewer terminal 30).
[0067] A user terminal according to one aspect of the present disclosure includes a user terminal manufactured to be capable of the above-mentioned operations, a user terminal having a program installed that enables the above-mentioned operations, or a user terminal to which hardware that enables the above-mentioned operations is connected.
[0068] [Variations] Various examples of the present disclosure have been described in detail above. However, the present disclosure is not limited to the above examples. Various modifications of the present disclosure are possible without departing from the spirit of the present disclosure.
[0069] The mark control unit 12 may dynamically control the mark in response to another preset event without accepting a user operation, i.e., without accepting a marking request from a user terminal. For example, the mark control unit 12 may generate a mark related to a predetermined scene in video content in response to the arrival of the scene, and display the mark on the user terminal together with the video content. The mark control unit 12 may measure the number of comments per unit time (i.e., frequency) inputted at the user terminal while the video content is being displayed, generate a mark related to a scene of the video content corresponding to the timing when the frequency of the comments reaches a predetermined threshold, and display the mark on the user terminal together with the video content. The mark control unit 12 may generate a mark related to a scene of the video content corresponding to the timing when a predetermined comment (e.g., a comment including a predetermined phrase) or a gift is sent or received between user terminals, and display the mark on the user terminal together with the video content. In such dynamic control of marks, the mark control unit 12 may display the mark on at least one of the distributor terminal 20 and the viewer terminal 30.
[0070] In the above example, the content management system 1 includes the server 10, but the content management system may be applied to content distribution between user terminals without using a server. In this case, each functional element of the server 10 may be implemented in one of the user terminals, or may be implemented separately in multiple user terminals. In this regard, the content management program may be realized as a client program. The content management system may be configured using a server, or may be configured without using a server. That is, the content management system may be implemented by a client-server system, or may be implemented by P2P (Peer to Peer) or E2E (End to End) encryption, which is a client-client system. The client-client system improves the confidentiality of content distribution.
[0071] When the display mode of the video content changes on the distributor terminal 20 or the viewer terminal 30, the mark display unit 25 or 34 may automatically change the display position of the mark so as to maintain the positional relationship between the video content and the mark. Examples of changes in the display mode of the video content include switching between full-screen display and reduced-size display, and changes in the video content that accompany changes in the screen orientation between portrait and landscape. Alternatively, when the display mode of the video content changes, the mark display unit 25 or 34 may move the mark to an empty area on the screen.
[0072] In the above examples, the distributor terminal 20 and the viewer terminal 30 are shown as user terminals, but other types of user terminals may have the same functional elements as the distributor terminal 20 or the viewer terminal 30. For example, a moderator terminal, which is a computer used by a moderator who manages video content, may have the functional elements.
[0073] In this disclosure, the expression "at least one processor executes a first process, executes a second process, ... executes an nth process" or a corresponding expression indicates a concept including a case where the executing entity (i.e., the processor) of n processes from the first process to the nth process changes midway. In other words, this expression indicates a concept including both a case where all n processes are executed by the same processor and a case where the processor changes among the n processes according to an arbitrary policy.
[0074] The processing procedure of the method executed by at least one processor is not limited to the example in the above embodiment. For example, some of the above steps may be omitted, or each step may be executed in a different order. In addition, any two or more of the above steps may be combined, or some of the steps may be modified or deleted. Alternatively, other steps may be executed in addition to the above steps.
[0075] In comparing the magnitude of two numerical values, either of the two criteria "greater than or equal to" or "greater than" may be used, or either of the two criteria "less than or equal to" or "less than".
[0076] Any part or all of the functional elements described in this specification may be realized by a program. The programs mentioned in this specification may be distributed in a non-temporary manner recorded on a computer-readable recording medium, distributed via a communication line (including wireless communication) such as the Internet, or distributed in a state in which they are installed on any terminal.
[0077] Based on the above description, a person skilled in the art may be able to conceive additional effects or various modifications of the present disclosure, but the aspects of the present disclosure are not limited to the individual embodiments described above. Various additions, modifications, and partial deletions are possible within the scope of the conceptual idea and intent of the present disclosure derived from the contents defined in the claims and their equivalents.
[0078] For example, a configuration described in this specification as one device (or component; the same applies below) (including a configuration depicted as one device in the drawings) may be realized by multiple devices. Alternatively, a configuration described in this specification as multiple devices (including a configuration depicted as multiple devices in the drawings) may be realized by one device. Alternatively, some or all of the means or functions included in a certain device (e.g., a server) may be included in another device (e.g., a user terminal).
[0079] Not all of the features described in this specification are essential. For example, features that are described in this specification but not in the claims may be considered optional additional features.
[0080] The applicant is merely aware of the known technology described in the "Prior Art Documents" column of this specification. It should also be noted that this disclosure is not necessarily intended to solve the problems in the known technology. The problems to be solved in this disclosure should be identified by taking into consideration the entire specification. For example, if there is a description in this specification that a specific configuration produces a certain effect, it can also be said that the problem corresponding to the certain effect is solved. However, the description of the effect does not necessarily intend that such a specific configuration is an essential requirement.
[0081] [Note] As can be seen from the various examples above, the present disclosure includes the following aspects. (Appendix 1) At least one processor; the at least one processor: Displaying the video content generated by the first terminal on the second terminal; In response to a user operation received at the first terminal while the video content is being displayed, a mark is generated that is associated with a scene of the video content that corresponds to a timing of the user operation; displaying the mark together with the video content on the second terminal; Content management system. (Appendix 2) the at least one processor: In response to a user operation on the mark displayed on the second terminal, playing back the video content from the scene related to the mark on the second terminal. 2. A content management system as described in claim 1. (Appendix 3) the at least one processor: displaying, on the second terminal, a comment inputted on the first terminal or the second terminal while the video content is being displayed, together with the video content; In response to a user operation on the mark displayed on the second terminal, the comment corresponding to the scene related to the mark is displayed on the second terminal. 3. A content management system according to claim 1 or 2. (Appendix 4) the at least one processor: displaying a seek bar indicating a progress of the video content on the second terminal; displaying the mark at a position on the seek bar corresponding to the timing of the user operation; 4. A content management system according to any one of claims 1 to 3. (Appendix 5) the at least one processor generates, as the mark, a screenshot image including at least a portion of the scene corresponding to the timing of the user operation; 5. A content management system according to any one of claims 1 to 4. (Appendix 6) the at least one processor: generating a different mark associated with a different scene of the video content corresponding to a preset timing; displaying the separate mark together with the video content on the second terminal; 6. A content management system according to any one of appendices 1 to 5. (Appendix 7) the at least one processor: displaying, on the second terminal, a comment inputted on the first terminal or the second terminal while the video content is being displayed, together with the video content; generating a separate mark associated with a scene of the video content corresponding to a timing when the frequency of the comment reaches a predetermined threshold; displaying the separate mark together with the video content on the second terminal; 7. A content management system according to any one of appendixes 1 to 6. (Appendix 8) 1. A content management method performed by a content management system having at least one processor, comprising: Displaying the video content generated by the first terminal on a second terminal; generating, in response to a user operation received at the first terminal while the video content is being displayed, a mark associated with a scene of the video content corresponding to a timing of the user operation; displaying the mark together with the video content on the second terminal; Content management methods, including: (Appendix 9) Displaying the video content generated by the first terminal on a second terminal; generating, in response to a user operation received at the first terminal while the video content is being displayed, a mark associated with a scene of the video content corresponding to a timing of the user operation; displaying the mark together with the video content on the second terminal; A content management program that causes a computer to execute the above. (Appendix 10) A user terminal that connects to other terminals via a communication network, At least one processor; the at least one processor: Display video content on the screen a mark generated in response to a user operation received at the other terminal while the video content is being displayed, the mark being related to a scene of the video content corresponding to a timing of the user operation, and the mark being displayed on the screen together with the video content; User terminal.
[0082] According to Supplementary Notes 1, 8, and 9, in response to a user operation performed on a first terminal while video content is being displayed, a mark of a scene corresponding to the operation is displayed on a second terminal. This mark provides information about the scene to a second terminal other than the first terminal that accepted the user operation, thereby helping the user of the second terminal to access the information.
[0083] According to Supplementary Note 10, in response to a user operation performed on another terminal while video content is being displayed, a mark of a scene corresponding to the operation is displayed on the user terminal. This mark provides information about the scene on a user terminal other than the other terminal that accepted the user operation, thereby helping the user of the user terminal to access the information.
[0084] According to Supplementary Note 2, in response to a user operation on a displayed mark, video content is played back from a scene related to the mark. This mechanism improves access to a particular scene and allows video content to be provided again from that scene.
[0085] According to Supplementary Note 3, a comment that was displayed in a scene related to a mark is displayed in response to a user operation on the mark. This mechanism makes it possible to provide a topic of conversation in the scene.
[0086] According to Supplementary Note 4, a mark is displayed on the seek bar that indicates the progress of the video content at a position corresponding to the timing of the user's operation. This mechanism makes it possible to clearly indicate the position of a specific scene in the video content. As a result, access to information about a specific scene in the video content is further improved.
[0087] According to Supplementary Note 5, a screenshot image showing a scene of video content is displayed as a mark, so that information about the scene can be provided in a visually easy-to-understand manner.
[0088] According to Supplementary Note 6, a mark related to a scene corresponding to a preset timing is automatically displayed. This mechanism makes it possible to display the mark without requiring user operation.
[0089] According to Supplementary Note 7, when the frequency of comments reaches a certain threshold, a mark related to the scene is automatically displayed. This mechanism improves access to information about scenes that are likely to be popular in video content. [Explanation of symbols]
[0090] 1...content management system, 10...server, 11...content transfer unit, 12...mark control unit, 20...distributor terminal, 21...content generation unit, 22...content display unit, 23...screen control unit, 24...marking request unit, 25...mark display unit, 30...viewer terminal, 31...content display unit, 32...screen control unit, 33...marking request unit, 34...mark display unit, 40...user database, 300, 400, 400A...screen, 301...content area, 310...video content, 320, 324...seek bar, 321, 325...scroller, 322...camera icon, 323...mark area, 330...comment list, 341-344...mark, P1...server program, P2...client program.
Claims
1. at least one processor; the at least one processor: Displaying the video content generated by the distributor terminal on the viewer terminal, In response to a user operation by a viewer that is accepted at the viewer terminal while the video content is being displayed, a mark related to a scene of the video content that corresponds to the timing of the user operation by the viewer is generated; displaying the mark together with the video content on the viewer terminal; Content management system.
2. the at least one processor: In response to a user operation by the viewer on the mark displayed on the viewer terminal, the video content is reproduced on the viewer terminal from the scene related to the mark. The content management system of claim 1 .
3. the at least one processor: a comment input at the distributor terminal or the viewer terminal while the video content is being displayed is displayed on the viewer terminal together with the video content; In response to a user operation by the viewer on the mark displayed on the viewer terminal, the comment corresponding to the scene related to the mark is displayed on the viewer terminal.
3. The content management system according to claim 1 or 2.
4. the at least one processor: displaying a seek bar indicating the progress of the video content on the viewer terminal; displaying the mark at a position on the seek bar corresponding to the timing of the user operation by the viewer; 3. The content management system according to claim 1 or 2.
5. the at least one processor generates, as the mark, a screenshot image including at least a portion of the scene corresponding to the timing of the user operation by the viewer; 3. The content management system according to claim 1 or 2.
6. the at least one processor: generating a different mark associated with a different scene of the video content corresponding to a preset timing; displaying the separate mark together with the video content on the viewer terminal; 3. The content management system according to claim 1 or 2.
7. the at least one processor: a comment input at the distributor terminal or the viewer terminal while the video content is being displayed is displayed on the viewer terminal together with the video content; generating a separate mark associated with a scene of the video content corresponding to the timing when the frequency of the comment reaches a predetermined threshold; displaying the separate mark together with the video content on the viewer terminal; 3. The content management system according to claim 1 or 2.
8. 1. A content management method performed by a content management system comprising at least one processor, comprising: displaying the video content generated by the distributor terminal on the viewer terminal; generating a mark related to a scene of the video content corresponding to a timing of a user operation by the viewer, the user operation being received at the viewer terminal while the video content is being displayed; displaying the mark together with the video content on the viewer terminal; Content management methods, including:
9. displaying the video content generated by the distributor terminal on the viewer terminal; generating a mark related to a scene of the video content corresponding to a timing of a user operation by the viewer, the user operation being received at the viewer terminal while the video content is being displayed; displaying the mark together with the video content on the viewer terminal; A content management program that causes a computer to execute the above.
10. A viewer's user terminal that connects to the distributor terminal via a server, at least one processor; the at least one processor: Displaying the video content generated by the distributor terminal on a screen; accepting a user operation by the viewer while the video content is being displayed; a mark generated by the server in response to a user operation by the viewer, the mark being related to a scene of the video content corresponding to the timing of the user operation by the viewer, and the mark being displayed on the screen together with the video content; User terminal.