Video comment sharing system
The video comment sharing system addresses miscommunication in video editing by incorporating drawing-based instructions synchronized with video playback, enhancing editing efficiency and accuracy.
Patent Information
- Application Number
- JP2025140377
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2025-08-26
- Publication Date
- 2025-10-27
- Estimated Expiration
- 2045-08-26
AI Technical Summary
Current video editing systems face miscommunication issues due to the reliance on textual instructions, which are inefficient and difficult to accurately convey specific editing instructions, especially for identifying and correcting video elements in text.
A video comment sharing system that allows for both textual and drawing-based instructions, enabling synchronized overlay of comments and drawing information on the video playback timeline, with permission control and storage for collaborative editing.
Enhances video editing efficiency by providing intuitive and accurate editing instructions, reducing miscommunication and enabling seamless collaboration among editors.
Smart Images

Figure 0007760209000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to a video comment sharing system. [Background technology]
[0002] Software and systems for editing videos have been around for some time. The person instructing the video editing (hereafter referred to as the video editing instructor or editing instructor) and the person actually editing the video (hereafter referred to as the video editing performer or editing performer) communicate textual instructions and explanations regarding the editing content. For example, a YouTuber may shoot a video and request external editing. Many YouTubers hire external editors to make their videos more appealing. The current common method is as follows: (1) Providing the material: The YouTuber transfers the filmed footage to the editor via cloud storage or a file sharing service. The editor begins editing based on the provided material. (2) Sharing the editing content: The YouTuber shares specific requests with the editor. This includes the placement of subtitles, selection of background music, timing of cuts, and color adjustments. (3) Editing: The editor edits based on the instructions. If necessary, advanced effects and animations may be added. (4) Reviewing the first draft: The editor sends the completed first draft of the video to the YouTuber, who reviews the corrections. (5) Completion and Delivery: Once the revisions are complete, we will deliver the final version. If necessary, we will provide the data in a format optimized for YouTube (registered trademark; the same applies hereinafter).
[0003] Currently, there are many options to choose from, ranging from freelancers and crowdsourcing services to professional editing agencies, depending on the cost and service content. While outsourcing video editing can produce a professional finish, it can also lead to issues such as inconsistencies in the finished product due to ambiguous instructions. To prevent this, it is recommended to provide specific instructions and reference videos. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Patent Publication No. 2023-73184 Summary of the Invention [Problem to be solved by the invention]
[0005] In the current video editing system described above, when YouTubers give editing instructions to editors, they typically communicate the subject matter depicted in the video in text, but this is not always easy. This is because not all video descriptions can necessarily be expressed in text. Even if the video description could be expressed in text, it often requires a lot of text, which can reduce the efficiency of the person giving the instructions. For example, "Please remove the person appearing in the background at 12:34:56:10." However, there are cases where the video editor is unable to accurately understand the text information from the video editor and edit the video accordingly. In the above example, the specific location of the "person appearing in the background at 12:34:56:10" is not provided, which requires the video editor to go through the trouble of searching for the person to be deleted. Also, if there are multiple people appearing at the same time, the video editor is unable to determine whether to delete all of the people or only specific ones. Furthermore, for example, if you want to make a correction to a specific point area in a space depicted in a video, it will be difficult to accurately identify the position in text unless there is a mark or something that characterizes that point, and unless coordinate axes or the like are attached to the video surface.
[0006] Therefore, the present invention provides a video comment sharing system for video editing that eliminates the miscommunication between the video editing instructor and the video editing performer as described above, and in which the instructions from the video editing instructor include not only text information but also drawing information, making the video editing intuitive and easy to understand. [Means for solving the problem]
[0007] The present invention provides a video comment sharing system having the following configuration, comprising a video acquisition unit that acquires a video, a comment storage unit that stores comments in association with the playback timing of the acquired video, a drawing information storage unit that stores drawing information, which is information for overlaying the video screen of the acquired video, in synchronization with the playback timing of the video to be overlaid, a permission unit that grants permission to one or more of viewing the acquired video, recording and viewing comments synchronized with the acquired video, drawing information to be overlaid in synchronization with the playback timing of the acquired video screen, and viewing of drawing information overlaid on the acquired video, a permission control information storage unit that holds permission control information for controlling permission, a comment recording unit that records comments in the comment storage unit when permission is given by the permission unit, a drawing unit that records drawing information into the video in the drawing information storage unit when permission is given by the permission unit, a video viewing unit that views the video that has been processed using the drawing information when permission is given by the permission unit, and a comment viewing unit that views the recorded comments when permission is given by the permission unit.
[0008] As a first invention, we provide a video comment sharing system having a video acquisition unit that acquires a video, a comment storage unit that stores comments in association with the playback timing of the acquired video, a drawing information storage unit that stores drawing information, which is information for overlaying the video screen of the acquired video, in synchronization with the playback timing of the video to be overlaid, a permission unit that grants permission to one or more of viewing the acquired video, recording and viewing comments in synchronization with the acquired video, drawing information to be overlaid in synchronization with the playback timing of the acquired video screen, and viewing of the drawing information overlaid on the acquired video, a permission control information storage unit that holds permission control information for controlling the permission, a comment recording unit that records comments in the comment storage unit when permission is given by the permission unit, a drawing unit that records drawing information into the video in the drawing information storage unit when permission is given by the permission unit, a video viewing unit that views the video that has been processed using the drawing information when permission is given by the permission unit, and a comment viewing unit that views the recorded comments when permission is given by the permission unit.
[0009] As a second invention, based on the first invention, there is provided a video comment sharing system in which a video acquisition unit acquires videos from a video sharing site on the Internet.
[0010] As a third invention, based on the first or second invention, there is provided a video comment sharing system in which the permission control information includes at least user identification information.
[0011] As a fourth invention, based on the second invention, a video comment sharing system is provided in which a processing start icon that accepts the start of processing by the comment recording unit and / or drawing unit is displayed as an add-on in the same window as the video playback screen of a video sharing site on the Internet.
[0012] As a fifth invention, based on the first or second invention, a video comment sharing system is provided which has check boxes, comment entry boxes, and emotional expression icon addition boxes that can be used by viewers when there is drawing information, comments, and / or drawing information and / or comments, associated with the timing of video playback.
[0013] As a sixth invention, there is provided a method for operating a video comment sharing system, which is a calculation method having a video acquisition step of acquiring a video, a comment storage step of storing comments in association with the playback timing of the acquired video in synchronization with the playback timing of the video to be superimposed, a drawing information storage step of storing drawing information, which is information for superimposing the acquired video on the video screen, in synchronization with the playback timing of the video to be superimposed, a permission step for granting permission to one or more of viewing the acquired video, recording and viewing comments synchronized with the acquired video, drawing information to be superimposed in synchronization with the playback timing of the acquired video screen, and viewing of the drawing information superimposed on the acquired video, a permission control information storage step of storing permission control information for controlling the permission, a comment recording step for recording a comment in the comment storage step if permission is granted by the permission unit, a drawing step for recording drawing information into the video in the drawing information storage step if permission is granted in the permission step, a video viewing step for viewing the video that has been processed using the drawing information if permission is granted in the permission step, and a comment viewing step for viewing the recorded comments if permission is granted in the permission step.
[0014] As a seventh invention, based on the sixth invention, there is provided a method for operating a video comment sharing system, in which the video acquisition step acquires videos from a video sharing site on the Internet.
[0015] As an eighth invention, based on the sixth or seventh invention, there is provided an operation method of a video comment sharing system, in which the permission control information includes at least user identification information.
[0016] As a ninth invention, based on the seventh invention, there is provided an operating method of a video comment sharing system in which a processing start icon that accepts the start of processing of the comment recording step or / and the drawing step is displayed as an add-on in the same window as the video playback screen of a video sharing site on the Internet.
[0017] As a tenth invention, based on the sixth or seventh invention, we provide an operating method of a video comment sharing system that has check boxes, comment entry boxes, and emotional expression icon addition boxes that can be used by viewers when there is drawing information, comments, or drawing information and / or comments, associated with the timing of video playback.
[0018] As an eleventh invention, we provide an operating program that can be read and executed by a video comment sharing system that is a computer having a video acquisition step of acquiring a video, a comment storage step of storing comments in association with the playback timing of the acquired video in synchronization with the playback timing of the video to be superimposed, a drawing information storage step of storing drawing information that is information for superimposing the acquired video on the video screen in synchronization with the playback timing of the video to be superimposed, a permission step for granting permission to one or more of viewing the acquired video, recording and viewing comments synchronized with the acquired video, drawing information to be superimposed in synchronization with the playback timing of the acquired video screen, and viewing of the drawing information superimposed on the acquired video, a permission control information storage step of storing permission control information for controlling the permission, a comment recording step for recording a comment in the comment storage step if permission is granted by the permission unit, a drawing step for recording drawing information into the video in the drawing information storage step if permission is granted by the permission step, a video viewing step for viewing the video that has been processed using the drawing information if permission is granted by the permission step, and a comment viewing step for viewing the recorded comments if permission is granted by the permission step.
[0019] As a twelfth invention, based on the eleventh invention, the video acquisition step provides an operating program that can be read and executed by a video comment sharing system, which is a computer that acquires videos from a video sharing site on the Internet.
[0020] As a thirteenth invention, based on the eleventh or twelfth invention, the permission control information provides an operating program that can be read and executed by a video comment sharing system that is a computer that includes at least user identification information.
[0021] As a fourteenth invention, based on the twelfth invention, a processing start icon that accepts the start of processing of the comment recording step or / and the drawing step provides an operating program that can be read and executed by a video comment sharing system, which is a computer that is displayed as an add-on in the same window as the video playback screen of a video sharing site on the Internet.
[0022] As a fifteenth invention, based on the eleventh or twelfth invention, an operating program is provided that can be read and executed by a video comment sharing system, which is a computer that has checkboxes, comment entry boxes, and emotional expression icon addition boxes that can be used by viewers when drawing information, comments, and / or comments are "present" in association with the timing of video playback. [Effects of the Invention]
[0023] The invention according to this embodiment eliminates miscommunication between the video editing instructor and the video editing implementer, and enables intuitive, easy-to-understand, and efficient video editing work. [Brief explanation of the drawings]
[0024] [Figure 1] A conceptual diagram showing an example of a video comment sharing system according to the present invention. [Figure 2] FIG. 1 is a conceptual diagram showing an example of a network configuration of a video comment sharing system according to the present invention. [Figure 3] FIG. 1 is a functional block diagram illustrating an example of functions of a video comment sharing system according to a first embodiment. [Figure 4] FIG. 1 is a conceptual diagram illustrating an example of a screen of a video comment sharing system according to a first embodiment; [Figure 5]FIG. 1 is a conceptual diagram illustrating an example of an overall image of processing in a video comment sharing system according to a first embodiment; [Figure 6] FIG. 10 is a conceptual diagram illustrating an example of a screen in an add-on OFF state of the video comment sharing system according to the first embodiment; [Figure 7] FIG. 1 is a conceptual diagram illustrating an example of a superimposition process in a video comment sharing system according to a first embodiment; [Figure 8] FIG. 1 is a conceptual diagram showing an example of a tool window screen of the video comment sharing system according to the first embodiment; [Figure 9] FIG. 1 is a conceptual diagram showing an example of a comment input window screen of the video comment sharing system according to the first embodiment; [Figure 10] FIG. 10 is a conceptual diagram showing an example of team management on a setting screen of the video comment sharing system according to the first embodiment; [Figure 11] FIG. 10 is a conceptual diagram showing an example of a screen for setting the video comment sharing system according to the first embodiment; [Figure 12] FIG. 10 is a conceptual diagram showing an example of a comment history screen of the video comment sharing system according to the first embodiment; [Figure 13] FIG. 1 is a conceptual diagram showing an example of a video list screen of the video comment sharing system according to the first embodiment; [Figure 14] FIG. 10 is a conceptual diagram showing an example of a user setting screen of the video comment sharing system according to the first embodiment; [Figure 15] FIG. 1 is a diagram illustrating an example of a hardware configuration of a video comment sharing system according to a first embodiment. [Figure 16] FIG. 1 is a flowchart showing an example of a data processing flow of a video comment sharing system according to a first embodiment. [Figure 17] FIG. 1 is a diagram showing an example of a hardware configuration of a video comment sharing system according to the present invention.
[0025] <Hardware that constitutes the video comment sharing system that is the present invention> FIG. 17 is a diagram showing a hardware configuration applied to the present invention. While the present invention principally utilizes a computer, it can also be realized by software, hardware, or a combination of software and hardware. The hardware that realizes all or part of the components of the present invention comprises the basic components of a computer, such as a CPU, memory, bus, input / output devices, various peripherals, and a user interface. These peripherals include storage devices, Internet interfaces, Internet devices, displays, keyboards, mice, speakers, cameras, videos, televisions, and various sensors. The present system does not necessarily have to be comprised of a single housing; it can also be comprised of multiple housings connected via communication. Communication may be via LAN, WAN, Wi-Fi, Bluetooth (registered trademark), infrared communication, or ultrasonic communication, and some of the systems may be installed across borders. Furthermore, the multiple housings may be operated by different entities, or by a single entity. The system of the present invention may be operated by a single or multiple entities. The invention may also be comprised of a system that includes the present system, a terminal used by a third party, and a terminal used by yet another third party. These terminals may also be installed across borders. Furthermore, in addition to this system and the terminals, devices used to register related information of third parties and related persons, and devices used for databases to record the contents of registration may also be provided. These may be provided in this system, or may be provided outside the system and configured to make this information available.
[0026] As shown in this diagram, the computer is configured on a motherboard and comprises a chipset, CPU, non-volatile memory, main memory, various buses, BIOS, various interfaces such as USB, HDMI (registered trademark), and LAN, a real-time clock, etc. These operate in cooperation with an operating system, device drivers (for various interfaces such as USB and HDMI (registered trademark), and various built-in devices such as cameras, microphones, speakers or headphones, and displays), various programs, etc. The various programs and data that make up the present invention are configured to efficiently utilize these hardware resources to execute various processes.
[0027] Chipset A "chipset" is a set of large-scale integrated circuits (LSI) mounted on a computer's motherboard that integrates a communication function, or bridge function, between the CPU's external bus and the standard bus that connects memory and peripheral devices. Two chipset configurations are used, or one chipset configuration. The northbridge is located on the side closest to the CPU and main memory, and the southbridge is located on the side farther away, which interfaces with relatively slow external I / O.
[0028] (Northbridge) The northbridge includes a CPU interface, memory controller, and graphics interface. Most of the functions of a conventional northbridge can be performed by the CPU. The northbridge connects to the main memory slot via a memory bus, and to the graphics card slot via a high-speed graphics bus (AGP, PCI Express).
[0029] (Southbridge) The southbridge connects to the PCI interface (PCI slot) via the PCI bus and handles I / O functions such as ATA (SATA), USB, and Ethernet interfaces, as well as sound functions. Incorporating circuits to support features such as PS / 2 ports, floppy disk drives, serial ports, parallel ports, and ISA buses, which do not require or are not capable of high-speed operation, would hinder the speed of the chipset itself, so these can be separated from the southbridge chip and placed in a separate LSI called a super I / O chip. Buses are used to connect the CPU (MPU) to peripheral devices and various control units. Buses are connected by the chipset. The memory bus used to connect to main memory may instead use a channel structure for increased speed. A serial bus or a parallel bus can be used as the bus. While a serial bus transfers data one bit at a time, a parallel bus transmits the original data or multiple bits extracted from the original data as a single block over multiple communication paths simultaneously. A dedicated line for the clock signal runs parallel to the data line, synchronizing data demodulation on the receiving side. It is also used as a bus to connect the CPU (chipset) to external devices, and includes GPIB, IDE / (Parallel) ATA, SCSI, PCI, etc. Because there is a limit to how fast it can be made, in PCI Express, an improved version of PCI, and Serial ATA, an improved version of Parallel ATA, the data line can be a serial bus.
[0030] CPU A CPU sequentially reads, interprets, and executes a sequence of instructions called a program stored in main memory, outputting signal-based information to the main memory. The CPU functions as the center of computation within a computer. A CPU consists of a CPU core, which is the center of computation, and its peripheral components, including registers, cache memory, an internal bus connecting the cache memory to the CPU core, a DMA controller, a timer, and an interface with the bus connecting to the north bridge. A single CPU (chip) may have multiple CPU cores. Processing may also be performed by a graphics interface (GPU) or FPU in addition to the CPU. While the embodiments are described as being of a two-core type, this is not limiting. Programs may also be embedded within the CPU.
[0031] <Non-volatile memory> The basic structure of a hard disk drive (HDD) consists of a magnetic disk, a magnetic head, and an arm on which the magnetic head is mounted. The external interface can be SATA (previously ATA). A high-performance controller, such as SCSI, supports communication between hard disk drives. For example, when copying a file to another hard disk drive, the controller can read the sectors, transfer them to the other hard disk drive, and write them. This does not access the host CPU's memory, so there is no increase in the CPU load.
[0032] <Main memory> The CPU directly accesses and executes various programs in main memory. Main memory is volatile memory and uses DRAM. Programs in main memory are expanded from non-volatile memory to main memory upon receiving a program startup command. The CPU then executes the program according to various execution commands and execution procedures within the program.
[0033] Operating System (OS) An operating system is used to manage computer resources for use by applications, to manage various device drivers, and to manage the computer itself (the hardware). In small computers, firmware is sometimes used as the operating system.
[0034] ≪BIOS≫ The BIOS causes the CPU to execute procedures for starting up the computer hardware and running the operating system. It is most typically the hardware that the CPU reads first when it receives a computer startup command. The BIOS contains the address of the operating system stored on the disk (non-volatile memory), and the BIOS loaded into the CPU sequentially loads the operating system into main memory, putting it into operation. The BIOS also has a check function that checks the presence or absence of various devices connected to the bus. The check results are stored in main memory and made available to the operating system as appropriate. The BIOS may also be configured to check for external devices, etc. The above applies to all embodiments.
[0035] As shown in Figure 17, the present invention can basically be configured with a general-purpose computer program and various devices. The computer basically operates by loading a program recorded in non-volatile memory into main memory, and then executing processing using the main memory, CPU, and various devices. Communication with devices is performed via an interface connected to a bus line. Possible interfaces include a display interface, keyboard, and communication buffer. Below, an embodiment of the present invention will be described with reference to illustrative examples.
[0036] <Fulfillment of the Laws of Nature of the Invention> The present invention functions through the cooperation of a computer, communications equipment, and software. Specifically, it relates to a centralized healthcare information management system for accumulating and centrally managing healthcare information related to an individual's healthcare, in which various information and data are exchanged between third-party terminals and administrator terminals via a network using hardware resources. Therefore, from this perspective, if we judge the claimed invention based on the computer and other resources described in the claims and specification and the common general knowledge related to those matters, the claimed invention as a whole utilizes the laws of nature and falls under the category of a computer-software-related invention.
[0037] <The significance of utilizing the laws of nature required by patent law> The Patent Act requires that an invention be industrially applicable and contribute to the development of industry. This requirement ensures that the invention is industrially applicable. In other words, the invention must be industrially useful; that is, the effects of the invention declared in the application must be reproducible with a certain degree of certainty through the practice of the invention. From this perspective, the application of the laws of nature is interpreted as the use of the laws of nature to achieve the functions of each of the invention's defining features (invention elements), which constitute the invention's effects. Furthermore, the effect of an invention is sufficient if it has the potential to provide a specific utility to users who use the invention, and should not be viewed in terms of how users feel or think about that utility. Therefore, even if the effect users gain from the system is a psychological effect, that effect itself does not fall within the scope of the required application of the laws of nature.
[0038] <Embodiment 1> Embodiment 1 mainly relates to claim 1, etc. Note that the embodiment merely shows one way of implementing the present invention, and the claims defining the present invention should not be interpreted as being limited to this embodiment.
[0039] <Outline of Embodiment 1> The invention according to the first embodiment is a system for accurately transmitting editing instructions from the editing instructor to one or more editing executors authorized to perform editing by a system administrator or the like (which may be the editing instructor or the like) via a network or the like, when the person instructing editing of a video and the person executing the video editing are different persons. More specifically, the editing instructor views a video that can be shared with the editing executor via a network or the like, and records the details to be edited for the video to be edited as text and illustrations drawn on the video so that they can be superimposed and played back. This may be a video that both the editing instructor and the editing executor view simultaneously, or it may be configured so that the editing instructions are given first and the editing executor views them later to understand the editing intentions. In particular, illustrations drawn so that they can be superimposed and played back convey editing intentions that are difficult to express with text. Information indicating these editing intentions is transmitted by the editing executor viewing the video with the instructions recorded via a network or the like. The invention of this embodiment provides a system that can smoothly perform these tasks. Specifically, the system has functions for recording editing intentions, storing them, and allowing the stored editing intentions to be viewed.
[0040] <Configuration of Embodiment 1> (Embodiment 1 General) This embodiment provides a function for multiple people to edit videos at low cost and easily by effectively utilizing a social infrastructure called a video sharing service that is generally available to anyone. In other words, the goal is to provide a platform that enables collaborative video editing by adding this system to a video-sharing service (either a web-based service or an app-based service) widely used as social infrastructure. Specifically, the system provides a comment input window linked to the video playback and a drawing tool that is superimposed on the playback video, located adjacent to the video playback window provided by the video-sharing service. This system is configured so that the editing information recorded in synchronization with the video can be viewed by the editor while playing the video on the video-sharing service. Since publicly available video-sharing systems naturally do not have the functionality to record comments and superimposed drawings provided by this system, when the editor edits, they can understand the editing intentions by playing the video on the video-sharing site in synchronization with the editing information stored in the records provided by this system, just as in the case of the editing instructor.
[0041] FIG. 1 is a conceptual diagram showing an example of a video comment sharing system 0100 according to the first embodiment. For example, in the video comment sharing system, a video is played in a video playback window 0102 of a playback device 0101 used by person A on an information processing terminal for person A. Here, the information processing terminal may be a personal computer, a tablet, or a smartphone. The playback device may be a web browser, an application that is included as standard on the information processing terminal, or a dedicated application downloaded and installed from a specific website. For example, Person A inputs comments and / or drawing information to a video acquired from a video sharing site 0140. A video sharing site is a server that distributes video content such as YouTube, and is also called a streaming server or a video content distribution server. The function of inputting comments to the acquired video is enabled by a comment input window on the right side of the screen. The function of providing drawing information is enabled by selecting an appropriate drawing tool from a tool window at the bottom of the screen and superimposing a drawing on the video screen. These input comments and drawings are stored in a video comment sharing server 0150 that is provided separately from the publicly accessible video sharing site. These functions are realized by an add-on function that provides extended functionality to existing software or applications. When person A shares comments and drawing information about a video with other team members, people B, C, and D, who have received permission from person A to view the information, can view the comments and drawing information about the video in a playback window 0110 of person B's playback device, a playback window 0120 of person C's playback device, and a playback window 0130 of person D's playback device, respectively. A video processed based on comments and drawings entered by one or more of person B, C, and D, for example, person B, is stored in the video comment sharing server, and the stored comments and / or videos can be viewed by person A, C, and D.
[0042] FIG. 2 is a conceptual diagram showing an example of a network configuration 0200 of a video comment sharing system according to the present invention. The network configuration includes an information processing terminal A 0210, an information processing terminal B 0220, an information processing terminal C 0230, an information processing terminal D 0240, a video comment sharing server 0250, a video sharing site 0260, and a communication network 0270. The information processing terminals are personal computers, tablets, smartphones, etc. The video sharing site is a server that distributes video content. A server is a subordinate concept of a site. The communication network is a communication network in which multiple computers and devices are interconnected to exchange information and data. Examples include the Internet, Wi-Fi (registered trademark), and a 5G system. Although four information processing terminals are depicted in this figure, the number of information processing terminals is not particularly limited as long as it is two or more.
[0043] <Functional Blocks of Embodiment 1> (Overview of Functional Blocks in Embodiment 1) 3 is a functional block diagram of the video comment sharing system according to embodiment 1. The functional blocks include a video acquisition unit 0301, a comment storage unit 0302, a drawing information storage unit 0303, a permission unit 0304, a permission control information storage unit 0305, a comment recording unit 0306, a drawing unit 0307, a video viewing unit 0308, and a comment viewing unit 0309.
[0044] (Embodiment 1 Functional Block: Video Acquisition Unit) The "video acquisition unit" 0301 acquires videos published on video sharing servers, etc. For example, the video acquisition unit acquires a frame image of a certain playback time for a video that needs editing and / or playback time information for that frame image. In other words, in the present invention, "acquiring a video" means acquiring video footage, and acquiring one or more of the playback times (hours, minutes, and seconds) of a video being played on a video sharing service while the comment recording unit and / or drawing unit are operating. This is to identify which scene at which playback time when editing a video. The still image may be a screenshot or a snapshot. Videos are retrieved in the video format provided by the video sharing server; this system does not select or require a specific video format. In other words, the system views videos stored on servers such as YouTube. Note that the videos retrieved here are unedited and are not intended to be made public. Therefore, in the case of YouTube, for example, the videos retrieved are those uploaded to the video sharing server and designated for limited viewing by members only. Video sharing sites offer features for limiting the scope of videos available. For example, YouTube offers the following three public settings: (1) Public: Anyone can view the video, and it also appears in search results and related videos. (2) Private: Only users who know the video URL can view the video. It does not appear in search results, so it can be shared only with specific people. (3) Private: Only users with a Google account specified by the poster can view the video, providing stricter restrictions. For example, with the "private" setting, viewing permissions can be controlled by sharing the video URL via LINE (registered trademark) or email. However, caution is required, as the URL may be shared widely, potentially allowing unintended viewers to view it. In cases where disclosure is strictly limited to certain members, as in the present case, the disclosure method described in (3) above is appropriate.
[0045] (Function block comment storage unit of embodiment 1) The "comment storage unit" 0302 stores comments recorded by a comment recording unit (described later) in synchronization with a certain playback timing of the acquired video. The playback timing may be the playback time or the frame ID (counter ID) of the video. Comments are configured to be input using an add-on function, plug-in function, or the like. In this embodiment, a configuration is made such that comments can be added using an add-on function in a standard browser, and comments for a certain playback timing of the acquired video are stored in the video comment sharing server. Note that the add-on function may be configured to be switched on / off using an add-on icon in the upper right corner of the screen (described later). Comments may be input from a window on the right side of the screen. The comment storage unit stores comments so that it is possible to know when and by which user they were entered. That is, the entered comments are stored in association with the user name and the time of entry. In other words, it is desirable to configure the system so that the history of comments entered in the past can be easily viewed. The comment storage unit also applies a filter function to the entered comments, storing them so that only the desired comments can be output. Furthermore, the comment storage unit also applies a sorting function to the entered comments, storing them so that the order can be changed. The comment storage unit may be configured to send input comments to the video editor or the video editing instructor via push notification, for example, via SNS or email.
[0046] (Function block of embodiment 1: drawing information storage unit) The "drawing information storage unit" 0303 stores the drawing information recorded by the drawing unit (described later) together with synchronization information of the playback timing so that the drawing information can be superimposed on a window playing the acquired video at a certain playback timing of the video. That is, the original video to be edited and the drawing information to be edited of the original video are handled separately and the drawing information is stored. When the original video is played, the drawing information is superimposed on the window playing the original video. In the present invention, the concept of drawing information includes not only drawings such as arrows and enclosures, but also sounds.
[0047] (Embodiment 1 Functional Block: Permission Unit) The "permission unit" 0304 allows a person with administrator authority to allow one or more third parties to view and / or record comments, and also allows them to view and / or record drawing information superimposed on the video playback window in synchronization with the playback timing. A person with administrator authority may be configured to be able to grant sub-permission authority to others. The person to be authorized is authorized by a person having administrator authority using a combination of one or more pieces of identification information such as a name, a phone number, an email address, or an SNS ID. At this time, the authorized person may be configured to be assigned a unique ID to be used in the video comment sharing system. The authorized person is registered in the video comment sharing system with the unique ID and password, and can log in. Those with administrator authority can grant permission to those who have been granted permission to view / record drawing information and view / record comments. The scope of permission that can be granted by those with administrator authority can be individual videos, parts of videos, or all videos handled by the video comment sharing system. A part of a video means that there are many edit points in the video to be edited and only a part of the many correction points is edited, or if the video to be edited is long, it can be divided into certain time intervals. For example, when editing a video that is over an hour long, there will be many edit points, and it is more efficient for multiple video editors to do the work. It is also possible to set a time limit for permission (for example, one month, one year, or until the video editing is completed).
[0048] (Function block of embodiment 1: License control information storage unit) The "permission control information storage unit" 0305 stores control information such as access control for one or more third parties by a person with administrator authority. For example, with regard to comments and drawings made by a person to edit a video, the person has owner authority and can view and record them. A third party can be permitted to view and record the video, or only view it.
[0049] (Function block: Comment recording unit in embodiment 1) The "comment recording unit" 0306 records comments on the video for recording in the comment holding unit. The video editing instructor instructs the video editing executor to make corrections to the video in order to edit the video. In addition, the video editing executor makes a comment in response to the comment from the video editing instructor to inform them that the video instructed has been corrected. The comment recording unit mainly records text information as a communication tool between the video editing executor and the video editing instructor. Note that the comment recording unit does not prevent communication between the video editing executors when there are multiple video editing executors. Input to the comment recording unit may be text or audio. For audio input, audio files such as MP3 may be converted into text and recorded, or the audio may be recorded as is. Text files may also be pasted and loaded using drag-and-drop. Furthermore, the system may be configured to accept input in video file formats such as MP4. It is desirable that the comment recording unit records comments in a way that makes it possible to know when and by which user the comment was entered. That is, the entered comment is recorded in the comment recording unit in association with the user name and the time of entry. It is also desirable that the comment recording unit be configured so that the history of previously entered comments can be easily viewed. In this case, the comment recording unit is configured to record the entered comments in a way that applies a filter function to the entered comments so that only the desired comments can be output. Furthermore, the comment recording unit is configured to record the entered comments in a way that applies a sort function to the entered comments so that the order can be changed. Comments may be recorded in the comment recording unit while the video is playing, or while the video is stopped (still image). In this case, the recorded comment is associated with the video playback time. Also, instead of the playback time, counter information used in this system or the video frame ID (for example, a unique number assigned to each 60 fps frame) may be used. Furthermore, if editing is required over a certain period of time, the time period during which the video is played may be recorded.
[0050] (Embodiment 1 Functional Block: Drawing Unit) The "drawing unit" 0307 records drawing information for the video to be stored in the drawing information storage unit. The video editing instructor instructs the video editing executor to correct the video. Since it may be difficult to clearly convey the correction points using text information alone, the video editing instructor superimposes drawing information on the video screen at a certain playback timing of the video to provide editing instructions. The drawing information may be configured so that it can be input on the video screen to be superimposed using an add-on function or plug-in function. In this embodiment, it may be configured so that various drawing information such as color, line thickness, line type, and shape can be added using an add-on function to a standard browser. The drawing information for a certain playback timing of the video to be edited is recorded in the video comment sharing server. The drawing unit may be configured to instruct the AI to draw the edited content of the video by text or verbal instructions, or to have the AI draw the correction content of the video to be edited. The drawing unit records the original image, which is one frame of a video, and the drawing information so that they can be distinguished from each other. That is, the original image layer and the drawing information layer are recorded separately. The drawing unit may also be configured to acquire one frame of a video, modify and record that frame, and record it on a layer separate from the original image. The original image and the drawing information are positioned using the same reference coordinates. The video editing features include: (1) Timeline editing: Arrange multiple videos, audio, and subtitles along a timeline and adjust the playback order and length. (2) Cutting and trimming: Cutting out unnecessary parts of a video or extracting only the necessary parts. (3) Transition: An effect inserted between images to smooth the scene change (cross dissolve, wipe, etc.). (4) Effects / Filters: Apply special effects (blur, noise, light) and color filters to the video. (5) Captions and Subtitles: Add text to video. You can set font, color, size, animation, etc. (6) Audio editing: Volume adjustment, fade-in / out, adding background music and sound effects, noise removal, etc. Color grading: Advanced color correction that adjusts the color and tone of the entire video to unify the atmosphere or express specific emotions. (7) Chroma key compositing: Making a specific color (usually green or blue) transparent and compositing it with another video or image. (8) Masking: Masking (covering) part of an image to apply effects to only that part or cut out a specific object. (9) Keyframe: An animation function that allows you to make detailed changes to the position, size, transparency, etc. of effects and objects over time. (10) Multi-camera editing: Synchronizing footage shot simultaneously with multiple cameras and editing while switching between them in real time.
[0051] (Embodiment 1 Functional Block Video Viewing Unit) The "video viewing section" 0308 displays an "original image," which is one frame of a video that has been recorded so that it can be identified, superimposed on "drawing information" for instructing editing of the video. In other words, the time information of the original image and the time information of the drawing information are made to match. In this case, the time information may be counter information or a frame number. The video editing executor is allowed to view the video that has been processed using the drawing information. Also, the video editing instructor is allowed to view the edited video in order to confirm the content of the editing process performed by the video editing executor. The video viewing unit may have a function to skip to a playback time with editing instructions when playing a video, because this allows the video editor to immediately check the video image (frame) with editing instructions without having to check the entire video. The video content sharing system and / or the video viewing unit may be configured to allow the edited video and the unedited video to be viewed side by side at the same time, allowing the editing content to be confirmed at a glance.
[0052] (Function block: Comment viewing unit in embodiment 1) The "comment viewing unit" 0309 enables viewing of comments synchronized with the playback timing of videos stored in the video content sharing server. The window for viewing comments and the window for inputting comments may be the same window. In other words, the person instructing video editing can view the comments to check the content of the video editing process performed by the video editing executor, and the video editing executor can view the comments to check the content instructed by the video editing instructor. The video editing instructor and the video editing performer may be configured to check a checkbox after checking the content of the comment. Furthermore, the video editing instructor and the video editing performer may be configured to be able to input emotion icons that show their feelings and emotions, and these icons may be displayed in the comment viewing section. Furthermore, the system may be configured to record the comment viewing (read mark) and the time of viewing. The comment viewing unit can view history information such as the user ID of the user who input the comment (the person who instructed the video editing or the person who performed the video editing) and the date and time when the comment was input.
[0053] <Example of screen in embodiment 1> (Example of screen in embodiment 1) 4 is a conceptual diagram showing an example of a screen of the video comment sharing system according to embodiment 1. The example screen 0400 of the video comment sharing system is made up of a video playback window 0401 for playing videos, a tool window 0410 for drawing, a comment input window 0420 for inputting comments, and an add-on icon 0499 for turning on / off an add-on function. FIG. 5 is a flow chart showing an example of the overall processing of the video comment sharing system according to the present invention. (1) The video editor obtains the URL of a private video from the person requesting video editing. A private video is a video with the following characteristics: (A) Who can view it: Only the person who uploaded the video and users with a specific account designated by the uploader can view it. (B) Search / display: It will not appear in YouTube search results or on the channel page. (C) Share: Even if the link URL is shared, it cannot be viewed unless the designated ID and password are present. (D) Playlist: It will not be added to other users' playlists. (2) The video editor accesses the provided URL of the private video. (3) A browser capable of viewing videos is launched, and the video is viewed using the designated ID and password. (4) The add-on function according to the present invention is enabled in the browser. (5) The administrator (video editing instructor) grants the person performing the video editing permission to view / edit the video to be edited and to view / edit comments and / or drawings. The order of permission processing can be either before (1) or between (1) and (4). The video editing instructor can use AI to create prompts for video editing instructions and give them to the video editor, or the AI can perform post-edit confirmation based on the created prompts. The video editing instructor can also create prompts for the AI to compare videos before and after editing and explain the differences. (6) The video editor can log in to this system using the ID and password registered in the video comment sharing system and access the private video using the specified URL, ID, and password. (7) The video editor edits the video as instructed. In the case of an application type rather than a browser, the video editor downloads the application and installs it after agreeing to certain conditions. The video editor sets a user ID and password, and the administrator (video editing instructor) gives permission to the video editor. After permission is given, the installed application has the same functions as an add-on, so it may be configured to allow access to private videos with a specified URL, ID, and password.
[0054] (Example of screen in embodiment 1: video playback window) In Figure 4, a video playback window 0401 is a window created in a browser for playing videos. In the present invention, a video playback window for playing videos acquired from an external video sharing site such as YouTube is displayed using a standard browser or the like, and the video is played in the video playback window. The video playback window also displays drawing information for editing video frames, superimposed on an image at a certain timing in the video. Image superimposition will be described below. Figure 7 is a conceptual diagram showing an example of overlay processing in a video comment sharing system. The drawing information window 0720 exists on a different layer from the video playback window 0710, and editing instructions can be drawn in the drawing information window without directly editing the video. The drawing information window has a transparent background and displays only the drawing information to be edited. In this system, the drawing information is overlaid (superimposed) on the original video and displayed in the video playback window 0730.
[0055] (Example of tool window screen in embodiment 1) The tool window 0410 is a window that displays tools for drawing on the video at a certain playback time. The drawing tool has icons for selecting line drawings such as straight lines, rectangles, and circles, as well as color and line thickness. User names, team names, and other information are also displayed. For example, in this figure, after switching to text input mode and adjusting the appropriate text size, you can click on the video screen to enter text and display AAAAAA. You can also switch to handwriting mode, adjust the line color and thickness to an appropriate size, and then draw a picture that surrounds the text.
[0056] (Example of screen in embodiment 1, comment window) The comment window 0420 is a window for inputting comments. The comment window may be configured to have a selection filter for team names and comments at the top, with a window for inputting comments located below it. For example, the comment input window may contain instructions such as "Please blur out the face," "Please add sound effects," and "Please add captions!" from the video editing instructor, and comments such as "I blurred out the face," "What kind of sound effects would you like?" and "Editing completed" from the video editing performer.
[0057] (Example of screen in embodiment 1, add-on icon) The add-on icon 0499 may be displayed in the upper right corner of the screen after the video comment sharing system of the present invention is installed. FIG. 6 is a conceptual diagram showing an example of a state in which the add-on function of the present invention is turned off. The present system is installed in a browser, and the add-on function is displayed as an example of a processing start icon described below. The present system has an icon 0699 in the upper right corner of the browser for turning the add-on function on and off. When the add-on function is turned on, a comment input window and tool window are displayed as shown in FIG. 4, and comments and drawings can be input / displayed. On the other hand, when the add-on function is turned off, the comment input window and tool window are hidden as shown in FIG. 6, and comments and drawings cannot be input / displayed. On the other hand, even if this video comment sharing system is introduced and the add-on icon is not displayed, it can be configured so that the comment input window and tool window are displayed by logging in with a specified ID and password, as shown in Figure 4. This video comment sharing system can be configured to process add-ons and other extensions in the background so that they are not visible to the user and are not displayed on the screen. In other words, this video comment sharing system can be used without relying on a browser.
[0058] (Embodiment 1 Tool Window) 8 is a conceptual diagram showing an example of a tool window screen of the video comment sharing system according to embodiment 1. The tool window 0800 has at least a line drawing type 0801, a font size 0802, a status change 0803, a color selection 0804, and a line drawing thickness 0805 at the top. It also has a text window at the bottom for inputting text, and has at least a user icon 0806, a user name 0807, a login / logout 0808, a team name 0809, a settings icon 0810, a drawing icon 0811, and a send button 0812.
[0059] The line drawing type 0801 can be selected from freehand, rectangle, circle, arrow, and text. The font size 0802 allows for five different font sizes. The status change 0803 allows for the user to "go back" to the previous status, "go forward" to the next status, or "delete all" the currently selected items, as needed. The color selection 0804 allows for nine colors to be selected: red, orange, yellow, yellow-green, blue, navy blue, purple, black, and white. The line thickness can be selected from five different levels. The user icon 0806 is one of the following: last name, nickname, face photo, or image. The user name 0807 is the user's name. The login / logout 0808 displays "logged out" if the user is logged in, and "logged in" if the user is logged out. The team name 0809 displays the name of the selected team. The settings icon 0810 is an icon for changing settings. The drawing icon 0811 is an icon for turning on / off the drawing mode on the video screen. The send button 0812 sends the comment that has been input.
[0060] (Embodiment 1 Comment Input Window) 9 is a conceptual diagram showing an example of a screen of a comment input window of the video comment sharing system according to the first embodiment. A window 0901 for selecting a team name is located at the top of the comment input window 0900. The name of the team to which the user belongs is displayed. When a team name is selected, comments about that team are displayed below. Next is a comment filter window 0910. Here, the user can select the type of comment to be displayed below. For example, comment types include unconfirmed, confirmed, and all. Below, windows for entering and displaying comments are listed in chronological order (0920, 0930). The user icon and user name 0921, the comment date and time 0922, an icon 0923, and elapsed time 0924 are displayed at the top of the window, with the entered comment 0925 displayed below. Icons 0923 include (1) a pen mark when a drawing is present, (2) a check mark can be added by clicking, (3) an icon displaying an emotional expression (reaction), (4) a reply icon, and (5) an icon for deletion by authorized users. Emotional expression icons 0926 are also displayed in the lower right corner of the message window. Emotional expression icons include a smiling face, a crying face, an angry face, a heart icon, and a like icon. The video editing instructor inputs the corrections. The video editing performer can determine whether the comment is directed to them or not, ask questions if they have any questions, and report completion to the video editing instructor once the video editing is complete.
[0061] (Embodiment 1 Settings Team Management Members) 10 is a conceptual diagram showing an example of team management on a setting screen of the video comment sharing system according to embodiment 1. A team management screen 1000 has a title 1001, a login status 1002, a team management tab 1003, a user setting tab 1004, a comment history tab 1005, a team list 1006, team names 1007 and 1008, a team screen 1009, team members 1010, and a detailed description 1011.
[0062] This image explains the Team Management tab. The team list on the left side of the screen displays the teams you belong to. In this image, the teams "Animation Video Production" and "Detective" are displayed. When you select "Animation Video Production," detailed information about Animation Video Production is displayed on the right side of the screen. Team members and their permissions are displayed at the bottom right of the screen. An explanation of the permissions is displayed below the members.
[0063] (Embodiment 1 Settings Team Management Settings) Figure 11 shows the "Settings" screen when you select the animation video production team in the team management tab. One of the most important settings is the ability to "delete" the team itself. This can be done for a number of reasons, including (1) to prevent information leaks as much as possible once the editing project is complete, (2) not retaining information for confidentiality reasons, and (3) reducing data volume. If you delete the entire team, all members of the team will no longer be able to access it, and all comments will also be deleted. Furthermore, once deleted, it cannot be restored. If you select "Delete Team", a pop-up screen will appear. After confirming, select "Delete" to delete the team, or select "Cancel" to close the pop-up without deleting the team.
[0064] (Embodiment 1 Settings Team Management Comment History) Figure 12 shows the "Comment History" screen when the animation production team is selected in the Team Management tab. Administrators and users can view a list of comment history. When Comment History 1201 is selected, a list of comment history is displayed in the lower right corner of the screen. Each comment includes the name of the user who edited the video, an icon, the date and time the comment was created, and the comment content. If an edited video is available, the screen may be configured to jump to the playback time of the edited video. It also includes a "Refresh" icon 1202 to obtain the latest information and a "Filter" icon 1203 to display only the necessary comments. Filtering by user or period is possible. This screen allows users to view the comment history, including comments and reactions made by members of the animation production team.
[0065] (Embodiment 1 Settings Video List) FIG. 13 is an example of a video list screen in the user settings tab of the video comment sharing system according to the first embodiment. A list of videos that can be viewed by the team is displayed in the left window. When a video is selected, the title of the video list 1301 is displayed in the right window of the screen, and related videos are displayed below. An "update" icon 1302 is provided to update the video. In addition, when there are many videos, a sorting function 1303 is provided, such as sorting by newest or oldest. In this figure, for example, when the video "Mystery Solving Street" is selected, videos related to "Mystery Solving Street" are displayed on the right. In this figure, the first, second, and third drafts of episode 3 are displayed.
[0066] (Embodiment 1 Settings User Settings) FIG. 14 is an example of a screen in the user settings tab of the video comment sharing system according to the first embodiment. The following describes the process of performing plug-in collaboration with a third-party product. (1) When user settings 1401 is selected, the user name, email address, and user ID are displayed at the top of the screen. Below these, an icon for reissuing a token to collaborate with a plug-in and an icon for invalidating the token currently in use are also displayed. When the token reissue icon is clicked, the token is displayed and a new token is issued linked to the user name and email address. By using the token, the third-party product can be used. (2) It is also possible to use a third-party product by logging in with a user ID and password without using a token. An example of a third-party product is Adobe's Premiere Pro product.
[0067] <Hardware Configuration of First Embodiment> (Embodiment 1: Hardware Configuration Overview) 15 is a diagram illustrating an example of a hardware configuration of a video comment sharing system 1500 according to embodiment 1. The video comment sharing system 1500 includes a CPU 1501, a nonvolatile memory 1502, a main memory 1503, an I / O controller 1504, a communication unit 1505, and the like.
[0068] (Embodiment 1 Hardware Configuration CPU) The CPU (Central Processing Unit) 1501 sequentially reads, interprets, and executes programs, which are instruction sequences, stored in the nonvolatile memory 1502, and outputs information consisting of signals to the main memory 1503. The CPU 1501 functions as the center of calculations within the computer. In the present invention, the CPU 1501 controls all processing within the real estate brokerage information service system 1500. For example, in the first embodiment, the CPU 1501 executes a video acquisition program deployed on the main memory 1503 to acquire a video.
[0069] (Embodiment 1 Hardware Configuration Non-Volatile Memory) Video information, comment information, drawing information, permission information, comment recording information, etc. are stored in the nonvolatile memory 1502. This user information is read from the nonvolatile memory 1502 and expanded on the main memory 1503, triggered, for example, by power-on.
[0070] (Embodiment 1 Hardware Configuration Main Memory) The main memory 1503 reads out programs that perform various processes so that the CPU 1501 can execute them, and also provides a work area for the programs. The main memory 1503 is a volatile memory, and dynamic random access memory (DRAM) is used. For example, a program on the main memory 1503 is loaded from the nonvolatile memory 1502 onto the main memory 1503 in response to a program startup command. The CPU 1501 directly accesses and executes various programs on the main memory 1503. The CPU 1501 then executes the program according to various execution commands and execution procedures within the program.
[0071] (Embodiment 1 Hardware Configuration Input / Output Interface Serial Bus) The input / output interface 1504 is connected to an external device and transmits received signals to the CPU 1501 via a serial bus 1505 .
[0072] (Embodiment 1 Hardware Configuration Communication Unit) The communication unit 1505 exchanges information with the outside of the video comment sharing system 1500. For example, the communication unit 1505 transmits video information and the like acquired by the video comment sharing system 1500 to a video comment sharing server. The communication unit 1505 also receives correction comments about the target video from the editing executor.
[0073] (Embodiment 1 Hardware Configuration Program) In this embodiment, the nonvolatile memory 1502 stores a video acquisition program, a comment storage program, and It stores the program, the drawing information holding program, the license program, the process start icon program, etc.
[0074] For example, the video acquisition program executes a program that stores desired videos in memory by streaming them from a video comment sharing server, or a program that stores them in a storage unit by downloading files. The comment storage program executes a program that receives predetermined comments entered by a user and stores them in a storage unit. The permission program executes a program that allows a video editing instructor to grant permission to a video editor to view / edit comments and / or drawing information. The process start icon program is executed after the system is installed, and generates an icon that enables / disables add-on functions.
[0075] <Explanation of processing flow in embodiment 1> (Outline of processing flow in embodiment 1) FIG. 16 is a flowchart showing an example of the processing flow of the video comment sharing system 1600 in the first embodiment.
[0076] First, a desired video is acquired from a video sharing site (S1601). The video file may be acquired, or an image of one frame to be edited from the video and / or playback time information of that frame (frame number, counter number, etc.) may be acquired. The video comment sharing server also holds permission control information for the person editing the video (S1602).
[0077] An information processing terminal used by the video editing instructor (hereinafter referred to as the instructor information processing terminal) transmits a permission message for viewing and / or recording the video to the video comment sharing server (S1603). The video comment sharing server transmits a permission message for viewing and / or recording the video to the information processing terminal used by the video editing executor (hereinafter referred to as the executor information processing terminal) (S1604). A login ID and password are entered at the executor information processing terminal, and are registered in the video comment sharing server (not shown).
[0078] A comment for the editing instructor about the video is created from the instructor information processing terminal (S1605) and transmitted to the video comment sharing server (S1606). The video comment sharing server stores the editing instruction comment (S1607). The editing instruction comment is transmitted from the video comment sharing server to the performer information processing terminal (S1608).
[0079] Drawing information (including playback time information, etc.) for the video intended for the editing instructor is created from the instructor information processing terminal (S1509) and transmitted to the video comment sharing server (S1610). The video comment sharing server holds the drawing information intended for the editing instructor (S1611). The drawing information is transmitted from the video comment sharing server to the performer information processing terminal (S1612). It should be noted that the order of "S1605 to S1608" and "S1609 to S1612" may be any order. That is, "S1609 to S1612" may be performed first, and then "S1605 to S1608" may be performed.
[0080] The execution instructor views the video on which the comment and drawing information have been superimposed (S1613). The video editing executor edits the video (S1614). The execution instructor can add comments after correcting the video (S1615). The system may be configured so that the creator's comments can be made before the video is edited. That is, before editing the video, the creator can confirm the editing content and ask questions about the editing instructions. In this case, the creator's information processing terminal may be configured to send edit instruction comments to the creator's information processing terminal as responses to questions. There is no particular limit to the number of messages between the creator's information processing terminal and the creator's information processing terminal.
[0081] An editing completion comment for the video is created from the executor information processing terminal (S1615) and transmitted to the video comment sharing server (S1616). The video comment sharing server holds the editing completion comment (not shown). The editing completion comment is transmitted from the video comment sharing server to the instructor information processing terminal (S1617). The video editing instructor views the edited video (S1618). If, as a result of viewing, the video has been corrected in accordance with the instructor's request, the instructor transmits a completion comment. If the video has not been corrected as expected, the instructor can transmit comments or drawings again and provide instructions for correction.
[0082] <Effects of Embodiment 1> By eliminating miscommunication between the video editing instructor and the person performing the video editing, video editing can be done intuitively, easily, and efficiently.
[0083] <Embodiment 2> The second embodiment mainly relates to claim 2 and the like.
[0084] <Outline of Embodiment 2> The invention according to the second embodiment is a video comment sharing system in which a video acquisition unit acquires videos from a video sharing site on the Internet.
[0085] Representative video sharing sites on the Internet include (1) YouTube, (2) Niconico Video (registered trademark), (3) TikTok (registered trademark), (4) FC2 (registered trademark) Video, (5) Vimeo, and (6) Facebook. The present invention is a service that allows users to share editing comments on videos regardless of the type of video sharing site.
[0086] The video acquisition unit acquires a video, which means acquiring the video image, and acquiring one or more of the playback times (hours, minutes, and seconds) of the video being played on the video sharing service while the comment recording unit and / or drawing unit are operating. Specifically, this is a still image that is part of the video, or the playback time of the video you want to edit (which may be a frame ID, counter ID, etc.). If the video does not include a playback time, the video comment sharing system may be configured to read time information included in each packet that distributes the video. In this case, the Real Time Protocol (RTP) is used, and the time information is read from the RTP timestamp included in the RTP header. This RTP timestamp plays an important role in synchronizing video and audio and correctly rearranging the order of packets. Furthermore, since there may be a processing delay of several hundred milliseconds to several seconds between receiving a packet and displaying the video, the system may be configured to calculate playback time information for editing the video by adjusting for the processing delay. The video comment sharing server on which the system is implemented may be configured to obtain time information from the nearest NTP server.
[0087] <Effects of Embodiment 2> Since miscommunication between a video editing instructor and a video editing performer is eliminated, video editing can be done intuitively, easily, and efficiently, regardless of the video sharing site.
[0088] <Embodiment 3> The third embodiment mainly relates to claim 3 and the like.
[0089] <Outline of Embodiment 3> The invention according to the third embodiment is a video comment sharing system in which the permission control information includes at least user identification information.
[0090] When a video editing instructor gives permission to a video editor who will edit a video, user identification information may be used to control the permission given to the video editor. Examples of user identification information include name, email address, telephone number, and social media ID. User identification information such as a driver's license, My Number, health insurance card, and bank account number may also be used. A configuration may also be adopted in which a reward is paid to an account linked to the user identification information upon completion of the editing work.
[0091] A person with administrator authority will grant permission to a person who is authorized to use the video comment sharing system by combining the person's name with one or more pieces of identification information, such as a phone number, email address, or SNS ID. The person who is authorized will be registered in the video comment sharing system with a unique ID and password to be used in the video comment sharing system. The person who is authorized can log in to the video comment sharing system with this ID and password. A person with administrator authority can grant permission to those who have been granted permission to view / record drawing information and to view / record comments. The scope of permission that can be granted by a person with administrator authority can be on a video-by-video basis, a portion of a video, or all videos handled in the video comment sharing system. A time limit for permission can also be set (for example, 30 days, 4 months, or 1 year). A configuration may also be adopted in which a person with administrator authority can grant permission to re-grant to others.
[0092] <Effects of Embodiment 3> By providing permission using user identification information, teams can be organized, eliminating miscommunication between the video editing instructor and the person performing the video editing, making video editing intuitive, easy to understand, and efficient.
[0093] <Embodiment 4> The fourth embodiment mainly relates to claim 4 and the like.
[0094] <Outline of Embodiment 4> The invention according to the fourth embodiment is a video comment sharing system in which a process start icon for accepting the start of processing by the comment recording unit and / or drawing unit is displayed as an add-on in the same window as the video playback screen of a video sharing site on the Internet.
[0095] The process start icon is an add-on function. By installing this system and launching a process start icon program that enables the add-on function, a tool window and a comment input window can be displayed in the same display window (display device) as the video playback window, in addition to the video playback window. There are no particular restrictions on the relative positions of the tool window and the comment input window. As shown in Figure 4, a tool window that allows input of drawing information may be located below the video playback window that plays the video, and a comment input window that allows input of comments may be located to the right of the video playback window. The video playback window, tool window, and comment input window may be arranged in a horizontal or vertical row.
[0096] <Effects of Embodiment 4> This eliminates miscommunication between the video editing instructor and the person performing the video editing, enabling intuitive, easy-to-understand, and efficient video editing work.
[0097] <Embodiment 5> The fifth embodiment mainly relates to claim 5 and the like.
[0098] <Outline of Embodiment 5> The invention of embodiment 5 is a video comment sharing system that has check boxes, a comment entry box, and an emotional expression icon addition box that can be used by viewers when drawing information and / or comments are present, in association with the timing of video playback.
[0099] The windows provided by the video comment sharing server through the add-on function include a comment input window that allows for text input and a tool window that allows for drawing input. Both the video editing instructor and the video editing performer can input comments in the comment input window. The comment input window has a confirmed checkbox for the comment and also has an emotional expression icon for the comment. The checkbox is a square frame that can be checked to indicate the status of the message. The emotional expression icon shows the emotion for the message and includes a smiling face, crying face, angry face, heart icon, like icon, etc.
[0100] As shown in Figure 12, the comment history tab manages the drawing information of comments entered by administrators and users of this system. Administrators and users can check the comment history list displayed in the comment history tab. Each comment includes the user's name, icon, comment creation date and time, comment content, and so on. For example, if an administrator wants to view the history of a specific user, they can display only that user's history in chronological order, allowing them to check interactions with that user. In addition, if there is an edited video, the system may be configured to jump to the playback time of the edited video.
[0101] <Effects of Embodiment 5> This eliminates miscommunication between the video editing instructor and the person performing the video editing, enabling intuitive, easy-to-understand, and efficient video editing work. [Explanation of symbols]
[0102] 0100 Video comment sharing system 0101 Video playback device 0102 Video playback window 0103 Comment input window 0104 Tool Window 0301 Video Acquisition Unit 0302 Comment storage section 0303 Drawing information holding unit 0304 Permissions Department 0305 Permission control information storage unit 0306 Comment Recording Section 0307 Drawing Department 0308 Video Viewing Section 0309 Comment Viewing Section
Claims
1. A video acquisition unit that acquires videos from a video sharing site on the Internet; a comment storage unit that stores comments for editing a video in association with the playback timing of the acquired video; a drawing information storage unit that stores drawing information, which is superimposition information for editing a moving image on a moving image screen of the acquired moving image, in synchronization with the playback timing of the moving image to be superimposed; a permission unit for granting permission to one or more of viewing the acquired video, recording and viewing of the comments synchronized with the acquired video, drawing of information to be superimposed in synchronization with the playback timing of the acquired video screen, and viewing of the drawing information superimposed on the acquired video; a permission control information storage unit that stores permission control information for controlling permission; a comment recording unit for recording the comment in a comment storage unit when permission is granted by the permission unit; a drawing unit for recording drawing information into the video in a drawing information storage unit when permission is granted by the permission unit; a video viewing unit for viewing the video processed using the drawing information when permission is granted by the permission unit; a comment viewing unit for viewing the recorded comments when permission is granted by the permission unit; A video comment sharing system having the above.
2. The video comment sharing system according to claim 1 , wherein the permission control information includes at least user identification information.
3. 3. The video comment sharing system according to claim 1, wherein the process start icon for accepting the start of processing by the comment recording unit and / or the drawing unit is displayed as an add-on in the same window as the video playback screen of the video sharing site on the Internet.
4. A video comment sharing system as described in claim 1 or claim 2, which has check boxes, comment entry boxes, and emotional expression icon addition boxes that can be used by viewers when drawing information, comments, and drawing information and / or comments are ``present'' associated with the timing of video playback.
5. A video acquisition step of acquiring a video from a video sharing site on the Internet; a comment storage step of storing comments for editing the video in synchronization with playback timing of the acquired video in association with the comment; a drawing information holding step of holding drawing information, which is superimposition information for editing a moving image on a moving image screen of the acquired moving image, in synchronization with the playback timing of the moving image to be superimposed; a permission step for permitting one or more of viewing of the acquired video, recording and viewing of the comments synchronized with the acquired video, drawing of information superimposed in synchronization with the playback timing of the acquired video screen, and viewing of drawing information superimposed on the acquired video; a license control information holding step for holding license control information for controlling the license; a comment recording step for recording the comment in a comment holding step when permission is given by the permission unit; a drawing step for recording drawing information into the video in a drawing information storage step when permission is granted in the permission step; a video viewing step for viewing the video processed using the drawing information when permission is granted in the permission step; a comment viewing step for viewing the recorded comments when permission is granted in the permission step; A method for operating a video comment sharing system, which is a calculation method having the above.
6. The operating method of a video comment sharing system according to claim 5, wherein the permission control information includes at least user identification information.
7. A method for operating a video comment sharing system as described in claim 5 or claim 6, wherein a processing start icon that accepts the start of processing of the comment recording step or / and the drawing step is displayed as an add-on in the same window as the video playback screen of a video sharing site on the Internet.
8. An operating method of the video comment sharing system described in claim 5 or claim 6, which has check boxes, comment entry boxes, and emotional expression icon addition boxes available to viewers when the presence or absence of drawing information, the presence or absence of comments, and drawing information and / or comments are "present" associated with the playback timing of the video.
9. A video acquisition step of acquiring a video from a video sharing site on the Internet; a comment storage step of storing comments for editing the video in synchronization with playback timing of the acquired video in association with the comment; a drawing information holding step of holding drawing information, which is superimposition information for editing a moving image on a moving image screen of the acquired moving image, in synchronization with the playback timing of the moving image to be superimposed; a permission step for permitting one or more of viewing of the acquired video, recording and viewing of the comments synchronized with the acquired video, drawing of information superimposed in synchronization with the playback timing of the acquired video screen, and viewing of drawing information superimposed on the acquired video; a license control information holding step for holding license control information for controlling the license; a comment recording step for recording the comment in a comment holding step when permission is given by the permission unit; a drawing step for recording drawing information into the video in a drawing information storage step when permission is granted in the permission step; a video viewing step for viewing the video processed using the drawing information when permission is granted in the permission step; a comment viewing step for viewing the recorded comments when permission is granted in the permission step; An operating program that can be read and executed by a video comment sharing system that is a computer having the program.
10. 10. The operating program readable and executable by a video comment sharing system that is a computer according to claim 9, wherein the permission control information includes at least user identification information.
11. An operating program that can be read and executed by a video comment sharing system that is a computer as described in claim 9 or claim 10, wherein a processing start icon that accepts the start of processing of the comment recording step or / and the drawing step is displayed as an add-on in the same window as the video playback screen of a video sharing site on the Internet.
12. An operating program that can be read and executed by a video comment sharing system that is a computer as described in claim 9 or claim 10, which has check boxes, comment entry boxes, and emotional expression icon addition boxes that can be used by viewers when drawing information, comments, and drawing information and / or comments are ``present'' associated with the timing of video playback.
Citation Information
Patent Citations
Collaborative dynamic video commenting device and method
JP2002507027A
Information processing system, information processor, information processing program, and information display device
JP2014236873A
Video editing system
JP2023073184A
Server, terminal and computer program
JP2024047602A
Shared Augmented Reality sessions for rendering video effects
JP2024530183A
Cited By
AI agent-to-agent decision-making information sharing device and program
JP7886589B1