Video editing system, video editing program, and recording medium.

Abstract

The entire video data recording a series of tasks can be easily divided into multiple parts, one for each work process, and the divided video data can be saved chronologically. [Solution] The system includes a storage unit 5 that stores a series of work processes, including multiple elemental work processes, pre-recorded for a person, a machine, or an item, as a single work video file; an identification unit (control unit 10) that analyzes the video data constituting the single work video file stored in the storage unit 5 to automatically identify the start timing of the multiple elemental work processes; a splitting unit (control unit 10) that positions the video period from the previous start timing to the current start timing identified by the identification unit as a single elemental work period video, and divides the entire work video file into multiple elemental work period videos; and an editing unit (control unit 10) that associates each of the divided elemental work period videos with a work procedure and stores them in the storage unit as a new work video file.

Description

Technical Field

[0001] The present invention relates to a work video editing system, a video editing program, and a recording medium, and particularly to a work video editing system, a video editing program, and a recording medium for dividing one work video file in which a plurality of pre-shot work processes are used as a series of work processes.

Background Art

[0002] Conventionally, based on long (long-time) video data pre-shot, a video editing system has been known that edits the video data in a short time and enables various forms of editing such as addition of titles, wipes, etc., addition of voices and BGM as needed (see, for example, Patent Documents 1 to 3).

[0003] Also, a video editing system is known that compares the line-of-sight video during the work of a skilled worker and the line-of-sight video during the work of an inexperienced worker in order to teach the inexperienced worker engaged in on-site work the skills of the skilled worker (see, for example, Patent Document 4).

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Patent Document 3

Patent Document 4

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in the video editing systems disclosed in the aforementioned Patent Documents 1 to 3, the process involves specifying the start and end points of a required section from a series of video data to create the necessary video section, and then adding other edits (text overlays, background music, etc.), similar to existing video editing systems.

[0006] Furthermore, in work video editing systems like the one disclosed in Patent Document 4, it is assumed that not only skilled workers but also inexperienced workers will actually perform the work.

[0007] Therefore, for example, in situations where a series of tasks are performed continuously during filming, such as in a factory or cooking, and individuals only want to view a specific part of the process for training purposes, specifying the start and end points of the required section becomes problematic. For instance, if the end point of the previous section and the start point of the next section are the same, specifying them becomes difficult, resulting in an unnecessarily complicated process.

[0008] On the other hand, when filming a series of work processes as a sample video for educational purposes, if the work can be efficiently divided into segments, editing will not be necessary. However, if equipment operation or instructions are given to start or stop filming, those parts will remain as extra footage, resulting in the need for some kind of editing.

[0009] Therefore, the inventors of the present invention came to the conclusion that by using a generation AI (Artificial Intelligence) function to analyze the video data that constitutes a single work video file, and then dividing that video data into sample videos for each process, in other words, by creating a video manual creation tool that aims to easily formalize tacit knowledge, it would be possible to realize a simple editing operation.

[0010] The object of the present invention is to provide a work video editing system, a video editing program, and a recording medium that can easily divide the entire video data recorded of a series of operations into multiple parts for each process, and moreover, can store the divided video data in chronological order. [Means for solving the problem]

[0011] To achieve the above objective, the work video editing system of the present invention is characterized by comprising: a storage unit that stores a series of work processes, including multiple elemental work processes, pre-recorded for a person, a machine, or an item, as a single work video file; an identification unit that analyzes the video data constituting the single work video file stored in the storage unit to automatically identify the start timing of the multiple elemental work processes; a division unit that divides the entire work video file into multiple elemental work period videos, positioning the video period from the previous start timing to the current start timing identified by the identification unit as a single elemental work period video; and an editing unit that associates each of the elemental work period videos divided by the division unit with a work procedure and stores them in the storage unit as a new work video file.

[0012] Furthermore, the video editing program of the present invention is characterized in that it causes a video editing terminal equipped with computer functions to execute the following: a storage process that stores a series of work processes, including multiple elemental work processes that have been previously filmed for a person, a machine, or a single item, as a single work video file in a storage unit; an identification process that analyzes the video data constituting the single work video file stored in the storage unit and automatically identifies the start timing of the multiple elemental work processes in an identification unit; a splitting process that positions the video period from the previous start timing to the current start timing identified by the identification unit as a single elemental work period video and splits the entire work video file into multiple elemental work period videos in a splitting unit; and an editing process that associates each of the elemental work period videos split by the splitting unit with a work procedure in an editing unit and stores them in the storage unit as a new work video file. [Effects of the Invention]

[0013] According to the present invention, the entire video data recorded from a series of operations can be easily divided into multiple parts for each process, and the divided video data can be stored in chronological order. [Brief explanation of the drawing]

[0014] [Figure 1] An example of the work video editing system of the present invention is shown, where (A) is a block diagram of the work video editing system, and (B) is an explanatory diagram showing an example of the display screen showing the automatic editing start state of the work video editing screen. [Figure 2] This diagram illustrates an example of the work video editing system of the present invention, showing an example of the work video editing screen display after the division points for a series of work videos have been specified. [Figure 3] An example of the video editing system of the present invention is shown, where (A) is an explanatory diagram showing an example of the video editing screen during re-editing, and (B) is an explanatory diagram showing an example of the title input screen displayed on the screen during re-editing. [Figure 4] This diagram shows an example of the video editing system of the present invention, and is a flowchart of an example of a processing routine executed by the control unit. [Figure 5] This diagram illustrates an example of the video editing system for work according to the present invention, and is an explanatory diagram of an example of the playback screen. [Modes for carrying out the invention]

[0015] Next, a work video editing system according to one embodiment of the present invention will be described with reference to the drawings.

[0016] In FIG. 1(A), the work video editing system 1 uses a video editing terminal 2 equipped with computer functions such as a personal computer. The video editing terminal 2 can be used not only in a personal computer (hereinafter sometimes simply abbreviated as "PC") such as a desktop type or a notebook type, but also in a tablet terminal, a smartphone (hereinafter sometimes simply abbreviated as "smartphone"), etc. Further, the smartphone may be a smartphone synchronized with the PC (hereinafter sometimes abbreviated as "PC / s synchronized smartphone").

[0017] The video editing terminal 2 includes a communication unit 4 that enables communication with the cloud 3 through a telecommunication line NT, a storage unit 5 that stores an operating system (hereinafter sometimes simply abbreviated as "OS") and various applications (hereinafter sometimes simply abbreviated as "apps"), etc., an operation unit 6 such as a keyboard, a mouse, and a touch panel (not shown in the figure), a playback unit 7 that plays back videos, a display unit 8 that displays the played-back videos, a signal database unit 9 that accumulates audio signals and video signals included in video data, and a control unit 10 that controls the communication unit 4, the storage unit 5, the operation unit 6, the playback unit 7, the display unit 8, and the signal database unit 9 according to the programs of the OS and apps stored in the storage unit 5.

[0018] In the cloud 3, work video files in which a plurality of pre-shot work processes are regarded as a series of work processes are stored.

[0019] The communication unit 4 is configured to download one or more work video files selected by the operator operating the operation unit 6 from the work video files stored in the cloud 3 through the telecommunication line NT. Here, the work video file is a file in which a series of work processes including a plurality of element work processes pre-shot for one person, one unit, or one article is regarded as one work video file. Also, the video data of the work video file includes those composed only of video signals and those composed of both audio signals and video signals.

[0020] The memory unit 5 stores one or more work video files downloaded from the cloud 3 via the communication unit 4. The memory unit 5 includes a ROM-type memory unit that stores the OS, etc., and a RAM-type memory unit that stores work video files, etc., and can also utilize the cloud 3 or portable memory (such as a USB memory or SD card memory). Therefore, the control unit 10 executes a storage function that stores a single work video file in the memory unit 5, which consists of multiple pre-recorded work processes.

[0021] Note that using Cloud 3 is not mandatory. For example, a work video file shot with a video camera (not shown) can be copied (or moved) to the storage unit 5 of the video editing terminal 2. Similarly, if the work video terminal 2 is a smartphone or tablet, the work can be recorded using its recording function, and the resulting work video file can be used directly.

[0022] The playback unit 7 plays a work video based on the work video file stored in the storage unit 5. The display unit 8 displays the work video processed by the playback unit 7, as well as the work videos for manual split editing and re-editing described later, on the screen.

[0023] The operation unit 6 is equipped with functions for the operator to manually split and edit the work video displayed on the display unit 8 for each work process, and for the operator to manually re-split and edit the work video for each work process after it has been automatically split and edited using the generation AI technology described later. Depending on the type of video editing terminal 2, it may include a keyboard, mouse, and touch panel, which are not shown in the illustration.

[0024] The database unit 9 comprises an audio signal database unit 9a and a video signal database unit 9b.

[0025] The control unit 10 controls the communication unit 4, storage unit 5, operation unit 6, playback unit 7, display unit 8, and database unit 9 according to the video editing program of this embodiment, referring to the OS and application programs stored in the storage unit 5, and performing automatic split editing using generation AI technology. Therefore, an application for using the video editing program is installed in advance in the storage unit 5, and the control unit 10 controls the execution of storage, playback, and display, as well as the execution of split editing processing in response to split editing operations using the operation unit 6.

[0026] On the other hand, it is preferable to use a liquid crystal display panel, including a touch panel type, for the display unit 8. Furthermore, the display screen 80 of the display unit 8 can be switched between the work video editing screen shown in Figure 1(B) and the title input screen shown in Figure 3(B).

[0027] The work video editing screen shown in Figure 1(B) comprises a work video display screen section 81 partitioned off as part of the screen to display the work video, a divided work information display screen section 82 partitioned off to the side of the work video display screen section 81, a level display screen section 83 partitioned off below the work video display screen section 81 to display the total time frame 83a of the work video and to display the playback progress position in levels according to the proportion from the start of playback to the current playback time relative to the total time frame 83a, and an icon display screen section 84 to display multiple divided editing icons (described later) for use by the operator in divided editing operations. In addition, the display unit 8 displays a movable mouse pointer 86 that is displayed when a mouse is used on the operation unit 6, etc.

[0028] The splitting work information display screen 82 displays one or more splitting work information frames 82a, 82b, etc., as shown in Figures 2 and 3, although this will be described in detail later. These splitting work information frames 82a, 82b, etc. are increased or decreased according to the editing status when automatic splitting editing is performed using generation AI technology, and when the operator performs manual splitting re-editing, such as specifying the start of splitting (hereinafter also simply referred to as "re-editing") after these automatic and manual splitting edits have been performed.

[0029] The topmost splitting work information frame 82a displays the start time of the video targeted by that frame, i.e., the video playback time ("00:00") 85a, the work title (for example, a temporary title such as "1st Step") 85b, as well as an exclusion designation icon 85c that specifies that the work video file (data) for the target section of that frame will be excluded from the creation of the manual data described later, until the next splitting start designation is executed, and a title input icon 85d that switches to the title input screen to change the work title.

[0030] The following splitting information frame 82b (splitting information frames 82c~82g) displays the video playback time 85a, work title 85b, exclusion icon 85c, title input icon 85d for the relevant section, as well as a cancel icon 85e for canceling the splitting start specification.

[0031] Furthermore, if the number of division sections increases and the number of division work information frames 82a, 82b, etc. increases, and there are division work information frames 82a, 82b, etc. that do not fit within the display area of ​​the division work information display screen section 82 (or immediately before them, etc.), a vertical scroll bar 82j will be displayed to move the display area as needed.

[0032] The icon display screen section 84 is arranged at appropriate positions on the work video editing screen as a set of split editing icons for use in split editing operations by the operator during manual split editing and re-editing. This includes a full-screen display icon 84a for switching the work video display screen section 81 to full-screen display, a save icon 84b, a temporary save icon 84c, a split start position specification icon 84d, a playback progress time / total time display icon 84e, a fast-forward icon 84f, a fast-back icon 84g, a playback speed UP icon 84h, a playback speed DOWN icon 84i, a playback speed display icon 84j, a play / stop specification icon 84k, a screen rotation icon 84m, a split start position identification icon 84n, and an AI icon 84p that is operated by the operator when performing automatic split editing using generation AI technology.

[0033] Furthermore, the operating procedures when an operator performs manual splitting editing, such as specifying the start of splitting, and when an operator performs re-editing, such as specifying the start of splitting, after automatic splitting editing using the generating AI, are substantially the same as those disclosed in Patent Publication No. 7546989, filed by the same applicant as the applicant of this application. Therefore, specific explanations of these editing operations will be omitted except for some explanations (for example, the example of re-editing in the re-editing execution step in step S7 described later).

[0034] Next, an example of control of the control unit 10 in automatic split editing using generation AI technology will be explained based on the flowchart in Figure 4. Note that the objects controlled by the control unit 10 shown below are primarily illustrative examples and do not represent a limited set of control objects.

[0035] (Step S1) In step S1, the control unit 10, in response to the operator's operation of the control unit 6, for example, controls the communication unit 4 to download the target video from the cloud 3, stores the work video file in the storage unit 5, and then proceeds to step S2.

[0036] (Step S2) In step S2, the control unit 10 controls the playback unit 7 and the display unit 8 to perform an icon display function that displays multiple split editing icons (icons 84a to 84n, etc.) on the icon display screen unit 84 for use during split editing and re-editing operations by the operator, while enabling playback (and display) of the work video on the work video display screen unit 81 of the display unit 8, and then proceeds to step S3.

[0037] Here, if the operator simply wants to play a video, or if they want to perform manual split editing, they can start playback by operating the play / stop icon 84k (separate routine).

[0038] (Step S3) In step S3, the control unit 10 determines whether an operation to specify the AI ​​icon 84p has occurred from the state shown in Figure 2 (in reality, the beginning of the video is displayed on the work video display screen 81). If the control unit 10 determines that an operation to specify the AI ​​icon 84p has occurred (Yes), it proceeds to step S4. If the control unit 10 does not determine that an operation to specify the AI ​​icon 84p has occurred (No), it continues to monitor the routine in step S3.

[0039] (Step S4) In step S4, the control unit 10 starts video analysis as automatic segmentation and editing using generation AI technology, and when the analysis is completed, it proceeds to step S5.

[0040] In step S4, the control unit 10 specifically performs an identification process as an identification unit, which analyzes the video data constituting a single work video file stored in the storage unit 5 and automatically identifies the start timings of multiple elemental work processes as division start positions, and a division process, which positions the video period from the previously identified start timing to the current start timing as a single elemental work period video, and divides the entire work video file into multiple elemental work period videos.

[0041] By the way, in step S4, the control unit 10 can identify the start timing using only the audio data obtained by referring to the audio database unit 9a, only the video data obtained by referring to the video database unit 9b, or both the audio data and the video data, depending on the video data or the work content.

[0042] Therefore, it is particularly useful when the work process is performed by a single worker, when the work process is handled using a single piece of equipment, or when the work process is performed on a single item.

[0043] In other words, when multiple workers, multiple devices, or multiple items are used, it is easy to determine that these are different work processes if they involve switching between them.

[0044] In contrast, when dealing with a work process involving a single worker, a single piece of equipment, or a single item, it is not easy to divide that series of work processes.

[0045] Therefore, when referring to audio data, the start timing of the split can be easily identified using phrases such as "Next..." or "Ending now." Depending on the type of phrase, it is also possible to identify the start timing as either before or after the phrase.

[0046] Furthermore, when referring to video data, the timing of the start of segmentation can be easily identified based on the worker's hand movements (continuous, repetitive, pauses, etc.) and changes in tools, etc.

[0047] Furthermore, when referencing video data, it is possible to perform analysis including so-called wipe-in ​​footage. In addition, for tasks that are repeated over a certain time axis, it is possible to apply the technology by not recognizing the start time of the split or by deleting a portion of it.

[0048] (Step S5) In step S5, the control unit 10, as part of the division process performed by the division unit, expands and displays the data on each display screen of the display unit 8, as shown in Figure 3, and then proceeds to step S6.

[0049] (Step S6) In step S6, the control unit 10 determines whether the operator has performed any icon selection operation by the operation unit 6 in order to perform a re-editing operation. If the control unit 10 determines that any icon selection operation has been performed (Yes), it proceeds to step S7. If the control unit 10 does not determine that any icon selection operation has been performed (No), it proceeds to step S8.

[0050] (Step S7) In step S7, as an example of re-editing, if the operator specifies the division work information frame 82d for title editing, the frame of the division work information frame 82d becomes thicker, as shown in Figure 3(A). Subsequently, when the operator selects the title input icon 85d, the screen switches to the title input screen, as shown in Figure 3(B), and re-editing can be performed.

[0051] Then, after the operator has entered text for re-editing into the text input box 87a, and the operator has selected the OK icon 87b, the control unit 10 changes the original text (fit the tire) to the changed text (insert the tire) and switches the display screen 80 back from the title input screen to the work video editing screen. Also, if the operator has selected the Cancel icon 87c, the control unit 10 switches the display screen 80 back from the title input screen to the work video editing screen while keeping the original text (fit the tire). Note that in Figure 3(B), the cursor 87d is displayed in the text input box 87a.

[0052] (Step S8) In step S8, the control unit 10 determines whether the save icon 84b has been specified. If the control unit 10 determines that the save icon 84b has been specified (Yes), it proceeds to step S9. If the control unit 10 does not determine that the save icon 84b has been specified (No), it loops back to step S6.

[0053] (Step S9) In step S9, the control unit 10 creates manual data that links multiple work video files, each designated as a division start interval, so that they can be identified and played back in chronological order, and then controls the unit 5 to store this as a new series of work video files, and then terminates this routine.

[0054] Therefore, in step S9, the control unit 10 performs editing processing as an editing unit, associating each of the divided element work period videos with a work procedure and storing them in the storage unit 5 as a new work video file.

[0055] Thus, the control unit 10 performs the following operations: a storage process in which, for example, a series of work processes including multiple elemental work processes pre-recorded for a person, a machine, or an item is stored in the storage unit 5 as a single work video file, according to a video editing program that includes an automatic video editing function using a generation AI stored in the storage unit 5; an identification process in which the video data constituting the single work video file stored in the storage unit 6 is analyzed to automatically identify the start timing of multiple elemental work processes; a splitting process in which the entire work video file is divided into multiple elemental work period videos, with the video period from the previously identified start timing to the current start timing being positioned as a single elemental work period video; and an editing process in which each of the split elemental work period videos is associated with a work procedure and stored in the storage unit as a new work video file.

[0056] On the other hand, this new series of manualized work video files can be played back on devices such as the smartphone 90 shown in Figure 5.

[0057] The display screen 91 of the smartphone 90 shows a work video display screen section 92, a level display screen section 93 including the total time frame 93a of the work video, segmented work information frames 94a, 94b...94e for each segmented work required for manualization, and minute digits 95 for recognizing the playback progress of the entire process of the selected playback.

[0058] Therefore, the operator can play the desired video simply by selecting the work process they want to play from the divided work information frames 94a, 94b...94e.

[0059] Thus, in the video editing system 1 according to this embodiment, there is no need to specify the start and end points for splitting a required section of a series of video data, as is the case when using existing video editing software.

[0060] In other words, by equipping a single work video file with an automatic splitting and editing function specifically designed for splitting work processes, a series of work processes including multiple elemental work processes pre-recorded for a single person, a single machine, or a single item can be easily divided into multiple files for each work process, and the divided video data can be saved in chronological order.

[0061] Furthermore, the present invention is not limited to the embodiments described above, and various modifications are possible without departing from its spirit and technical concept. For example, during re-editing, (1) Include re-edited unnecessary sections during playback. (2) Automatic deletion of unnecessary sections (3) Interrupt operation This allows for easy re-editing.

[0062] Furthermore, although not to be exemplified individually, the present invention may be implemented with various modifications without departing from its spirit. [Explanation of symbols]

[0063] 1. Video editing system for work 2. Video editing terminal 3. Cloud (memory unit) 4. Communications Department 5 Storage section 6. Control Panel (Mouse, Keyboard, Touch Panel) 7 Playback section 8 Display 9. Database Department 9a Audio Signal Database Section 9b Video Signal Database Section 10 Control Unit (Identification Unit, Segmentation Unit, Editing Unit) 81 Work video display screen 82 Split work information display screen section 82a Splitting work information frame 82b Splitting work information frame 83 Level display screen section 83a Total time slot 83a 84 Icon display screen 84b Save icon 84c Temporary save icon 84d Split start position specification icon 84n division start position identification icon 84p AI icon

Claims

1. A storage unit that stores a series of work processes, including multiple elemental work processes, pre-recorded for a person, a machine, or an item, as a single work video file, An identification unit analyzes the video data constituting the single work video file stored in the storage unit to automatically identify the start timing of the multiple elemental work processes, A division unit divides the entire work video file into multiple work period videos, while positioning the video period from the previous start time to the current start time identified by the identification unit as a single work period video element. The editing unit stores each of the element work period videos divided in the division unit as a new work video file in the storage unit, associating it with the work procedure. A video editing system that uses a video editing terminal equipped with the following features.

2. A storage unit that stores a single work video file containing multiple pre-recorded work processes for a person, a machine, or an item, which are treated as a series of work processes. A playback unit plays a work video based on the work video file stored in the storage unit, A display unit that displays a work video editing screen including the work video processed by the playback unit, An operation unit for the operator to perform editing operations on the work video displayed on the display unit, A control unit that controls the execution of the aforementioned storage, playback, and display, as well as the execution of the split editing process on the aforementioned work video file, A video editing system using a video editing terminal equipped with, The aforementioned display unit is A work video display screen section, which is partitioned as part of the work video editing screen and displays the work video, A divided work information display screen section is partitioned to the side of the aforementioned work video display screen section and displays one or more divided work information frames, A level display screen section is provided below the aforementioned work video display screen section, which displays the total time frame of the work video and also displays the playback progress position in proportion to the total time frame from the start of playback to the current playback time. An icon display screen section that displays multiple split editing icons for manual split editing operations by the operator, Equipped with, The control unit, An identification unit analyzes the video data constituting the single work video file stored in the storage unit and automatically identifies the start timing of the multiple elemental work processes as the division start position, The division unit positions the video period from the previous start time to the current start time identified by the identification unit as a single element work period video, and divides the entire work video file into multiple element work period videos, which are then displayed on each display screen of the display unit. The editing unit stores each of the element work period videos divided in the division unit as a new work video file in the storage unit, associating it with the work procedure. A video editing system that uses a video editing terminal equipped with the following features.

3. In the work video editing system according to claim 1 or claim 2, The aforementioned identification unit is The system analyzes at least one of the audio or video signals contained in the video file, and automatically identifies the start timing of the multiple elemental work processes when predetermined conditions are met by referring to a database of signals accumulated in the past. A video editing system characterized by the following features.

4. In the work video editing system described in claim 2, The aforementioned operating unit is The section from the division start position to the next division start position, divided by the control unit, is considered a single division section, and the display unit includes one or more icons to allow the operator to perform editing operations such as changing or deleting the division start position of a single division section, re-dividing the division section, deleting the division section or deleting either of the re-divided sections, and changing the work title. A video editing system characterized by the following features.

5. A storage process that stores a series of work processes, including multiple elemental work processes pre-recorded for a person, a machine, or an item, as a single work video file in a storage unit, An identification process that analyzes the video data constituting the single work video file stored in the storage unit and automatically identifies the start timing of the multiple elemental work processes in the identification unit, The video period from the previous start time to the current start time, identified by the identification unit, is positioned as a single element work period video, and the entire work video file is divided into multiple element work period videos by the division unit in a splitting process. Editing process in which each of the element work period videos divided in the division unit is associated with a work procedure in the editing unit and stored in the storage unit as a new work video file, A video editing program designed to run on a video editing terminal equipped with computer capabilities.

6. A recording medium characterized in that it contains the video editing program described in claim 5 and is readable by a video editing terminal equipped with computer functions.

Images