Work video editing system, video editing program and recording medium

Abstract

To easily divide the entire video data in which a series of work is recorded into a plurality of parts for each work process, and to store the divided video data in chronological order. [Solution] The system comprises a memory unit 5 that stores a series of work processes including multiple element work processes that have been filmed in advance for one person, one machine, or one item as one work video file; an identification unit (control unit 10) that analyzes the video data that makes up one work video file stored in the memory unit 5 and automatically identifies the start timing of the multiple element work processes; a division unit (control unit 10) that divides the entire work video file into multiple element work period videos while positioning the video period from the previous start timing to the current start timing identified by the identification unit as one element work period video; and an editing unit (control unit 10) that associates each of the divided element work period videos with a work procedure and stores them as new work video files in the memory unit.

Description

[Technical Field]

[0001] The present invention relates to a work video editing system, a video editing program, and a recording medium, and more particularly to a work video editing system, a video editing program, and a recording medium for dividing a single work video file into a series of work steps each of which is a series of work steps that have been previously filmed. [Background technology]

[0002] Conventionally, video editing systems have been known that edit pre-recorded long (long duration) video data into a shorter length, and enable the addition of subtitles, wipes, audio, background music, and various other forms of editing as needed (see, for example, Patent Documents 1 to 3).

[0003] Also known is a video editing system that compares footage of the gaze of a skilled worker working with footage of the gaze of an unskilled worker working, in order to enable unskilled workers engaged in on-site work to learn the techniques of skilled workers (for example, Patent Document 4). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2008-098752 [Patent Document 2] Japanese Patent Application Laid-Open No. 2010-178010 [Patent Document 3] Patent No. 5517532 [Patent Document 4] Japanese Patent Application Publication No. 2023-050798 Summary of the Invention [Problem to be solved by the invention]

[0005] However, in the work video editing systems disclosed in Patent Documents 1 to 3 described above, like existing video editing, for a necessary section among a series of video data, after designating the start and end points as the necessary video section, operations such as adding other edits (captions, BGM, etc.) were performed.

[0006] Also, in the work video editing system disclosed in Patent Document 4, it is premised that not only skilled workers but also unskilled workers actually perform the work.

[0007] Therefore, for example, in a series of operations in a factory or the like, or a series of operations in cooking or the like, when the work is continuously carried out as it is during shooting and each person wants to view only a series or necessary parts of the work for training or the like, if the start and end points of the necessary section are designated, for example, when the end point of the previous section and the start point of the next section are the same, problems such as difficulty in that designation and being forced to perform overly complicated operations have occurred.

[0008] On the other hand, when shooting a series of work processes as a sample video for education or the like, if the work can be segmented without waste, although the editing work becomes unnecessary, even if equipment operations or instructions for starting and stopping shooting are performed, that part remains as extra video, so as a result, some kind of editing work becomes necessary, and this problem also occurs.

[0009] Therefore, the inventors of the present application analyzed the video data constituting one work video file using a generative AI (Artificial Intelligence) function, and created a sample video by dividing the video data for each process. In other words, they came to the idea that a video manual creation tool aimed at simply formalizing tacit knowledge can realize simple editing work.

[0010] To provide a work video editing system, a video editing program, and a recording medium that can easily divide the entire video data recording a series of work into a plurality of parts for each process, and that can store the divided video data in chronological order. [Means for solving the problem]

[0011] In order to achieve the above object, the work video editing system of the present invention is characterized by comprising: a storage unit that stores a series of work processes including a plurality of element work processes that have been filmed in advance for one person, one machine, or one item as one work video file; an identification unit that analyzes video data that constitutes the one work video file stored in the storage unit and automatically identifies the start timings of the plurality of element work processes; a division unit that divides the entire work video file into a plurality of element work period videos while positioning the video period from the previous start timing to the current start timing identified by the identification unit as one element work period video; and an editing unit that associates each of the element work period videos divided by the division unit with a work procedure and stores the resulting video file in the storage unit as a new work video file.

[0012] The video editing program of the present invention is characterized in that it causes a video editing terminal equipped with computer functions to execute the following steps: a storage process for storing a series of work processes including a plurality of element work processes that have been filmed in advance for one person, one machine, or one item as one work video file in a storage unit; an identification process for analyzing video data that constitutes the one work video file stored in the storage unit and automatically identifying the start timings of the plurality of element work processes in an identification unit; a division process for dividing the entire work video file into a plurality of element work period videos in a division unit while positioning the video period from the previous start timing to the current start timing identified by the identification unit as one element work period video; and an editing process for associating each of the element work period videos divided by the division unit with a work procedure in an editing unit and storing the result as a new work video file in the storage unit. [Effects of the Invention]

[0013] According to the present invention, the entire video data in which a series of operations has been recorded can be easily divided into a plurality of parts for each process, and the divided video data can be stored in chronological order. [Brief explanation of the drawings]

[0014] [Figure 1] 1A and 1B show an example of a work video editing system of the present invention, in which FIG. 1A is a block diagram of the work video editing system, and FIG. 1B is an explanatory diagram showing an example of a display screen of a work video editing screen in an automatic editing start state. [Figure 2] FIG. 10 is an explanatory diagram showing an example of a work video editing system according to the present invention, illustrating a display example of a work video editing screen in a state where designation of division positions for a series of work videos has been completed. [Figure 3] 1A and 1B show an example of a work video editing system of the present invention, in which (A) is an explanatory diagram showing an example of the display of a work video editing screen during re-editing work, and (B) is an explanatory diagram showing an example of the display of a title input screen on the display screen during re-editing work. [Figure 4] 1 is a flowchart illustrating an example of a processing routine executed by a control unit in an example of a work video editing system according to the present invention. [Figure 5] FIG. 1 is an explanatory diagram of an example of a playback screen of an example of a work video editing system of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0015] Next, a working video editing system according to an embodiment of the present invention will be described with reference to the drawings.

[0016] In FIG. 1(A), the work video editing system 1 uses a video editing terminal 2 equipped with computer functions such as a personal computer. The video editing terminal 2 can be used, for example, not only on a personal computer (hereinafter sometimes simply abbreviated as "PC") such as a desktop type or a notebook type, but also on a tablet terminal, a smartphone (hereinafter sometimes simply abbreviated as "smartphone"), etc. In addition, the smartphone may be a smartphone synchronized with the PC (hereinafter sometimes abbreviated as "PC / s synchronized smartphone").

[0017] The video editing terminal 2 includes a communication unit 4 that enables communication with the cloud 3 through a telecommunication line NT, a storage unit 5 that stores an operating system (hereinafter sometimes simply abbreviated as "OS") and various applications (hereinafter sometimes simply abbreviated as "apps"), etc., an operation unit 6 such as a keyboard, mouse, and touch panel (not shown in the figure), a playback unit 7 that plays back videos, a display unit 8 that displays the played-back videos, a signal database unit 9 that stores audio signals and video signals included in video data, and a control unit 10 that controls the communication unit 4, storage unit 5, operation unit 6, playback unit 7, display unit 8, and signal database unit 9 according to the programs of the OS and apps stored in the storage unit 5.

[0018] The cloud 3 stores work video files in which a plurality of pre-shot work processes are regarded as a series of work processes.

[0019] The communication unit 4 is configured to download one or more work video files selected by the operator operating the operation unit 6 from the work video files stored in the cloud 3 through the telecommunication line NT. Here, the work video file is a file in which a series of work processes including a plurality of element work processes pre-shot for one person, one device, or one article is regarded as one work video file. In addition, the video data of the work video file includes those composed only of video signals and those composed of both audio signals and video signals.

[0020] The storage unit 5 is configured to store one or more working video files downloaded from the cloud 3 via the communication unit 4. The storage unit 5 includes a storage unit in the form of a ROM that stores the OS and the like, and a storage unit in the form of a RAM that stores working video files and the like. Additionally, the cloud 3 or a portable memory (such as a USB memory or an SD card memory) can be used separately. Therefore, the control unit 10 executes a storage function that stores, in the storage unit 5, one working video file that combines a plurality of pre-shot working processes into a series of working processes, targeting these various storage media.

[0021] Note that the use of this cloud 3 is not essential. For example, a working video file of a working video shot with a video camera (not shown) may be copied (or moved) to the storage unit 5 of the video editing terminal 2. Similarly, when the working video terminal 2 is a smartphone or a tablet terminal, the shooting function thereof may be used to shoot work or the like, and the working video file may be used as it is.

[0022] The playback unit 7 plays back the working video based on the working video file stored in the storage unit 5. The display unit 8 displays on the screen the working video processed for playback by the playback unit 7 and the working videos for manual splitting / editing and re-editing described later.

[0023] The operation unit 6 has a function for the operator to perform a manual splitting / editing operation on the working video displayed on the display unit 8 for each working process, and a manual re-splitting / editing operation on the working video automatically split / edited using the generation AI technology described later for each working process. Depending on the type of the video editing terminal 2 and the like, it appropriately includes a keyboard, a mouse, and a touch panel whose illustration is omitted.

[0024] The database unit 9 includes an audio signal database unit 9a and a video signal database unit 9b.

[0025] The control unit 10 controls the communication unit 4, the storage unit 5, the operation unit 6, the playback unit 7, the display unit 8, and the database unit 9 in accordance with the operating systems and application programs stored in the storage unit 5, and performs automatic split editing using the generation AI technology while referring to these, according to the video editing program according to the present embodiment. Therefore, an application for using the video editing program is installed in the storage unit 5 in advance, and the control unit 10 controls the execution of storage, playback, and display, as well as the execution of split editing processing according to the split editing operation using the operation unit 6.

[0026] On the other hand, it is preferable to use a liquid crystal display panel including a touch panel method for the display unit 8. Further, the display screen 80 of the display unit 8 is configured to be switched between the work video editing screen shown in FIG. 1(B) and the title input screen shown in FIG. 3(B).

[0027] The work video editing screen shown in FIG. 1(B) includes, as a part thereof, a work video display screen unit 81 that displays a work video partitioned as a part thereof, a split work information display screen unit 82 partitioned on the side of the work video display screen unit 81, and a total time frame 83a of the work video displayed below the work video display screen unit 81, and a level display screen unit 83 that displays a playback progress position corresponding to the share from the start of playback to the current playback time with respect to the total time frame 83a at a level, and an icon display screen unit 84 that displays a plurality of split editing icons (described later) for use in split editing operations by the operator. Further, on the display unit 8, a mouse pointer 86 displayed when a mouse is used for the operation unit 6 is displayed so as to be movable.

[0028] In the split work information display screen unit 82, although details will be described later, as shown in FIGS. 2 and 3, one or more split work information frames 82a, 82b,... are displayed. These split work information frames 82a, 82b,... increase or decrease according to the editing state when automatic split editing is performed using the generation AI technology, and when the operator performs manual split re-editing (hereinafter, also simply referred to as "re-editing") such as split start designation after performing these automatic split editing and manual split editing.

[0029] The topmost split work information frame 82a displays the start time of the video that is the target of the frame, i.e., video playback time ("00:00") 85a, the work title (for example, "1st Step" as a tentative title) 85b, as well as an exclusion designation icon 85c that specifies that the work video file (data) for the target section of the frame will not be included in the creation of manual data, as described below, until the next split start designation is executed, and a title input icon 85d that switches to a title input screen to change the work title.

[0030] The next (or subsequent) divided task information frame 82b (divided task information frames 82c to 82g) displays the video playback time 85a of the section, the task title 85b, an exclusion designation icon 85c, a title input icon 85d, as well as a cancel icon 85e for canceling the division start designation.

[0031] In addition, if the number of divided sections increases and the number of displayed divided work information frames 82a, 82b, etc. increases, and there are divided work information frames 82a, 82b, etc. that cannot all be contained within the display section of the divided work information display screen section 82 (or immediately before that), a vertical scroll bar 82j is displayed to move the display area as necessary.

[0032] The icon display screen section 84 is arranged at an appropriate position on the working video editing screen as a plurality of split editing icons used for split editing operations during manual split editing and re-editing by the operator. Here, the icon display screen section 84 includes a full screen display icon 84a for switching the working video display screen section 81 to full screen display, a save icon 84b, a temporary save icon 84c, a split start position designation icon 84d, a playback progress time / total time display icon 84e, a forward icon 84f, a rewind icon 84g, a playback speed up icon 84h, a playback speed down icon 84i, a playback speed display icon 84j, a play / stop designation icon 84k, a screen rotation icon 84m, a split start position identification icon 84n, and an AI icon 84p operated by the operator when automatic split editing is performed using a generation AI technology.

[0033] When the operator performs manual split editing such as specifying the start of splitting, and when the operator performs re-editing such as specifying the start of splitting after automatic split editing using generative AI, the operation procedures and the like are substantially the same as those disclosed in Japanese Patent Publication No. 7546989 filed by the same applicant as the applicant of the present application. Therefore, specific descriptions of these editing operations will be omitted except for some descriptions (for example, the re-editing example in the re-editing execution step in step S7 described later).

[0034] Next, a control example of the control unit 10 in automatic split editing using generative AI technology will be described based on the flowchart of FIG. 4. Note that the main control targets by the control unit 10 shown below are merely examples and are not intended to be limited control targets.

[0035] (Step S1) In step S1, in response to an operation of the operation unit 6 of the operator, the control unit 10 controls, for example, the communication unit 4 to download a target video from the cloud 3, stores the work video file in the storage unit 5, and transfers the process to step S2.

[0036] (Step S2) In step S2, the control unit 10 controls the playback unit 7 and the display unit 8 to execute an icon display function of displaying a plurality of split editing icons (icons 84a to 84n, etc.) to be used during split editing operations and re-editing operations by the operator on the icon display screen unit 84, and enables the playback (and display) of the work video on the work video display screen unit 81 of the display unit 8, and transfers the process to step S3.

[0037] Here, when the operator simply plays the video or performs manual split editing, the playback can be started by operating the playback / stop designation icon 84k (separate routine).

[0038] (Step S3) In step S3, the control unit 10 determines whether there has been a designation operation for the AI icon 84p from the state shown in FIG. 2 (actually, the opening video of the video is displayed on the work video display screen unit 81). When the control unit 10 determines that there has been a designation operation for the AI icon 84p (Yes), the process proceeds to step S4. When the control unit 10 determines that there has been no designation operation for the AI icon 84p (No), it continues to monitor the routine of this step S3.

[0039] (Step S4) In step S4, the control unit 10 starts video analysis as automatic splitting and editing using the generation AI technology, and when the analysis is completed, the process proceeds to step S5.

[0040] Note that in this step S4, specifically, the control unit 10 performs identification processing as an identification unit that analyzes the video data constituting one work video file stored in the storage unit 5 to automatically identify the start timing of a plurality of elemental work processes as the split start position, and splitting processing that positions the video period from the previously identified start timing to the current start timing as one elemental work period video and splits the entire work video file into a plurality of elemental work period videos.

[0041] Incidentally, in this step S4, the control unit 10 can identify the start timing using only the audio data referring to the audio database unit 9a, only the video data referring to the video database unit 9b, or both the audio data and the video data, according to the video data or the work content, etc.

[0042] Therefore, it is particularly useful when the work process is being performed by a single worker, when the work process is being processed using a single device, etc., or when the work process is being performed on a single article.

[0043] That is, when using a plurality of workers, a plurality of devices, a plurality of articles, etc., if such switches occur, it is of course easy to determine that they are different work processes.

[0044] On the other hand, in the case of a work process for one worker, one device, and one article, it is not easy to divide that series of work processes.

[0045] Therefore, when referring to the audio data, the start timing of the division can be easily identified based on phrases such as "next..." or "ending" as an opportunity. At this time, depending on the type of phrase, it is also possible to identify the start timing as before the phrase or after the phrase.

[0046] Also, when referring to the video data, the start timing of the division can be easily identified based on the movement of the operator's hand (continuous, repetitive, stopped, etc.) or the change of tools, etc.

[0047] Note that when referring to the video data, it is also possible to perform analysis including so-called wipe videos. Also, in the case of work repeated on a certain time axis, it is possible to apply such as not recognizing it as the start timing of the division or partially deleting it.

[0048] (Step S5) In step S5, as a partial function of the division process by the division unit, the control unit 10 expands and displays on each display screen unit of the display unit 8 as shown in FIG. 3, and transfers the process to step S6.

[0049] (Step S6) In step S6, the control unit 10 determines whether there has been any icon designation operation by the operation unit 6 in order for the operator to execute a re - editing operation. If the control unit 10 determines that there has been any icon designation operation (Yes), it transfers the process to step S7. If the control unit 10 determines that there has been no icon designation operation (No), it transfers the process to step S8.

[0050] (Step S7) In step S7, when the operator designates the division work information frame 82d for title editing as an example of re-editing, the frame of the division work information frame 82d becomes thick as shown in Fig. 3(A) in the operation unit 10. After that, when the operator designates the title input icon 85d, the screen is switched to the title input screen as shown in Fig. 3(B) and re-editing can be performed.

[0051] Then, when the operator inputs text for re-editing into the text input frame 87a and then specifies an OK icon 87b, the control unit 10 changes the initial text characters (fit the tire) to the modified text characters (fit the tire), and switches the display on the display screen 80 from the title input screen to the work video editing screen, and returns to the screen. Furthermore, when a cancel icon 87c is specified, the control unit 10 switches the display on the display screen 80 from the title input screen to the work video editing screen, with the initial text characters (fit the tire) remaining unchanged. In FIG. 3(B), a cursor 87d is displayed in the text input frame 87a.

[0052] (Step S8) In step S8, the control unit 10 determines whether the save icon 84b has been specified. If the control unit 10 determines that the save icon 84b has been specified (Yes), the control unit 10 proceeds to step S9. If the control unit 10 does not determine that the save icon 84b has been specified (No), the control unit 10 loops to step S6.

[0053] (Step S9) In step S9, the control unit 10 creates manual data that links multiple work video files, with each division start specified as a division section, so that they can be identified and played back in chronological order, and controls the storage unit 5 to store the data as a new series of work video files, and then ends this routine.

[0054] Therefore, in this step S9, the control unit 10 executes an editing process as an editing unit that associates each of the segmented element work period videos with a work procedure and stores it in the storage unit 5 as a new work video file.

[0055] In this way, the control unit 10, for example, according to a video editing program including an automatic video editing function using the generation AI stored in the storage unit 5, stores a series of work processes including a plurality of element work processes pre-shot for one person or one unit or one article in the storage unit 5 as one work video file, an identification process for automatically identifying the start timing of a plurality of element work processes by analyzing the video data constituting one work video file stored in the storage unit 6, a division process for dividing the entire work video file into a plurality of element work period videos while positioning the video period from the previous start timing automatically identified by the automatic identification unit to the current start timing as one element work period video, and an editing process for associating each of the divided element work period videos with a work procedure and storing it in the storage unit as a new work video file.

[0056] On the other hand, such a new series of work video files converted into manual data can be played back by a smartphone 90 or the like shown in FIG. 5.

[0057] On the display screen 91 of the smartphone 90, a work video display screen unit 92, a level display screen unit 93 including a total time frame 93a of the work video, split work information frames 94a, 94b... 94e for each time-series split work required during manual conversion, and a fraction number 95 for recognizing the playback process for the entire process of the selected playback process are displayed.

[0058] Therefore, the operator can play back a desired video simply by selecting and specifying the work process to be played back from the split work information frames 94a, 94b... 94e.

[0059] Thus, in the work video editing system 1 according to the present embodiment, there is no need for the labor of specifying a division start point and a division end point for a necessary section among a series of video data as in the case of using existing video editing software.

[0060] That is, by providing an automatic division editing function specialized for work process division for a single work video file for a series of work processes including a plurality of elemental work processes pre-shot for one person, one unit, or one article, the entire video data of the recorded series of work can be easily divided into a plurality of parts for each work process, and moreover, the divided video data can be saved in time series.

[0061] Note that the present invention is not limited to the above embodiment, and various modifications are possible within the scope not departing from its gist and technical idea. For example, at the time of re-editing, (1) Include re-editing of unnecessary sections during playback (2) Automatically delete unnecessary sections (3) Interrupt operation Such re-editing can be easily performed.

[0062] In addition, although not exemplified one by one, the present invention is implemented with various changes within the scope not departing from its gist.

Explanation of Reference Numerals

[0063] 1 Work video editing system 2 Video editing terminal 3 Cloud (storage unit) 4 Communication unit 5 Storage unit 6 Operation unit (mouse, keyboard, touch panel) 7 Playback unit 8 Display unit 9 Database unit 9a Audio signal database unit 9b Video signal database unit 10 Control unit (identification unit, division unit, editing unit) 81 Operation video display screen section 82 Divided operation information display screen section 82a Divided operation information frame 82b Divided operation information frame 83 Level display screen section 83a Total time frame 83a 84 Icon display screen section 84b Save icon 84c Temporary save icon 84d Division start position specification icon 84n Division start position identification icon 84p AI icon

Claims

1. A storage unit that stores a series of work steps including a plurality of elemental work steps pre-shot for one person, one unit, or one article as one work video file; An identification unit that analyzes the video data constituting the one work video file stored in the storage unit to automatically identify the start timing of the plurality of elemental work steps; A division unit that positions the video period from the previous start timing identified by the identification unit to the current start timing as one elemental work period video and divides the entire work video file into a plurality of elemental work period videos; An editing unit that associates each of the elemental work period videos divided by the division unit with a work procedure and stores it in the storage unit as a new work video file; Comprising: The identification unit: A work video editing system using a video editing terminal that analyzes at least one of the audio signal or video signal included in the work video file, refers to each signal database accumulated in the past, and automatically identifies the start timing of the plurality of elemental work steps when a predetermined condition is satisfied.

2. A storage unit that stores one work video file with a plurality of elemental work steps pre-shot for one person, one unit, or one article as a series of work steps; A playback unit that plays back the work video based on the work video file stored and processed by the storage unit; A display unit that displays a work video editing screen including the work video played back by the playback unit; An operation unit for an operator to operate an editing operation related to the work video displayed on the display unit; A control unit that controls the execution of the storage, the execution of the playback, the execution of the display, and the execution of the split editing process for the work video file; A work video editing system using a video editing terminal comprising: The display unit: ​ ​ ​ ​ ​ ​ An identification unit that analyzes the video data constituting the one work video file stored in the memory unit and automatically identifies the start timings of the plurality of elemental work processes as split start positions; A splitting unit that positions the video period from the previous start timing identified by the identification unit to the current start timing as one elemental work period video, splits the entire work video file into a plurality of elemental work period videos, and expands them to each display screen unit of the display unit; An editing unit that associates each of the elemental work period videos split by the splitting unit with a work procedure and stores it in the memory unit as a new work video file; A work video editing system using a video editing terminal including the above.

3. In the work video editing system according to Claim 2, The identification unit is Analyzing at least one of the audio signal or video signal included in the work video file, and automatically identifying the start timings of the plurality of elemental work processes when a predetermined condition is satisfied with reference to each signal database accumulated in the past. A work video editing system characterized by this.

4. In the work video editing system according to Claim 2, The operation unit is Using the split start position divided by the control unit to the next split start position as one split section, allowing the operator to edit the change or deletion of the split start position of the one split section, the resplit of the split section, the deletion of the split section or the deletion of any one after the resplit, and the change of the work title, and including one or more icons displayed on the display unit for this purpose. A work video editing system characterized by this.

5. A storage process of storing a series of work processes including a plurality of elemental work processes pre-shot for one person or one unit or one article as one work video file in a storage unit; An identification process of analyzing the video data constituting the one work video file stored in the storage unit and automatically identifying the start timings of the plurality of elemental work processes by an identification unit; A splitting process of positioning the video period from the previous start timing identified by the identification unit to the current start timing as one elemental work period video and splitting the entire work video file into a plurality of elemental work period videos by a splitting unit; An editing process of associating each of the element work period videos divided by the dividing unit with a work procedure in an editing unit and storing the result in the storage unit as a new work video file, the editing process including analyzing at least one of an audio signal or a video signal included in the work video file, and automatically identifying start timings of the plurality of element work steps when a predetermined condition is satisfied by referring to each signal database accumulated in the past. A video editing program for causing a video editing terminal having computer functions to execute. **Claim 6** A recording medium, on which the video editing program according to claim 5 is recorded and which is readable by a video editing terminal having computer functions.

Images