A video playback method and control system, electronic device and computer readable storage medium

Abstract

The application relates to a video playback method and a control system, electronic equipment and a computer readable storage medium, which comprises the following steps: in a video collection process, an event occurring is time-stamped, and an index file associated with the event is generated, the index file being capable of searching the time point of the event in the video through different index dimensions; in the video playback, the index file is parsed, and the mark is displayed in the form of an icon at the corresponding position of a video playing time axis, and the icon is linked with a preview box describing event information and capable of jumping to the time point of the corresponding event in the video; the icons corresponding to the events matched with different index dimensions are searched, and the video segment to be played is selected by clicking the icon through the preview box; the control system, the electronic equipment and the computer readable storage medium according to the method are disclosed. The application can meet the requirements of quick positioning and accurate revisit of important events in the video, and the efficiency is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of industrial endoscopes, in particular to an industrial endoscope video playback method and control system, electronic equipment and computer readable storage medium. BACKGROUND

[0002] At present, industrial endoscopes have been widely used for video inspection and troubleshooting of complex, narrow or directly visible device internal structure. The common industrial endoscope system is equipped with video function, which can record the complete inspection process for later playback analysis. However, the existing video playback technology mainly adopts time axis mode and relies on manual memory for positioning, which has the following significant defects: the user needs to repeatedly drag the progress bar or slow play the video to locate the key event or abnormal picture, the positioning efficiency is low; it is difficult to accurately remember the time position during playback; it is difficult to automatically identify and mark abnormal frames according to image content, resulting in high risk of missing key content; the user cannot retrieve and jump to the required video segment through multiple index dimensions. SUMMARY

[0003] In view of the existing deficiencies, the present application provides a video playback method and control system, electronic equipment and computer readable storage medium.

[0004] The technical scheme adopted by the present application to solve its technical problems is: a video playback method, comprising:

[0005] S1, in the video acquisition process, the event occurred is time stamped and an index file associated with the event is generated, which can retrieve the time point of the event in the video through different index dimensions, wherein the event is an abnormal condition detected by the industrial endoscope, and when multiple events occur in the acquired video, multiple events are combined in the order of event occurrence to generate an index file; the index dimension includes time, event type, keywords describing the event for event type;

[0006] S2, in the video playback, the index file is parsed and the mark is displayed in the form of an icon at the corresponding position of the video playback time axis, and the icon is linked with a preview box describing the event information and can jump to the time point of the corresponding event in the video, the preview box can jump to the position of the event occurrence time point in the video; the event information includes any multiple information of time stamp, event type, event description, event screenshot and event level;

[0007] S3, the icons corresponding to the events matched by different index dimensions are searched, and the video segment to be played is selected by clicking the icon through the preview box.

[0008] As preferred, S4 is further included to generate a report of the event information corresponding to the played video segment.

[0009] As preferred, the mark is inserted automatically by using an image recognition algorithm when an anomaly is detected during video capturing.

[0010] As preferred, the icons are classified by different shapes and / or colors according to different event types.

[0011] A control system of video playback, comprising:

[0012] A mark generating module for time-stamping an event occurred during video capturing and generating an index file associated with the event, which can retrieve the time point of the event in the video by different index dimensions, and when multiple events occurred in the captured video, the multiple events are combined in the order of event occurrence to generate an index file; the index dimensions include time, event type, and keywords for describing the event according to the event type;

[0013] A video playback module for parsing the index file during video playback and displaying the mark in the form of an icon at the corresponding position of the video playback time axis, and jumping to the video segment to be played based on the preview frame linked by the icon;

[0014] An interactive module for user to retrieve and select the video segment to be played;

[0015] A report generating module for generating a report of the information related to the event and exporting the report.

[0016] An electronic device comprising a memory for storing a computer program, and a processor for executing the computer program to implement the video playback method according to any one of the preceding embodiments.

[0017] A computer readable storage medium having a computer program stored thereon, the program being executed by a processor to implement the video playback method according to any one of the preceding embodiments.

[0018] The present application has the beneficial effect that the index file is generated while time-stamping is inserted during video capturing, and the index file is parsed during video playback to form an icon displayed on the time axis, which can be retrieved by different index dimensions and jumped to the video segment to be played, so that the important events in the video can be quickly located and accurately revisited, and the efficiency is improved. BRIEF DESCRIPTION OF DRAWINGS

[0019] Figure 1 is the principle block diagram of the playback method of the embodiment of the present application;

[0020] Figure 2is a structural block diagram of the control system of the embodiment of the present application;

[0021] The names and serial numbers of the components in the figure are as follows: 1, a mark generation module; 2, a video playback module; 3, an interaction module; and 4, a report generation module. DETAILED DESCRIPTION

[0022] In order to more clearly illustrate the purpose, technical scheme and advantages of the embodiments of the present application, the present application will be further described below in conjunction with the accompanying drawings and embodiments, and a clear and complete description will be made. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments of the present application, all other embodiments obtained by those of ordinary skill in the art without creative labor fall within the protection scope of the present application.

[0023] As shown in the embodiment of the present application, Figure 1 A video playback method comprises the following steps:

[0024] S1, in the video acquisition process, the event occurring is time-stamped, and an index file associated with the event is generated, which can retrieve the time point of the event in the video through different index dimensions, wherein the event is an abnormal condition detected by an industrial endoscope, the mark can be inserted manually, that is, inserted through a button, a voice command or a touch interface in the collected video, or automatically inserted by using an image recognition algorithm when an abnormality is detected in the video acquisition process, and the preferred way is automatic insertion; the abnormal condition is a difference between the detected product and the standard product, such as color abnormality, shape variation, cracks, corrosion marks, foreign matter and other conditions on the detected position; at the same time of inserting the mark, the time point related to the event, the position of the abnormality on the detected product, the characteristics and types of the abnormality, the severity of the abnormality and other factors are summarized to generate an index file, different factors form an index dimension, and the time point of the corresponding event in the video can be retrieved from different index dimensions; when multiple events occur in the collected video, multiple events are combined to generate an index file in the order of event occurrence, such as generating a.json file, which is convenient for subsequent parsing; the index dimensions include time, event type and keywords related to the event, the time is the time length of the current frame when the mark is inserted; the event type indicates what category the abnormality of the event belongs to, such as foreign matter, crack, surface corrosion, deformation, etc.; the keywords related to the event are the description of the event for the event type, such as whether the foreign matter is removable or not, the shape of the foreign matter, the size of the foreign matter, the position of the foreign matter in the detected object, the color of the foreign matter, etc.; for cracks, there are crack shape, crack size, crack severity, etc.

[0025] S2, when playing back the video, parsing the index file and displaying the mark in the form of icon at the corresponding position of the video playback time axis, and the icon is linked with a preview box describing the event information and capable of jumping to the time point of the corresponding event in the video; that is, when the video needs to be played back, the video file is selected first, and then the index file corresponding to the video is parsed, the time point of the corresponding event is parsed, and the mark is displayed in the form of icon at the corresponding position of the video playback time axis, the icons are classified according to different event types in different shapes and / or colors, such as vertical lines, triangles, arrows, etc. to correspondingly represent foreign matter, cracks, surface corrosion, or blue, red, orange to correspondingly represent foreign matter, cracks, surface corrosion, or a combination of shape and color is used for representation, in which the icon is used to represent the event type, and the color represents the severity of the event; at this time, the icon is linked with a preview box, and the preview box interface is displayed after the icon is clicked, and the corresponding event information is displayed in the preview box interface, the event information includes any multiple information of time stamp, event type, event description, event screenshot and event level, and the preview box is clicked to jump to the corresponding event time point in the video to play. In order to analyze the condition before the event occurs, the preview box can jump to the position of the event occurrence time point in the video, that is, the time point after the preview box is jumped is set to the position of the event occurrence time point minus a number of seconds, such as 2 seconds or 5 seconds.

[0026] S3, searching the icons corresponding to the events matched with the index dimensions by using different index dimensions, and selecting the video segment to be played by clicking the icon; when playing back the video, the index dimensions are used to retrieve the event to be played, and the icon matched with the index dimension retrieved is highlighted or enlarged to highlight the icon, and then the corresponding icon is clicked to enter the preview box, and the preview box is clicked to jump to the video segment to be played; when multiple events occur in a video, multiple icons matched with the single index dimension may be searched, and another index dimension is added to search simultaneously, so that the video segment to be played is searched, and rapid and accurate positioning and revisit are realized.

[0027] S4, generating a report of the event information corresponding to the played video segment to be exported, and the exported report can be reviewed by experts or quality inspected and archived, which facilitates subsequent work.

[0028] A video playback control system, as shown in Figure 2 , comprising:

[0029] The marking generation module 1 is used for time stamping an event occurring in a video collection process and generating an index file associated with the event, which can retrieve the time point of the event in the video through different index dimensions; wherein the event is an abnormal condition detected by an industrial endoscope, and the marking can be inserted in the collected video by means of a button, a voice instruction or a touch interface, or automatically inserted by using an image recognition algorithm to detect the abnormality in the video collection process; at the same time of inserting the marking, information related to the event is summarized to generate an index file, which can retrieve the time point of the corresponding event in the video from different index dimensions; when there are multiple events in the collected video, the multiple events are combined in the order of event occurrence to generate an index file, such as generating the index file as a.json file, which is convenient for subsequent parsing; the index dimensions include time, event type and keywords related to the event.

[0030] The video playback module 2 is used for parsing the index file and displaying the marking in the form of an icon at the corresponding position of the video playback time axis during video playback, and jumping to the video segment to be played based on the preview box linked by the icon; first, a video file is selected, then the index file corresponding to the video is parsed, the time point of the corresponding event is parsed, and the marking is displayed in the form of an icon at the corresponding position of the video playback time axis, the icon is linked with a preview box, and the preview box interface is displayed after the icon is clicked, the corresponding event information is displayed in the preview box interface, and the video is played at the time point of the corresponding event in the video after the preview box is clicked.

[0031] The interaction module 3 is used for a user to retrieve and select a video segment to be played.

[0032] The report generation module 4 is used for generating a report of event information corresponding to the played video segment.

[0033] An electronic device includes a memory for storing a computer program, and a processor for executing the computer program to implement the video playback method according to any one of the preceding.

[0034] A computer readable storage medium has a computer program stored thereon, wherein the program is executed by a processor to implement the video playback method according to any one of the preceding.

[0035] Although the present application has been described in detail above with general description and specific implementation, some modifications or improvements can be made on the basis of the present application, which is obvious to those skilled in the art. Therefore, these modifications or improvements made on the basis of not deviating from the spirit of the present application, all belong to the scope of the present application.

Claims

1. A video playback method, characterized in that, include: S1, during video acquisition, events are timestamped, and an index file associated with each event is generated, which can be retrieved through different index dimensions to find the time point of the event in the video. The event is an abnormality detected by an industrial endoscope. When multiple events occur in the acquired video, the multiple events are combined in the order of their occurrence to generate an index file. The index dimensions include time, event type, and keywords describing the event type. S2, during video playback, the index file is parsed and the markers are displayed as icons at the corresponding positions on the video playback timeline. The icons are linked to preview boxes that describe event information and can jump to the preview box at the time point of the corresponding event in the video. The preview box can jump to a position several seconds before the time point of the corresponding event in the video. The event information includes any multiple items of information such as timestamp, event type, event description, event screenshot, and event level. S3 uses different index dimensions to search for icons corresponding to events that match them, and clicking on the icon allows you to select the video segment to play through the preview box.

2. The video playback method according to claim 1, characterized in that, It also includes S4, which generates and exports a report of the event information corresponding to the video segment being played.

3. The video playback method according to claim 1, characterized in that, The markers are automatically inserted when an anomaly is detected during video capture using an image recognition algorithm.

4. The video playback method according to claim 1, characterized in that, The icons are categorized according to different event types, using different shapes and / or colors.

5. A video playback control system, characterized in that, include: The tag generation module is used to timestamp events that occur during video capture and generate an index file associated with each event, which can be retrieved through different index dimensions to find the time point of the event in the video. When multiple events occur in the captured video, the multiple events are combined in the order of their occurrence to generate an index file. The index dimensions include time, event type, and keywords describing the event for the event type. The video playback module is used to parse the index file during video playback and display the markers as icons at the corresponding positions on the video playback timeline. At the same time, the preview box linked by the icon jumps to the video segment to be played. The interactive module allows users to search for and select the video clips they want to play. The report generation module is used to generate reports from event-related information and export them.

6. An electronic device, characterized in that, include: Includes memory used to store computer programs; A processor for executing the computer program to implement the video playback method as described in any one of claims 1 to 4.

7. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the video playback method as described in any one of claims 1 to 4.

Images