Multimedia file control method and device

Abstract

The present application provides a multimedia file control method and device; the method includes: processing each multimedia sub-file included in the multimedia file separately, dividing each multimedia sub-file into at least one multimedia segment; determining the time information of each multimedia segment; receiving an operation request for a first multimedia segment; and adjusting the playback progress corresponding to the multimedia file based on the time information corresponding to the first multimedia segment in response to the operation request. The multimedia file control method and device provided by the present application can quickly and accurately play to the starting point of the target multimedia segment.

Description

Technical Field

[0001] The present application relates to computer technology, and in particular to a multimedia file control method and device. Background Art

[0002] With the rapid development of computer technology, the application scope of multimedia files is becoming more and more extensive, and the playback forms of multimedia files are becoming more and more diverse. In addition to online live broadcast, the playback forms of multimedia files also include offline playback. For the scenario of offline playback of multimedia files, how to quickly and accurately play to the starting point of the target multimedia segment is always the goal. Summary of the invention

[0003] The embodiments of the present application provide a multimedia file control method and device, which can quickly and accurately play to the starting point of a target multimedia segment.

[0004] The technical solution of the embodiment of the present application is implemented as follows:

[0005] The present application provides a multimedia file control method, including:

[0006] Processing each multimedia sub-file included in the multimedia file separately, and dividing each multimedia sub-file into at least one multimedia segment;

[0007] Determining time information of each of the multimedia segments;

[0008] receiving an operation request for a first multimedia segment;

[0009] In response to the operation request, the playback progress corresponding to the multimedia file is adjusted based on the time information corresponding to the first multimedia segment.

[0010] In some embodiments, the processing each multimedia sub-file included in the multimedia file separately and dividing each multimedia sub-file into at least one multimedia segment comprises:

[0011] Performing structural analysis on each of the multimedia sub-files to obtain a component structure of each of the multimedia sub-files;

[0012] Based on the composition structure of each multimedia sub-file, each multimedia sub-file is divided into at least one multimedia segment.

[0013] In some embodiments, performing structural analysis on each of the multimedia sub-files to obtain the composition structure of each of the multimedia sub-files includes:

[0014] Identifying the type of content included in each of the multimedia sub-files, wherein the type of content includes at least one or more of a table, a graphic, and a text;

[0015] The multimedia sub-files are divided based on the types of the contents to obtain at least one component structure of the multimedia sub-files.

[0016] In some embodiments, if the type of the content is text, performing structural analysis on each of the multimedia sub-files to obtain the composition structure of each of the multimedia sub-files includes:

[0017] identifying paragraphs comprised by the text;

[0018] Dividing the text based on the paragraphs to obtain at least two sub-texts;

[0019] Each of the sub-texts is determined to be a component structure of the multimedia sub-file.

[0020] In some embodiments, if the type of the content is an image, performing structural analysis on each of the multimedia sub-files to obtain the composition structure of each of the multimedia sub-files includes:

[0021] Segmenting the image to obtain at least two sub-images;

[0022] Each of the sub-images is determined to be a component structure of the multimedia sub-file.

[0023] In some embodiments, determining the time information for playing each of the multimedia segments includes:

[0024] Determine a start time for playing each of the multimedia segments.

[0025] In some embodiments, before receiving the operation request for the first multimedia segment, the method further includes:

[0026] All multimedia sub-files included in the multimedia file are displayed in the form of an image list.

[0027] In some embodiments, the receiving an operation request for the first multimedia segment includes:

[0028] An operation of receiving a first mark on an image corresponding to the first multimedia clip is received.

[0029] In some embodiments, adjusting the playback progress of the multimedia file based on the time information corresponding to the first multimedia segment includes:

[0030] Determining a first start time for playing the first multimedia segment;

[0031] The playing progress of the multimedia file is adjusted to the first starting time.

[0032] The embodiment of the present application provides a multimedia file control device, the multimedia file control device comprising:

[0033] A processing module, configured to process each multimedia sub-file included in the multimedia file respectively, and divide each multimedia sub-file into at least one multimedia segment;

[0034] A determination module, used to determine the time information of each of the multimedia segments;

[0035] A receiving module, configured to receive an operation request for a first multimedia segment;

[0036] The adjustment module is used to adjust the playback progress of the multimedia file based on the time information corresponding to the first multimedia segment in response to the operation request.

[0037] In some embodiments, the processing module is used to perform structural analysis on each of the multimedia sub-files to obtain a component structure of each of the multimedia sub-files;

[0038] Based on the composition structure of each multimedia sub-file, each multimedia sub-file is divided into at least one multimedia segment.

[0039] In some embodiments, the processing module is used to identify the type of content included in each of the multimedia sub-files, wherein the type of content includes at least one or more of a table, a graphic, and a text;

[0040] The multimedia sub-files are divided based on the types of the contents to obtain at least one component structure of the multimedia sub-files.

[0041] In some embodiments, the processing module is used to identify paragraphs included in the text;

[0042] Dividing the text based on the paragraphs to obtain at least two sub-texts;

[0043] Each of the sub-texts is determined to be a component structure of the multimedia sub-file.

[0044] In some embodiments, the processing module is used to segment the image to obtain at least two sub-images;

[0045] Each of the sub-images is determined to be a component structure of the multimedia sub-file.

[0046] In some embodiments, the determination module is used to determine the start time of playing each of the multimedia segments.

[0047] In some embodiments, the multimedia file control device further includes:

[0048] The display module is used to display all multimedia sub-files included in the multimedia file in the form of an image list.

[0049] In some embodiments, the receiving module is used to receive an operation on a first marker on an image corresponding to the first multimedia segment.

[0050] In some embodiments, the adjustment module is used to determine a first start time for playing the first multimedia segment;

[0051] The playing progress of the multimedia file is adjusted to the first starting time.

[0052] An embodiment of the present application provides an electronic device, including:

[0053] A memory for storing executable instructions;

[0054] The processor is used to implement the multimedia file control method provided in the embodiment of the present application when executing the executable instructions stored in the memory.

[0055] An embodiment of the present application provides a computer-readable storage medium storing executable instructions for implementing the multimedia file control method provided in the embodiment of the present application when executed by a processor.

[0056] The multimedia file control method provided in the embodiment of the present application processes each multimedia sub-file included in the multimedia file separately, divides each multimedia sub-file into at least one multimedia segment; determines the time information of each multimedia segment; receives an operation request for a first multimedia segment; and in response to the operation request, adjusts the corresponding playback progress of the multimedia file based on the time information corresponding to the first multimedia segment. In this way, by dividing each multimedia sub-file into at least one multimedia segment and determining the time information of each multimedia segment, when the user requests to play the first multimedia segment, the time information of the first multimedia segment can be determined, and the playback progress of the multimedia file can be adjusted to the time position corresponding to the time information of the first multimedia segment, thereby achieving fast and accurate playback to the starting point of the target multimedia segment. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] Figure 1 This is a schematic diagram of an optional processing flow of the multimedia file control method provided in an embodiment of the present application;

[0058] Figure 2It is a schematic diagram of a specific implementation process of processing each multimedia sub-file included in a multimedia file separately and dividing each multimedia sub-file into at least one multimedia segment provided by an embodiment of the present application;

[0059] Figure 3 It is a schematic diagram of a specific processing process of performing structural analysis on each multimedia sub-file to obtain the composition structure of each multimedia sub-file provided by an embodiment of the present application;

[0060] Figure 4 is a schematic diagram of displaying all multimedia sub-files included in a multimedia file in the form of an image list provided by an embodiment of the present application;

[0061] Figure 5 is a schematic diagram of multimedia segments and the start time of playing the multimedia segments provided in an embodiment of the present application;

[0062] Figure 6 is a schematic diagram of a multimedia sub-file provided in an embodiment of the present application;

[0063] Figure 7 It is a schematic diagram of the structure of a multimedia file control device provided in an embodiment of the present application;

[0064] Figure 8 It is a schematic diagram of the hardware composition structure of the electronic device provided in the embodiment of the present application. DETAILED DESCRIPTION

[0065] In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings. The described embodiments should not be regarded as limiting the present application. All other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of this application.

[0066] In the following description, reference is made to “some embodiments”, which describe a subset of all possible embodiments, but it can be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0067] In the following description, the terms "first\second\third" are only used to distinguish similar objects, and do not represent a specific order of the objects. It is understandable that "first\second\third" can be interchanged with a specific order or sequence where permitted, so that the embodiments of the present application described here can be implemented in an order other than that illustrated or described here. In the following description, the term "multiple" refers to at least two.

[0068] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0069] In the related art, multimedia files may include video files corresponding to video recorded classes, or video files corresponding to lectures, or PPT files corresponding to meetings, etc. When it is necessary to play back a multimedia file, the playback progress of the multimedia file can be adjusted to a specified playback time point by indexing the images in the multimedia file; however, the indexing granularity using images as indexes is relatively coarse, and the playback progress of the multimedia file cannot be accurately adjusted to the specified playback time point. The playback progress of the multimedia file can also be adjusted to a specified playback time point by indexing the marking points on the progress bar of the multimedia file; however, the information about the multimedia file provided by the marking points on the progress bar is not intuitive, and the playback progress of the multimedia file cannot be accurately adjusted to the specified playback time point with a finer granularity.

[0070] The multimedia file control method and device provided in the embodiments of the present application can quickly and accurately play to the starting point of the target multimedia segment.

[0071] An optional processing flow of the multimedia file control method provided in the embodiment of the present application is as follows: Figure 1 As shown, it can at least include the following steps:

[0072] Step S101: Process each multimedia sub-file included in the multimedia file separately, and divide each multimedia sub-file into at least one multimedia segment.

[0073] In some embodiments, the multimedia file may be a video file or an audio file to be played. As an example, the multimedia file may be a video file of an online recorded course, or a lecture, or a meeting, and the content of the video file may be a blackboard or a PPT file of the online recorded course. A multimedia subfile may be a part of a multimedia file, and all multimedia subfiles constitute a complete multimedia file. Taking the multimedia file as an example that the multimedia file may be a video file of an online recorded course, or a lecture, or a meeting, and the content of the video file may be a blackboard or a PPT file of an online recorded course, the multimedia subfile may be a page in the blackboard or a page in a PPT file. A multimedia clip may be a part of the content in a multimedia subfile, and a multimedia subfile includes one or more multimedia clips; taking the multimedia subfile as an example that the multimedia subfile is a page in the blackboard or a page in a PPT file, the content of the page may be divided into multiple parts, each part representing different content or types, such as the first part is a formula, the second part is a graphic, the third part is text, etc.

[0074] In some embodiments, each multimedia sub-file included in the multimedia file is processed separately, and each multimedia sub-file is divided into at least one multimedia segment. Figure 2 As shown, it may include at least:

[0075] Step S101a, performing structural analysis on each multimedia sub-file to obtain the component structure of each multimedia sub-file.

[0076] In some embodiments, a structural analysis is performed on each multimedia sub-file to obtain a specific processing process of the composition structure of each multimedia sub-file, such as Figure 3 As shown, it may include at least:

[0077] Step S101a1, identifying the type of content included in each multimedia sub-file.

[0078] In some embodiments, optical character recognition (OCR) and layout analysis may be performed on each multimedia sub-file to obtain the type of content included in each multimedia sub-file. The type of content includes at least one or more of a table, a graphic, and a text.

[0079] Step S101a2: dividing the multimedia sub-files based on the types of the contents to obtain at least one component structure of the multimedia sub-files.

[0080] In some embodiments, when performing layout analysis on a multimedia subfile, structural analysis, paragraph segmentation, and image segmentation, etc., can be performed on the multimedia subfile according to the type of content included in the multimedia subfile. One type of content is used as one or more component structures of the multimedia subfile. As an example, if one type of content included in the multimedia subfile is a table, the table is used as a component structure of the multimedia subfile.

[0081] In some embodiments, if one type of content included in the multimedia sub-file is text, the text is taken as a component structure of the multimedia sub-file; or, the paragraphs included in the text are further identified, and the text is divided based on the paragraphs to obtain at least two sub-texts, and each of the sub-texts is determined to be a component structure of the multimedia sub-file; or, the text is semantically analyzed according to the reading order, the text is divided into multiple paragraphs, and each paragraph is taken as a component structure of the multimedia sub-file.

[0082] In some embodiments, if the type of the content is an image, the image is segmented to obtain at least two sub-images; and each sub-image is determined to be a component structure of the multimedia sub-file.

[0083] Step S101b: dividing each multimedia sub-file into at least one multimedia segment based on the composition structure of each multimedia sub-file.

[0084] In some embodiments, a component structure of a multimedia sub-file is a multimedia segment of the multimedia sub-file. If the multimedia sub-file includes N component structures, then the multimedia sub-file includes N multimedia segments, where N is a positive integer.

[0085] Step S102: determining the time information of each multimedia segment.

[0086] In some embodiments, the time information of the multimedia segment may refer to the start time of playing the multimedia segment, which may also be referred to as the start play point of the multimedia segment.

[0087] In other embodiments, the time information of the multimedia segment may also refer to a time point of a preset time interval earlier than the start time of playing the multimedia segment. As an example, if the start time of playing the multimedia segment is the Nth second, the time information of the multimedia segment may be the (NM)th second, where N>M, and the value of M may be flexibly set according to the total duration of playing the multimedia file.

[0088] Step S103: receiving an operation request for the first multimedia clip.

[0089] In some embodiments, before receiving the operation request for the first multimedia segment, the method further includes: displaying all multimedia sub-files included in the multimedia file in the form of an image list.

[0090] For example, a multimedia file may be a video file of an online recorded course, or a lecture, or a meeting, and the content of the video file may be a blackboard book or a PPT file of an online recorded course, and a multimedia subfile may be a page in a blackboard book or a page in a PPT file. Each page of the multimedia subfile corresponds to an image in the image list; if the number of multimedia subfiles is M, then the image list includes M images, each image corresponds to a multimedia subfile, and each image may be a thumbnail of a multimedia subfile. A schematic diagram showing all multimedia subfiles included in a multimedia file in the form of an image list, such as Figure 4 As shown, the teaching video includes three pages of blackboard books, which are displayed in the form of an image list; each image in the image list corresponds to a page of blackboard books, and each image is a thumbnail of a page of blackboard books. By displaying multimedia sub-files in the form of an image list, the multimedia sub-files can be intuitively presented in the form of two-dimensional images, making it easy to quickly find the multimedia sub-files to be played.

[0091] In some embodiments, receiving an operation request for a first multimedia segment may refer to receiving an operation for a first identifier on an image corresponding to the first multimedia segment. The first identifier may also be referred to as a time index of the first multimedia segment, and the first identifier corresponds to a first start time of playing the first multimedia segment; by clicking or touching the first identifier, the first start time of playing the first multimedia segment can be determined. Correspondingly, each multimedia segment has a corresponding identifier, and by clicking or touching the identifier, the start time of playing the multimedia segment corresponding to the identifier can be determined. In this way, by establishing a corresponding relationship between the identifier and the start time of the multimedia segment, when the identifier is clicked or touched, the start time of the multimedia segment can be accurately determined with a finer granularity. The schematic diagram of the multimedia segment and the start time of playing the multimedia segment is as shown in FIG. Figure 5 As shown, each multimedia segment corresponds to a start time for playing the multimedia segment. In the embodiment of the present application, the form or style of the identifier corresponding to the multimedia segment is not limited.

[0092] Step S104: in response to the operation request, adjusting the playback progress corresponding to the multimedia file based on the time information corresponding to the first multimedia segment.

[0093] In some embodiments, in response to the operation request, if the time information corresponding to the first multimedia segment is the first actual time for playing the first multimedia segment, the first start time for playing the first multimedia segment is determined according to the first identifier corresponding to the operation request, and the playback progress of the multimedia file is adjusted to the first start time. In this way, by clicking or touching the first identifier, the playback progress can be directly jumped to the first start time of the multimedia segment corresponding to the first identifier, and the playback progress of the multimedia segment can be adjusted with finer granularity.

[0094] In some embodiments, in response to an operation request, if the time information corresponding to the first multimedia clip is a time point that is a preset time interval earlier than the first start time, then according to the first identifier corresponding to the operation request, the playback progress of the multimedia file is adjusted to a time point that is earlier than the first start time and is a preset time interval away from the first start time. In this way, by clicking or touching the first identifier, the playback progress can be adjusted to a time point that is a preset time interval earlier than the first start time, ensuring that the complete first multimedia clip can be played, thereby improving the user experience.

[0095] In the embodiment of the present application, an identifier corresponding to each multimedia segment is constructed, and an index relationship between the identifier and the start time of playing the multimedia segment is established. By clicking or touching the identifier, the start time of playing the multimedia segment corresponding to the identifier can be determined, and the playback position of the multimedia file is adjusted to the start time determined according to the identifier. In this way, the start time of the multimedia segment can be accurately determined with finer granularity.

[0096] Below Figure 6 Taking the multimedia sub-file shown as an example, the implementation process of the multimedia file control method provided in the embodiment of the present application is explained. Figure 6 The multimedia sub-file shown is a page of blackboard writing; according to Figure 6 The multimedia sub-file shown in FIG. 1 is structurally analyzed, and it can be determined that the multimedia sub-file includes seven component structures according to the graphics, formulas and paragraphs included in the multimedia sub-file, and each component structure corresponds to a multimedia segment. Figure 6 The multimedia sub-file shown includes seven multimedia segments, namely, multimedia segment 1, multimedia segment 2, multimedia segment 3, multimedia segment 4, multimedia segment 5, multimedia segment 6 and multimedia segment 7. Each multimedia segment corresponds to an identifier, multimedia segment 1 corresponds to identifier 1, multimedia segment 2 corresponds to identifier 2, multimedia segment 3 corresponds to identifier 3, multimedia segment 4 corresponds to identifier 4, multimedia segment 5 corresponds to identifier 5, multimedia segment 6 corresponds to identifier 6 and multimedia segment 7 corresponds to identifier 7, and each identifier is displayed on the thumbnail of the corresponding multimedia segment. Each identifier can be used as an index of the start time of playing the multimedia segment. Identifier 1 can be used as index 1 of the start time of playing the multimedia segment 1, identifier 2 can be used as index 2 of the start time of playing the multimedia segment 2, identifier 3 can be used as index 3 of the start time of playing the multimedia segment 3, identifier 4 can be used as index 4 of the start time of playing the multimedia segment 4, identifier 5 can be used as index 5 of the start time of playing the multimedia segment 5, identifier 6 can be used as index 6 of the start time of playing the multimedia segment 6, and identifier 7 can be used as index 7 of the start time of playing the multimedia segment 7. By clicking or touching identifier 1, the start time of playing the multimedia segment 1 can be determined, and the playback progress of the multimedia file can be adjusted to the start time of the multimedia segment 1.

[0097] The embodiment of the present application also provides a multimedia file control device, and the composition structure diagram of the multimedia file control device can be as follows: Figure 7 As shown, including:

[0098] The processing module 501 is used to process each multimedia sub-file included in the multimedia file separately, and divide each multimedia sub-file into at least one multimedia segment;

[0099] A determination module 502, configured to determine time information of each of the multimedia segments;

[0100] The receiving module 503 is configured to receive an operation request for the first multimedia segment;

[0101] The adjustment module 504 is configured to adjust the playback progress of the multimedia file based on the time information corresponding to the first multimedia segment in response to the operation request.

[0102] In some embodiments, the processing module 501 is used to perform structural analysis on each of the multimedia sub-files to obtain a component structure of each of the multimedia sub-files;

[0103] Based on the composition structure of each multimedia sub-file, each multimedia sub-file is divided into at least one multimedia segment.

[0104] In some embodiments, the processing module 501 is used to identify the type of content included in each of the multimedia sub-files, where the type of content includes at least one or more of a table, a graphic, and a text;

[0105] The multimedia sub-files are divided based on the types of the contents to obtain at least one component structure of the multimedia sub-files.

[0106] In some embodiments, the processing module 501 is used to identify paragraphs included in the text;

[0107] Dividing the text based on the paragraphs to obtain at least two sub-texts;

[0108] Each of the sub-texts is determined to be a component structure of the multimedia sub-file.

[0109] In some embodiments, the processing module 501 is used to segment the image to obtain at least two sub-images;

[0110] Each of the sub-images is determined to be a component structure of the multimedia sub-file.

[0111] In some embodiments, the determination module 502 is used to determine the start time of playing each of the multimedia segments.

[0112] In some embodiments, the multimedia file control device further includes:

[0113] The display module 505 is used to display all multimedia sub-files included in the multimedia file in the form of an image list.

[0114] In some embodiments, the receiving module 503 is configured to receive an operation on a first mark on an image corresponding to the first multimedia segment.

[0115] In some embodiments, the adjustment module 504 is configured to determine a first start time for playing the first multimedia segment;

[0116] The playing progress of the multimedia file is adjusted to the first starting time.

[0117] In some embodiments, the multimedia file control method provided in the embodiments of the present application can be implemented by a terminal device or a server. Specifically, the terminal device or server can implement the multimedia file control method provided in the embodiments of the present application by running a computer program. For example, the computer program can be a native program or software module in the operating system; it can be a native application (APP, Application), that is, a program that needs to be installed in the operating system to run; it can also be a small program, that is, a program that can be run only by downloading it to a browser environment; it can also be a small program that can be embedded in any APP. In short, the above-mentioned computer program can be an application, module or plug-in in any form.

[0118] In some embodiments, the server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms, where cloud technology refers to a hosting technology that unifies a series of resources such as hardware, software, and networks in a wide area network or a local area network to achieve data calculation, storage, processing, and sharing. The terminal device can be a smart phone, a tablet computer, a laptop computer, a desktop computer, etc., but is not limited to this. The terminal device and the server can be directly or indirectly connected via wired or wireless communication, which is not limited in the embodiments of the present application.

[0119] Taking the data processing method provided in the embodiment of the present application as an electronic device as an example, the hardware composition structure diagram of the electronic device 700 provided in the embodiment of the present application is as follows: Figure 8 The electronic device 700 shown includes: at least one processor 701, a memory 702 and at least one network interface 704. The various components in the electronic device 700 are coupled together via a bus system 705. It is understood that the bus system 705 is used to achieve connection and communication between these components. In addition to the data bus, the bus system 705 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, the bus system 705 is not described in detail. Figure 8 Various buses are labeled as bus system 705 .

[0120] It can be understood that the memory 702 can be a volatile memory or a non-volatile memory, and can also include both volatile and non-volatile memories. Among them, the non-volatile memory can be ROM, programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), magnetic random access memory (FRAM), ferromagnetic random access memory, flash memory, magnetic surface memory, optical disk, or compact disc read-only memory (CD-ROM); the magnetic surface memory can be a disk memory or a tape memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static random access memory (SRAM), synchronous static random access memory (SSRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), direct memory bus random access memory (DRRAM). The memory 702 described in the embodiments of the present application is intended to include but is not limited to these and any other suitable types of memory.

[0121] The memory 702 in the embodiment of the present application is used to store various types of data to support the operation of the electronic device 700. Examples of such data include: any computer program for operating on the electronic device 700, such as the application 7022. The program for implementing the multimedia file control method in the embodiment of the present application may be included in the application 7022.

[0122] The method disclosed in the above embodiment of the present application can be applied to the processor 701, or implemented by the processor 701. The processor 701 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit in the processor 701 or the instruction in the form of software. The above processor 701 can be a general processor, a digital signal processor (DSP, Digital Signal Processor), or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The processor 701 can implement or execute the various methods, steps and logic block diagrams disclosed in the embodiment of the present application. The general processor can be a microprocessor or any conventional processor, etc. In combination with the steps of the multimedia file control method disclosed in the embodiment of the present application, it can be directly embodied as a hardware decoding processor to execute, or it can be executed by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium, which is located in the memory 702, and the processor 701 reads the information in the memory 702, and completes the steps of the aforementioned multimedia file control method in combination with its hardware.

[0123] In an exemplary embodiment, the electronic device 700 may be implemented by one or more application specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), FPGAs, general purpose processors, controllers, MCUs, MPUs, or other electronic components to execute the aforementioned multimedia file control method.

[0124] The embodiment of the present application provides a computer program product or a computer program, which includes a computer instruction stored in a computer-readable storage medium. The processor of the computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes the multimedia file control method described in the embodiment of the present application.

[0125] The present application embodiment provides a computer-readable storage medium storing executable instructions, wherein the executable instructions are stored. When the executable instructions are executed by a processor, the processor will execute the multimedia file control method provided by the present application embodiment, for example, Figures 1 to 6 The multimedia file control method is shown.

[0126] In some embodiments, the computer-readable storage medium may be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash memory, magnetic surface storage, optical disk, or CD-ROM; or it may be various devices including one or any combination of the above memories.

[0127] In some embodiments, executable instructions may be in the form of a program, software, software module, script or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including as a stand-alone program or as a module, component, subroutine or other unit suitable for use in a computing environment.

[0128] As an example, executable instructions may, but need not, correspond to a file in a file system, may be stored as part of a file that stores other programs or data, such as in one or more scripts in a HyperText Markup Language (HTML) document, in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files storing one or more modules, subroutines, or code portions).

[0129] By way of example, executable instructions may be deployed to be executed on one computing device, or on multiple computing devices located at one site, or on multiple computing devices distributed across multiple sites and interconnected by a communication network.

[0130] The above are only embodiments of the present application and are not intended to limit the protection scope of the present application. Any modifications, equivalent substitutions and improvements made within the spirit and scope of the present application are included in the protection scope of the present application.

Claims

1. A multimedia file control method, the method comprising: Processing each multimedia subfile included in the multimedia file separately, dividing each multimedia subfile into at least one multimedia segment, the multimedia file is a video file, the content of the multimedia file is a blackboard book or a PPT file, and the multimedia subfile is a page in the blackboard book or the PPT file; Determining time information of each of the multimedia segments; receiving an operation request for a first multimedia segment; In response to the operation request, adjusting the playback progress corresponding to the multimedia file based on the time information corresponding to the first multimedia segment; The processing of each multimedia sub-file included in the multimedia file separately and dividing each multimedia sub-file into at least one multimedia segment includes: Performing structural analysis on each of the multimedia sub-files to obtain a component structure of each of the multimedia sub-files; Based on the composition structure of each multimedia sub-file, dividing each multimedia sub-file into at least one multimedia segment; The structural analysis of each multimedia sub-file to obtain the composition structure of each multimedia sub-file includes: Identifying the type of content included in each of the multimedia sub-files, wherein the type of content includes at least one or more of a table, a graphic, and a text; The multimedia sub-files are divided based on the types of the contents to obtain at least one component structure of the multimedia sub-files.

2. According to the method of claim 1, if the type of the content is text, the structural analysis of each of the multimedia sub-files to obtain the composition structure of each of the multimedia sub-files comprises: identifying paragraphs comprised by the text; Dividing the text based on the paragraphs to obtain at least two sub-texts; Each of the sub-texts is determined to be a component structure of the multimedia sub-file.

3. According to the method of claim 1, if the type of the content is an image, the structural analysis of each of the multimedia sub-files to obtain the composition structure of each of the multimedia sub-files comprises: Segmenting the image to obtain at least two sub-images; Each of the sub-images is determined to be a component structure of the multimedia sub-file.

4. The method according to claim 1, wherein determining the time information for playing each of the multimedia segments comprises: Determine a start time for playing each of the multimedia segments.

5. The method according to claim 1, before receiving the operation request for the first multimedia segment, the method further comprises: All multimedia sub-files included in the multimedia file are displayed in the form of an image list.

6. The method according to claim 5, wherein receiving an operation request for the first multimedia segment comprises: An operation of receiving a first mark on an image corresponding to the first multimedia clip is received.

7. The method according to claim 1, 5 or 6, wherein adjusting the playing progress of the multimedia file based on the time information corresponding to the first multimedia segment comprises: Determining a first start time for playing the first multimedia segment; The playing progress of the multimedia file is adjusted to the first starting time.

8. A multimedia file control device, the device comprising: A processing module, used for processing each multimedia sub-file included in the multimedia file respectively, dividing each multimedia sub-file into at least one multimedia segment, wherein the multimedia file is a video file, the content of the multimedia file is a blackboard book or a PPT file, and the multimedia sub-file is a page in the blackboard book or the PPT file; A determination module, used to determine the time information of each of the multimedia segments; A receiving module, configured to receive an operation request for a first multimedia segment; an adjustment module, configured to adjust the playback progress of the multimedia file based on the time information corresponding to the first multimedia segment in response to the operation request; The processing module is specifically used to perform structural analysis on each of the multimedia sub-files to obtain the composition structure of each of the multimedia sub-files; based on the composition structure of each of the multimedia sub-files, divide each of the multimedia sub-files into at least one multimedia segment; Among them, the processing module is specifically used to identify the type of content included in each of the multimedia sub-files, and the type of content includes at least one or more of tables, graphics and texts; divide the multimedia sub-files based on the type of content to obtain at least one component structure of the multimedia sub-files.

Images