A processing method and apparatus, electronic device, and storage medium
By generating a progress bar for multimedia files using a media player, the problem of cumbersome operations for locating and playing points of interest in multimedia files in existing technologies is solved, achieving an efficient user experience and fast playback location.
Patent Information
- Application Number
- CN202211216782.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-09-30
- Publication Date
- 2026-02-27
- Estimated Expiration
- 2042-09-30
AI Technical Summary
In existing technologies, quickly locating and playing specific points of interest in multimedia files is cumbersome and time-consuming, resulting in a poor user experience, especially when playing videos, making it difficult to efficiently find content of interest.
The media player parses multimedia files to generate a progress bar containing multiple target areas. Each target area contains a target character group. The progress bar is generated based on sensor parameters, target information, or intelligent engine processing, adapting to different device forms and content formats to achieve fast positioning and playback.
It improves user operation efficiency, reduces user operation steps, enhances user experience, and enables quick location and playback of content of interest in multimedia files.
Smart Images

Figure CN115567758B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of Internet, and relates to but is not limited to a processing method and device, an electronic device and a storage medium. BACKGROUND
[0002] Video shooting is becoming more and more frequent in people's daily life and communication. Since a video has a certain time length, how to quickly locate and play a specific "interest point" in the video is a common pain point. SUMMARY
[0003] Therefore, the embodiments of the present application provide at least a processing method and device, an electronic device and a storage medium.
[0004] The technical scheme of the embodiments of the present application is implemented as follows:
[0005] The embodiments of the present application provide a processing method, which comprises:
[0006] obtaining a multimedia file;
[0007] analyzing the multimedia file by a media player to play the multimedia file;
[0008] analyzing the multimedia file by a media player to generate a progress bar for the multimedia file, the progress bar being used to indicate a time index of the multimedia file, the progress bar comprising a plurality of target regions, the plurality of target regions being continuous regions; each target region comprising a target character group, each target character group comprising at least one character, the target character group being related to the content of the time interval of the multimedia file in the target region where the target character is located.
[0009] In some embodiments, a sensing parameter is obtained;
[0010] determining that the progress bar comprises a plurality of target regions based on the sensing parameter;
[0011] If the sensing parameter represents a first use mode, a first number of target regions is determined.
[0012] If the sensing parameter represents a second use mode, a second number of target regions is determined.
[0013] The first use mode is different from the second use mode, and the first number is different from the second number.
[0014] In some embodiments, the analyzing the multimedia file by a media player to generate a progress bar for the multimedia file comprises:
[0015] obtaining target information contained in the multimedia file;
[0016] generating a progress bar for the multimedia file based on the target information; the target information comprises: a number of target regions and target character groups corresponding to the target regions.
[0017] In some embodiments, the generating the progress bar for the multimedia file by the media player comprises:
[0018] if the target information is not obtained from the multimedia file, processing the multimedia file by an intelligent engine to generate the target information;
[0019] generating a progress bar for the multimedia file based on the target information; the target information comprises: a number of target regions and target character groups corresponding to the target regions.
[0020] In some embodiments, the processing the multimedia file by the intelligent engine to generate the target information comprises:
[0021] obtaining target content of the multimedia file;
[0022] generating the target information based on the target content;
[0023] wherein, if the target content satisfies a first condition, it is determined that the target information comprises a first number of target regions and target character groups corresponding to the target regions;
[0024] if the target content satisfies a second condition, it is determined that the target information comprises a second number of target regions and target character groups corresponding to the target regions;
[0025] the first condition is different from the second condition, and the first number is different from the second number.
[0026] In some embodiments, the method further comprises:
[0027] obtaining a target parameter of the target content;
[0028] generating the target information based on the target parameter;
[0029] wherein, if the target parameter represents a first aspect ratio, it is determined that the first number of target regions;
[0030] if the target parameter represents a second aspect ratio, it is determined that the second number of target regions;
[0031] the first aspect ratio is different from the second aspect ratio.
[0032] In some embodiments, the processing the multimedia file by the intelligent engine to generate the target information comprises:
[0033] obtaining a pixel image of the multimedia file;
[0034] processing the pixel image by using a target algorithm to obtain description information of the pixel image;
[0035] determining a number of segments in the multimedia file and brief information of each segment based on the description information;
[0036] taking the number of segments as the number of target regions and taking the brief information of each segment as a target character group corresponding to the target region.
[0037] Embodiments of the present application provide a processing device, comprising:
[0038] an obtaining module configured to obtain a multimedia file;
[0039] a playing module configured to parse the multimedia file by a media player to play the multimedia file;
[0040] a generating module configured to parse the multimedia file by a media player to generate a progress bar for the multimedia file, the progress bar being used to indicate a time index of the multimedia file, the progress bar comprising a plurality of target regions, the plurality of target regions being continuous regions; each target region comprising a target character group, each target character group comprising at least one character, the target character group being related to content of a time interval of the multimedia file in which the target character group is located.
[0041] Embodiments of the present application provide an electronic device, comprising: a memory configured to store executable instructions; and a processor configured to execute the executable instructions stored in the memory to implement the above processing method.
[0042] Embodiments of the present application provide a computer readable storage medium having a computer program stored thereon, the computer program being executed by a processor to implement the above processing method.
[0043] Embodiments of the present application provide a computer program product, the computer program product comprising executable instructions stored in a computer readable storage medium; when a processor of a processing device reads the executable instructions from the computer readable storage medium and executes the executable instructions, the above processing method is implemented. BRIEF DESCRIPTION OF DRAWINGS
[0044] Figure 1 A flow implementation schematic diagram of a processing method provided by embodiments of the present application is shown.
[0045] Figure 2 A schematic diagram of the embodiment of the present application for playing a video file full screen through a media player analyzing the video file;
[0046] Figure 3 A schematic diagram of the embodiment of the present application for playing a video file full screen through a media player analyzing the video file;
[0047] Figure 4 A schematic diagram of the structure of the processing device provided by the embodiment of the present application;
[0048] Figure 5 A schematic diagram of the structure of the electronic device provided by the embodiment of the present application. DETAILED DESCRIPTION
[0049] The exemplary embodiments of the present application will be described more fully hereinafter with reference to the accompanying drawings. Like reference numerals can be used to refer to like elements throughout. The purpose of the exemplary embodiments of the present application is to enable any person skilled in the art to practice the present application, and not to limit the scope of the present application. It is to be understood that the present application is not limited in its application to the details set forth in the description contained herein or illustrated in the drawings. The present application is capable of implementation in various forms and of being practiced or carried out in various ways. Also, it is to be understood that the phraseology and terminology employed herein are for the purpose of description and should not be regarded as limiting.
[0050] In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application. However, it will be apparent to one skilled in the art that the present application can be practiced without one or more of these specific details. In other instances, well-known features have not been described in detail to avoid obscuring the present application. As used herein, the term "including" means including without limitation.
[0051] Video shooting is becoming more and more frequent in people's daily life and communication. Since a video has a certain length, how to quickly locate and play a certain "interest point" in the video is a common pain point.
[0052] The general solution is: 1, playing a video; 2, sliding or fast-forwarding a play progress bar in a large range to roughly find a "target area"; 3, fine-tuning the position of the progress bar back and forth to locate the "interest point" starting time point. The disadvantage of this method is: time-consuming, laborious, and the whole operation process needs to be repeated next time.
[0053] A higher level solution is: 1, learn video editing software, such as "Adobe Premiere", "fast cut"; 2, import the original video through the video editing software, and add the video introduction by segment through the interface and menu provided by the software. The disadvantages of this method are: 1, the cognitive level of the user is required to be high, and the user needs to have the ability to learn and master the use method of professional video editing software; 2, the operation steps are many and very cumbersome; 3, the device specification requirement for editing video is very high; 4, the time consumption of the secondary generated video is long.
[0054] Therefore, it is urgent to propose a new solution to quickly locate and play the content of interest, reduce user operation, and improve efficiency and user experience.
[0055] Based on the problems in the related art, the embodiment of the present application provides a processing method, which analyzes the multimedia file through a media player to play the multimedia file and analyzes the multimedia file through the media player to generate a progress bar for the multimedia file, the progress bar is used to indicate the time index of the multimedia file, the progress bar includes a plurality of target areas, and the plurality of target areas are continuous areas; each target area includes a target character group, each target character group includes at least one character, and the target character group is related to the content of the time interval of the multimedia file in the target area where the target character is located, that is, the time index of the multimedia file is indicated by the progress bar, the content of the time interval of the multimedia file corresponding to the target area in the progress bar is quickly located and played, the user operation is less, the efficiency is high, and the use satisfaction of the user is improved
[0056] The following describes an exemplary application of the processing method provided by the embodiment of the present application, Figure 1 The flow implementation schematic diagram of the processing method provided by the embodiment of the present application is shown in Figure 3 The processing method provided by the embodiment of the present application is implemented through steps S101 to S103:
[0057] Step S101: obtaining a multimedia file.
[0058] In the embodiment of the present application, the processing method can be applied to an electronic device, which can be a terminal with a user operation interface such as a mobile phone, a notebook computer, a desktop computer, a tablet computer, a vehicle-mounted computer, etc.
[0059] It should be noted that the multimedia file can be determined according to actual conditions, which is not limited here. As an example, the multimedia file can include an audio file and / or a video file.
[0060] Step S102: analyzing the multimedia file through a media player to play the multimedia file.
[0061] In the embodiments of the present application, the media player can also be referred to as a media player, which can be a multimedia playing software in an electronic device, and can be used to play multimedia, to gather decoders together, and to generate a playing function. The specific type of the media player can be determined according to actual conditions, and is not limited herein.
[0062] Step S103: parsing the multimedia file by the media player to generate a progress bar for the multimedia file, the progress bar being used to indicate a time index of the multimedia file, the progress bar including a plurality of target areas, the plurality of target areas being continuous areas; each of the target areas including a target character group, each of the target character groups including at least one character, the target character group being related to content of a time interval of the multimedia file in the target area where the target character is located.
[0063] In the embodiments of the present application, the parsing of the multimedia file by the media player to generate the progress bar for the multimedia file can include: parsing the multimedia file by the media player to obtain target information contained in the multimedia file; and generating the progress bar for the multimedia file based on the target information; specifically, the generation of the progress bar for the multimedia file based on the target information can include: generating the progress bar for the multimedia file based on the target information and a time interval corresponding to the target information.
[0064] It should be noted that the target area can be understood as an area corresponding to each segment of the multimedia file; the time interval of the multimedia file can be understood as a start time and an end time of each segment; the plurality of target areas being continuous areas can be understood as that the multimedia file is divided into a plurality of segment files in a time sequence, and an area corresponding to each segment file is a target area; each of the target areas includes a target character group; the target character group can be understood as introduction information of the segment file corresponding to the target area; each of the target character groups including at least one character can be understood as that content in the introduction information can be determined according to actual conditions, and can be one character or a plurality of characters; the progress bar being used to indicate the time index of the multimedia file can be understood as that the time index and the time interval have a corresponding relationship, the content of the time interval corresponds to the target area, and the corresponding target area on the progress bar can be quickly located by the time index, and related content can be played.
[0065] In some embodiments, the method further includes:
[0066] obtaining a sensing parameter;
[0067] determining, based on the sensing parameter, that the progress bar includes the plurality of target areas;
[0068] wherein if the sensing parameter represents a first use mode, a first number of target regions is determined;
[0069] if the sensing parameter represents a second use mode, a second number of target regions is determined;
[0070] the first use mode is different from the second use mode, and the first number is different from the second number.
[0071] In this embodiment, the sensing parameter can be determined according to an actual scenario. As an example, the sensing parameter can be a touch type sensing parameter. The first use mode and the second use mode can be determined according to an actual scenario. As an example, the first use mode can be that the electronic device is in a horizontal screen state, and the second use mode can be that the electronic device is in a vertical screen state. Alternatively, the first use mode can be that the electronic device is in a folded state of a flexible display, and the second use mode can be that the electronic device is in an unfolded state of the flexible display. Alternatively, the first use mode can be that a double-screen electronic device is in a state of using a first screen, and the second use mode can be that the double-screen electronic device is in a state of using a second screen. Alternatively, the first use mode can be that the double-screen electronic device is in a state of using one screen, and the second use mode can be that the double-screen electronic device is in a state of using two screens.
[0072] For ease of understanding, it is assumed that the electronic device is a tablet computer, and the first use mode is that the electronic device is in a horizontal screen state, and the second use mode is that the electronic device is in a vertical screen state. Since the horizontal screen displays a progress bar in a long side, the number of target regions included in the progress bar can be more. Since the vertical screen displays the progress bar in a short side, the number of target regions included in the progress bar can be less.
[0073] It is assumed that the electronic device is a mobile phone with an out-flap bar for display, and the first use mode can be that the electronic device is in a folded state of a flexible display, and the second use mode can be that the electronic device is in an unfolded state of the flexible display. Since the unfolded flexible display displays a progress bar in a square or a rectangle, the number of target regions included in the progress bar can be more. Since the folded flexible display displays the progress bar in half of a square or a rectangle, the number of target regions included in the progress bar can be less.
[0074] In the first use mode, the electronic device with dual-screen display is in a state of using the first screen, and in the second use mode, the electronic device with dual-screen display is in a state of using the second screen. Since the lengths of the first screen and the second screen are different, for example, the length of the first screen is longer and the length of the second screen is shorter, if the progress bar is displayed on the first screen, the progress bar includes a larger number of target areas; if the progress bar is displayed on the second screen, the progress bar includes a smaller number of target areas.
[0075] In the first use mode, the electronic device with dual-screen display is in a state of using the first screen, and in the second use mode, the electronic device with dual-screen display is in a state of using the second screen. Since the lengths of the first screen and the second screen are different, for example, the length of the first screen is longer and the length of the second screen is shorter, if the progress bar is displayed on the first screen, the progress bar includes a larger number of target areas; if the progress bar is displayed on the second screen, the progress bar includes a smaller number of target areas.
[0076] In some embodiments, the generating the progress bar for the multimedia file by the media player includes:
[0077] obtaining target information included in the multimedia file;
[0078] generating the progress bar for the multimedia file based on the target information; the target information includes: the number of target areas and a target character group corresponding to the target areas.
[0079] In this embodiment, the number of target areas can be understood as the number of corresponding areas of segments in the multimedia file; the specific number of target areas can be determined according to actual conditions, which is not limited herein. The target character group corresponding to the target area can be understood as the introduction information corresponding to the target area.
[0080] The generating the progress bar for the multimedia file based on the target information can be generating the progress bar for the multimedia file based on the number of target areas and the target character group corresponding to the target areas; specifically, the target character group corresponding to the target area can be added to the corresponding target area to generate the progress bar for the multimedia file.
[0081] In some embodiments, the generating the progress bar for the multimedia file by the media player includes:
[0082] generating the target information by processing the multimedia file through an intelligent engine if the target information is not obtained from the multimedia file;
[0083] generating a progress bar for the multimedia file based on the target information; the target information comprising: a number of the target regions and a target character group corresponding to the target regions.
[0084] In this embodiment, if the target information is not obtained from the multimedia file, it can be understood that the number of the target regions and the target character group corresponding to the target regions of the multimedia file are obtained, that is, no processing is performed.
[0085] The number of the target regions can be understood as the number of corresponding regions of segments in the multimedia file; the specific number of the target regions can be determined according to actual conditions, which is not limited herein. The target character group corresponding to the target regions can be understood as the brief information of the corresponding segments of the target regions.
[0086] Generating a progress bar for the multimedia file based on the target information can be generating a progress bar for the multimedia file based on the number of the target regions and the target character group corresponding to the target regions; specifically, the target character group corresponding to the target regions can be added to the corresponding target regions to generate a progress bar for the multimedia file.
[0087] In some embodiments, the generating the target information by processing the multimedia file through an intelligent engine comprises:
[0088] obtaining target content of the multimedia file;
[0089] generating the target information based on the target content;
[0090] wherein, if the target content satisfies a first condition, it is determined that the target information comprises a first number of target regions and a target character group corresponding to the target regions;
[0091] if the target content satisfies a second condition, it is determined that the target information comprises a second number of target regions and a target character group corresponding to the target regions;
[0092] The first condition and the second condition are different, and the first number and the second number are different.
[0093] In this embodiment, the first condition and the second condition can be determined according to actual conditions, which are not limited herein. As an example, the first condition and the second condition can be the form of the content, for example, the first condition can be narrow and short content; the second condition can be wide and long content; in actual application, it is mainly considered that the target content of the multimedia file can be narrow and short content, which can be more suitable for vertical screen watching, and the number of target areas in the progress bar on the vertical screen is a little less; and the target content of the multimedia file can be wide and long content, which can be more suitable for horizontal screen watching, and the number of target areas in the progress bar on the horizontal screen is a little more.
[0094] In this embodiment, different target information is generated according to that the target content of the multimedia file meets different conditions (for example, the form of the content); specifically, for the form of the content of the multimedia file being narrow and short content, the target information includes a target area with a small number and a target character group corresponding to the target area; for the form of the content of the multimedia file being wide and long content, the target information includes a target area with a large number and a target character group corresponding to the target area.
[0095] In some embodiments, the method further comprises:
[0096] obtaining a target parameter of the target content;
[0097] generating the target information based on the target parameter;
[0098] wherein if the target parameter represents a first aspect ratio, the first number of target areas is determined;
[0099] if the target parameter represents a second aspect ratio, the second number of target areas is determined;
[0100] The first aspect ratio is different from the second aspect ratio.
[0101] In this embodiment, the target parameter can be understood as a parameter representing the size of the frame image. In actual application, it is mainly considered that the content of the multimedia file (for example, a video) itself can be suitable for narrow screen display or wide screen display; for narrow screen display, the number of target areas in the progress bar can be a little less; for wide screen display, the number of target areas in the progress bar can be a little more.
[0102] As an example, the first aspect ratio and the second aspect ratio can be understood as the aspect ratio of each frame image, and in the case that the target parameter represents different aspect ratios, different numbers of target areas in the progress bar are determined. Generally, the larger the aspect ratio, the smaller the number of target areas; the larger the aspect ratio, the larger the number of target areas.
[0103] In some embodiments, the processing the multimedia file by the intelligent engine to generate the target information comprises:
[0104] obtaining a pixel image of the multimedia file;
[0105] processing the pixel image by using a target algorithm to obtain description information of the pixel image;
[0106] determining a number of segments in the multimedia file and brief information of each segment based on the description information;
[0107] taking the number of segments as the number of target regions and taking the brief information of each segment as a target character group corresponding to the target region.
[0108] It should be noted that the pixel image can include at least one video frame with time sequence; the target algorithm can be determined according to actual conditions, which is not limited herein. As an example, the target algorithm is an artificial intelligence (AI) algorithm. Processing the pixel image by using the target algorithm to obtain the description information of the pixel image can be processing each image frame in the at least one video frame by using the artificial intelligence AI algorithm to obtain the description information of each image frame.
[0109] Determining the number of segments in the multimedia file based on the description information can be determining first description information with coincidence degree and second description information without coincidence degree according to the description information of each image frame; determining the number of information sequences in time sequence of the multimedia file according to the first description information and the second description information; and taking the number of information sequences as the number of segments in the multimedia file.
[0110] Determining the brief information of each segment based on the description information can be determining the number of times of the same content of the corresponding description information in each segment; sorting the number of times to obtain target content corresponding to the highest number of times; and taking the target content as the brief information corresponding to each segment.
[0111] The embodiments of the present application are exemplarily illustrated by taking a multimedia file as a video file, Figure 2 a schematic diagram of playing a video file in full screen by a media player to parse the video file according to an embodiment of the present application; Figure 3 a schematic diagram of playing a video file after generating a progress bar of the video file by a media player to parse the video file according to an embodiment of the present application; in Figure 3In some embodiments, a multimedia player is capable of generating a video file progress bar for any video file to be played, the video file progress bar including a plurality of target regions with text labels, the video file progress bar indicating a time index of the video file. If a progress switch of the video file is made during the playing of the video file by the player, the progress bar is called up, and the corresponding switch point is quickly determined by the characters of different target regions of the video file progress bar, and the switch point is clicked on (or the play control is dragged onto the bar-shaped progress control) on the bar-shaped progress control to achieve a quick switch. The multimedia player provided in the embodiments has the capability of generating a progress bar including a plurality of target regions for a multimedia file by analyzing the multimedia file by the media player. If the multimedia file to be played includes the key information required by the multimedia player to generate the progress bar including a plurality of target regions, the multimedia processing obtains the key information included in the multimedia file, and generates the progress bar based on the key information included in the multimedia file; if the multimedia file to be played does not include the key information required by the multimedia player to generate the progress bar including a plurality of target regions, the multimedia player analyzes each frame of image of the multimedia file to obtain the required key information, and generates the progress bar based on the key information included in the multimedia file. The multimedia player analyzing each frame of image of the multimedia file to obtain the required key information can be performed during the playing of the multimedia file by the multimedia player (for example, during the first playing of the multimedia file by the multimedia player), or can be pre-processed before the playing of the multimedia file. In addition, it should be noted that the key information can be written into the multimedia file at any time to enable the multimedia player to directly obtain the key information to generate the progress bar next time.
[0112] The embodiments of the present application take the multimedia file as a video file for example, and two use scenarios are provided as follows: scenario one, real-time camera recording, that is, obtaining the key information during the shooting of a video; and scenario two, album processing and importing of an existing recording, that is, pre-processing to obtain the key information.
[0113] For scenario one, real-time camera recording, the following steps are included:
[0114] Step one: when recording, the camera obtains pixel data (YUV) data from a sensor to an application (App) layer.
[0115] Step two: the App layer converts the YUV data into a bitmap color format of YUV, and sends the YUV data to a video codec.
[0116] Third step: send the bitmap obtained in the second step to the AI algorithm, and the AI algorithm returns an array of descriptions of the current scene, behavior, and target.
[0117] Fourth step: secondary filtering is performed on the information in the description data returned by the AI, and information with low confidence and unclear meaning is removed.
[0118] Fifth step: record the filtered information and time stamp.
[0119] Sixth step: in the sequence of time stamp information before and after, coincident description information is grouped together until a completely non-coincident information sequence appears.
[0120] Seventh step: the first time stamp non-coincident information sequence is taken as the starting reference information sequence of the next video segment, and the coincident description information in the sequence of time stamp information before and after is compared and counted.
[0121] Eighth step: if the coincident description information occupies too short a time, it means a fleeting non-key emphasis link that needs to be skipped to determine the starting reference information sequence of the next video segment.
[0122] Ninth step: the number of information sequences in time sequence obtained is the number of video segments.
[0123] Tenth step: the most frequent "scene, behavior, and target description" in each information sequence is the "segment introduction" of the sequence.
[0124] Eleventh step: combine the time stamp information to obtain the video segment introduction progress bar.
[0125] For the scene two, the album processing after importing the existing video includes the following steps:
[0126] First step: the album app decodes the video file into a bitmap.
[0127] Second step: the album app sends the bitmap data to the AI algorithm, and the AI algorithm returns an array of descriptions of the current scene, behavior, and target.
[0128] Third step: secondary filtering is performed on the information in the description data returned by the AI, and information with low confidence and unclear meaning is removed.
[0129] Fourth step: record the filtered information and time stamp.
[0130] Fifth step: in the sequence of time stamp information before and after, coincident description information is grouped together until a completely non-coincident information sequence appears.
[0131] Step 6: Take the first timestamp-mismatched information sequence as the starting reference information sequence of the next video segment, and continue to compare and count the coincident description information in the timestamp information sequences before and after the comparison.
[0132] Step 7: If the coincident description information occupies too short a time, it is a fleeting non-key emphasis link that needs to be skipped to determine the starting reference information sequence of the next video segment.
[0133] Step 8: The number of each time-sequenced information sequence obtained is the number of video segments.
[0134] Step 9: The most frequent "scene, behavior, and target description" in each information sequence is the "segment introduction" of the sequence.
[0135] Step 10: Combine the timestamp information to obtain the video segment introduction progress bar.
[0136] By using the technical solution provided in the embodiment, the AI algorithm is used to analyze video frames frame by frame, the scene, behavior, and target description are obtained based on the relationship between the previous and next frames, the preset value of the segment time is automatically set based on the recording direction of the video (for example, considering the convenience of operation on the mobile phone screen, the segment of the vertical screen is less, and the segment of the horizontal screen is more), the item with the most frequent occurrence or Top3 is taken as the video segment introduction based on the "target description" of each frame, and finally, the video is intelligently added with the segment introduction progress bar based on the starting and ending timestamps of the "video segment introduction". The entire implementation process has the following advantages: first, it is fully automatic, simple, and relatively simple for users, and there is no learning cost for automatic generation; second, it is real-time generation with high efficiency; third, the information is generated once and can be directly reused next time.
[0137] The embodiment of the application provides a processing device, Figure 4 is a structural schematic diagram of the processing device provided by the embodiment of the application, as Figure 4 indicated, the processing device 400 comprises:
[0138] The obtaining module 401 is configured to obtain a multimedia file.
[0139] The playing module 402 is configured to parse the multimedia file by a media player to play the multimedia file.
[0140] The generating module 403 is configured to parse the multimedia file by the media player to generate a progress bar for the multimedia file, the progress bar being used to indicate a time index of the multimedia file, the progress bar comprising a plurality of target regions, the plurality of target regions being continuous regions; each of the target regions comprising a target character group, each of the target character groups comprising at least one character, the target character group being related to a content of a time interval of the multimedia file in which the target character group is located.
[0141] In some embodiments, the apparatus 400 further comprises a determining unit configured to obtain a sensing parameter; determine, based on the sensing parameter, that the progress bar comprises a plurality of target regions; wherein if the sensing parameter represents a first use mode, determine a first number of target regions; if the sensing parameter represents a second use mode, determine a second number of target regions; the first use mode is different from the second use mode, and the first number is different from the second number.
[0142] In some embodiments, the generating module 403 is further configured to obtain target information contained in the multimedia file; generate, based on the target information, the progress bar for the multimedia file; the target information comprises: a number of the target regions and a target character group corresponding to the target regions.
[0143] In some embodiments, the generating module 403 is further configured to, if the target information is not obtained from the multimedia file, generate the target information by processing the multimedia file by an intelligent engine; generate, based on the target information, the progress bar for the multimedia file; the target information comprises: a number of the target regions and a target character group corresponding to the target regions.
[0144] In some embodiments, the generating module 403 is further configured to obtain target content of the multimedia file; generate the target information based on the target content; wherein if the target content satisfies a first condition, determine that the target information comprises a first number of target regions and a target character group corresponding to the target regions; if the target content satisfies a second condition, determine that the target information comprises a second number of target regions and a target character group corresponding to the target regions; the first condition is different from the second condition, and the first number is different from the second number.
[0145] In some embodiments, the generating module 403 is further configured to obtain a target parameter of the target content; generate the target information based on the target parameter; wherein if the target parameter represents a first aspect ratio, determine the first number of target regions; if the target parameter represents a second aspect ratio, determine the second number of target regions; the first aspect ratio is different from the second aspect ratio.
[0146] In some embodiments, the generating module 403 is further configured to obtain a pixel image of the multimedia file; process the pixel image by using a target algorithm to obtain description information of the pixel image; determine a number of segments in the multimedia file and introduction information of each segment based on the description information; and take the number of segments as the number of target regions and take the introduction information of each segment as a target character group corresponding to the target region.
[0147] It should be noted that the description of the device embodiments of the present application is similar to the description of the above method embodiments, and has similar beneficial effects as the method embodiments, and thus is not described in detail. For technical details not disclosed in the device embodiments of the present application, please refer to the description of the method embodiments of the present application for understanding.
[0148] It should be noted that in the embodiments of the present application, if the above-mentioned system processing method is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a plurality of instructions for causing a terminal to execute all or part of the methods described in the embodiments of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM, Read Only Memory), a magnetic disk or an optical disk, and various media that can store program codes. Thus, the embodiments of the present application are not limited to any specific hardware and software combination.
[0149] The embodiments of the present application provide an electronic device, Figure 5 is a schematic diagram of the composition structure of the electronic device provided by the embodiments of the present application, as Figure 5 shown, the electronic device 500 at least includes a processor 501 and a computer readable storage medium 502 configured to store executable instructions, wherein the processor 501 generally controls the overall operation of the electronic device. The computer readable storage medium 502 is configured to store instructions and applications executable by the processor 501, and can also cache data to be processed by the processor 501 and modules in the electronic device 500, and can be realized by a flash memory or a random access memory (RAM, Random Access Memory).
[0150] The embodiments of the present application provide a storage medium storing executable instructions, wherein the storage medium stores executable instructions, and when the executable instructions are executed by a processor, the processor will execute the processing method provided by the embodiments of the present application, for example, the method shown in Figure 3 .
[0151] In some embodiments, the storage medium can be a computer-readable storage medium, such as a ferroelectric memory (FRAM), a read only memory (ROM), a programmable read only memory (PROM), an erasable programmable read only memory (EPROM), an electrically erasable programmable read only memory (EEPROM), a flash memory, a magnetic surface memory, an optical disk, a compact disk-read only memory (CD-ROM), or the like memory; or various devices including one or any combination of the above memories.
[0152] In some embodiments, the executable instructions can be in the form of a program, software, software modules, scripts, or code, written in any form of programming language, including compiled or interpreted languages, or declarative or procedural languages, and can be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.
[0153] By way of example, the executable instructions can or can not correspond to a file in a file system, can be stored in a part of a file that holds other programs or data, can be stored as one or more scripts in a markup language, such as Hyper Text Markup Language (HTML), in a single file dedicated to the program in question, or in multiple files in various combinations of these.
[0154] It should be noted that the technical solutions recorded in each embodiment of the embodiments of the present application can be combined arbitrarily without conflict between the technical features.
[0155] It should be understood that the term "one embodiment" or "an embodiment" as used herein means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the application. The appearances of the phrase "in one embodiment" or "in an embodiment" in various places in the specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. It should be understood that the sequence of steps in the above-described embodiments can not necessarily be the only sequence of steps, and that the embodiments can be carried out in other sequences than the one described. The above-described embodiments are merely exemplary and do not limit the scope of the application.
[0156] It should be noted that, as used in this document, the terms "includes," "including," "has," "having" or the like are intended to be open-ended: thus, a process, method, article, or apparatus that includes a series of elements is not required to
[0157] The above description is only the preferred implementation of the present application. Obviously, a person skilled in the art can make modifications or substitutions to the present application without departing from the spirit and scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.
Claims
1. A processing method, the method comprising: Obtain multimedia files; The multimedia file is parsed and played using a media player. The media player parses the multimedia file to generate a progress bar for the multimedia file. The progress bar is determined based on the description information of the multimedia file. The description information is a description array including scene, behavior, and target, obtained by analyzing the multimedia file frame by frame using a target algorithm. The progress bar is used to indicate the time index of the multimedia file. The progress bar includes multiple target regions, which are consecutive regions. The number of target regions is determined based on a first description with overlap and a second description without overlap. Each target region includes a target character group, which is the description of the target that appears most frequently in the image frame corresponding to the target region. The target character group is related to the content of the target region containing the target character and the time interval of the multimedia file.
2. The method according to claim 1, further comprising: Obtain the sensing parameters; Based on sensing parameters, the progress bar is determined to include multiple target areas; Wherein, if the sensing parameters indicate that the display screen of the electronic device is in a first usage mode, a first number of target areas are determined; If the sensing parameters indicate that the display screen of the electronic device is in a second usage mode, a second number of target areas are determined; The first usage form is different from the second usage form, and the first quantity is different from the second quantity.
3. The method according to claim 1, wherein parsing the multimedia file through a media player to generate a progress bar for the multimedia file comprises: The target information is generated by processing the multimedia file through an intelligent engine. Generate a progress bar for the multimedia file based on the target information; The target information includes: the number of target regions determined based on the description information and the target character groups corresponding to the target regions.
4. The method according to claim 3, wherein generating the target information by processing the multimedia file through an intelligent engine includes: Obtain the target content of the multimedia file; The target information is generated based on the target content; Wherein, if the target content satisfies the first condition, the target information is determined to include a first number of target regions and the target character groups corresponding to the target regions; the first condition indicates that the target content is narrow and short content; If the target content satisfies the second condition, the target information is determined to include a second number of target regions and the target character groups corresponding to the target regions; the second condition indicates that the target content is a wide and long strip of content. The first condition is different from the second condition, and the first quantity is different from the second quantity.
5. The method according to claim 4, further comprising: Obtain the target parameters of the target content; The target information is generated based on the target parameters; Wherein, if the target parameter represents a first aspect ratio, the first number of target regions is determined; If the target parameter is characterized as a second aspect ratio, determine the second number of target regions; The first aspect ratio is different from the second aspect ratio.
6. The method according to claim 3, wherein generating the target information by processing the multimedia file through an intelligent engine comprises: Obtain the pixel image of the multimedia file; The pixel image is processed using a target algorithm to obtain descriptive information of the pixel image; The number of segments in the multimedia file and the brief information of each segment are determined based on the description information. The number of segments is taken as the number of target regions, and the brief information of each segment is taken as the target character group corresponding to the target region.
7. A processing apparatus, comprising: The acquisition module is used to acquire multimedia files; A playback module is used to parse the multimedia file using a media player to play the multimedia file. The generation module is used to parse the multimedia file through a media player to generate a progress bar for the multimedia file. The progress bar is determined based on the description information of the multimedia file. The description information is a description array including scene, behavior, and target, obtained by analyzing the multimedia file frame by frame through a target algorithm. The progress bar is used to indicate the time index of the multimedia file. The progress bar includes multiple target regions, which are consecutive regions. The number of target regions is determined based on a first description information with overlap and a second description information without overlap. Each target region includes a target character group, which belongs to one of the description arrays. The target character group is the description of the target that appears most frequently in the image frame corresponding to the target region. The target character group is related to the content of the target region containing the target character and the time interval of the multimedia file.
8. An electronic device, comprising: Memory, used to store executable instructions; A processor, when executing executable instructions stored in the memory, implements the processing method according to any one of claims 1 to 6.
9. A computer-readable storage medium storing executable instructions for causing a processor to execute the executable instructions to implement the processing method according to any one of claims 1 to 6.
Citation Information
Patent Citations
Video playing method and device, electronic equipment and storage medium
CN111683281A
Video playing method, method for generating video directory and related products
CN114339375A
Display method and device of playing control, electronic equipment and storage medium
CN114845152A
Systems and methods for recommending content using progress bars
US20230052033A1
Systems and methods for recommending content using progress bars
WO2021225581A1