Method, apparatus, device, storage medium and product for playing media information
By receiving positioning time in the media information playback interface and responding to progress adjustment instructions, the problems of cumbersome and inaccurate playback progress adjustment in the prior art are solved, and fast and accurate playback progress adjustment is achieved, improving user experience.
Patent Information
- Application Number
- CN202111341676.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-11-12
- Publication Date
- 2025-08-01
- Estimated Expiration
- 2041-11-12
AI Technical Summary
In the prior art, the playback progress adjustment operation of media information is cumbersome and inaccurate, especially when the playback time of media information is long, multiple fast forward or fast backward operations are required, resulting in poor user experience.
By receiving the positioning time in the media information playback interface and responding to the progress adjustment command based on the positioning time, the playback progress of the media information is directly adjusted to the target time point, and the positioning time and instructions are inputted, supporting graphic drawing operations, positioning mode controls, digital drawing and sliding operations.
It realizes rapid and accurate adjustment of media information playback progress, simplifies operational processes, and improves user experience.
Smart Images

Figure CN116132724B_ABST
Abstract
Description
Technical Field
[0001] This application relates to mobile Internet technologies, and in particular, to a method, apparatus, device, computer-readable storage medium, and computer program product for playing media information. Background Art
[0002] In related technologies, for the method of adjusting the playback progress of media information, most of them control the playback progress of media information by performing left and right sliding operations on the terminal screen, or adjust the playback progress of media information by continuously performing fast forward or rewind operations with a fixed multiple. When the fixed multiple is small and the playback duration of the media information is long, it is necessary to continuously perform fast forward or rewind operations multiple times, which is not only cumbersome to operate, but also has low accuracy in adjusting the playback progress of media information. Summary of the Invention
[0003] Embodiments of this application provide a method, apparatus, device, computer-readable storage medium, and computer program product for playing media information, which can accurately adjust the playback progress of media information.
[0004] The technical solution of the embodiments of this application is implemented as follows:
[0005] Embodiments of this application provide a method for playing media information, including:
[0006] Play media information in a media information playback interface;
[0007] During the process of playing the media information, receive a positioning time input on the playback page of the media information;
[0008] Wherein, the positioning time is used to adjust the playback progress of the media information to a target time point;
[0009] Based on the positioning time, in response to a progress adjustment instruction for the media information, adjust the playback progress of the media information to the target time point, and start playing the media information from the adjusted target time point.
[0010] Embodiments of this application provide a device for playing media information, including:
[0011] A playback module, configured to play media information in a media information playback interface;
[0012] A receiving module, configured to receive a positioning time input on the playback page of the media information during the process of playing the media information; wherein, the positioning time is used to adjust the playback progress of the media information to a target time point;
[0013] An adjustment module, configured to adjust the playing progress of the media information to the target time point based on the positioning time in response to a progress adjustment instruction for the media information, and start playing the media information from the adjusted target time point.
[0014] In the above solution, the receiving module is further configured to receive a graphic drawing operation on the playing page before receiving the positioning time input on the playing page of the media information;
[0015] When the graphic drawn by the graphic drawing operation matches a preset graphic, control enters a positioning mode for adjusting the playing progress of the media information.
[0016] In the above solution, the receiving module is further configured to present a positioning mode control on the media information playing interface before receiving the positioning time input on the playing page of the media information;
[0017] In response to a trigger operation on the positioning mode control, control enters a positioning mode for adjusting the playing progress of the media information.
[0018] In the above solution, the receiving module is further configured to receive the positioning time input in the positioning mode based on the playing page of the media information during the playing of the media information.
[0019] In the above solution, the receiving module is further configured to detect a positioning time input operation on the playing page after controlling to enter a positioning mode for adjusting the playing progress of the media information;
[0020] When the positioning time input operation is not detected within the target duration, control exits the positioning mode.
[0021] In the above solution, the receiving module is further configured to receive a first digital drawing operation on the playing page of the media information;
[0022] Obtain the time unit corresponding to the playing progress adjustment, and use the time obtained by combining the number drawn by the first digital drawing operation and the time unit as the positioning time;
[0023] Wherein, the positioning time corresponds to the adjustment duration of the media information.
[0024] In the above solution, the receiving module is further configured to receive a second digital drawing operation on the playing page of the media information;
[0025] When the number drawn by the second digital drawing operation has a target digital format, obtain the time units corresponding to each part in the target digital format;
[0026] Combining the number with the time unit and the target digital format to obtain the positioning time, where the positioning time corresponds to the adjustment duration of the media information.
[0027] In the above solution, the receiving module is further configured to present a time input box in the target time format on the playback page of the media information;
[0028] Receiving the number input in the time input box, combining the input number and the target time format to obtain the positioning time, and using the positioning time as the target time point.
[0029] In the above solution, the receiving module is further configured to present a time input box in the target time format in the form of a floating window on the playback page of the media information, and the time input box has a preset transparency.
[0030] In the above solution, the receiving module is further configured to present a digital input area on the playback page of the media information, where the digital input area is used to input a number corresponding to the duration adjustment unit of the media information, and the number is used to indicate the quantity of the duration adjustment unit;
[0031] Receiving the number input in the digital input area, and using the time required to adjust the duration adjustment unit of the quantity as the positioning time.
[0032] In the above solution, the adjustment module is further configured to obtain the current playback time point of the media information and the progress adjustment direction indicated by the progress adjustment instruction;
[0033] Based on the progress adjustment direction, the current playback time point and the adjustment duration, determining the target time point;
[0034] Adjusting the playback progress of the media information to the target time point.
[0035] In the above solution, the duration adjustment unit is a scene or shot of the media information; when adjusting the playback progress of the media information, the adjustment module is further configured to obtain the current playback time point of the media information and the progress adjustment direction indicated by the progress adjustment instruction;
[0036] Starting from the current playback time point, adjusting the playback progress of the media information in the progress adjustment direction so that the adjusted playback progress changes the quantity of playback scenes or shots.
[0037] In the above solution, the receiving module is further configured to, after receiving the positioning time input on the playback page of the media information, receive a sliding operation on the playback page of the media information;
[0038] Obtain the sliding trajectory corresponding to the sliding operation;
[0039] When the sliding trajectory meets the first preset condition, generate a progress adjustment instruction indicating fast forward of the playback of the media information;
[0040] When the sliding trajectory meets the second preset condition, generate a progress adjustment instruction indicating rewind of the playback of the media information.
[0041] In the above solution, the receiving module is further configured to, after receiving the positioning time input on the playback page of the media information, receive the input characters in the area associated with the positioning time on the playback page;
[0042] When the character is the first character, generate a progress adjustment instruction indicating fast forward of the playback of the media information;
[0043] When the character is the second character, generate a progress adjustment instruction indicating rewind of the playback of the media information.
[0044] In the above solution, the receiving module is further configured to, after receiving the positioning time input on the playback page of the media information, obtain the number of times of progress adjustment of the media information in history, and the progress adjustment direction corresponding to each progress adjustment;
[0045] Predict the adjustment direction of the media information based on the number of times and the progress adjustment direction corresponding to each progress adjustment to obtain the target adjustment direction;
[0046] Generate a progress adjustment instruction corresponding to the target adjustment direction.
[0047] In the above solution, the adjustment module is further configured to obtain the playback timeline corresponding to the media information;
[0048] When it is determined that the target time point is within the playback timeline, adjust the playback progress of the media information;
[0049] When it is determined that the target time point is not within the playback timeline, present an error prompt message or a repositioning indication message;
[0050] Wherein, the error prompt message is used to indicate that the input of the size of the positioning time is incorrect; the repositioning indication message is used to indicate re-input of the positioning time on the playback page.
[0051] In the above solution, the adjustment module is further configured to, when the number of the positioning times is at least two, obtain the progress adjustment direction indicated by the progress adjustment instruction;
[0052] Starting from the current playback time point of the media information, in accordance with the progress adjustment direction, using the positioning time as the adjustment duration, continuously perform the at least two progress adjustments on the media information;
[0053] Wherein, the playback duration of the media information corresponding to two adjacent progress adjustments is the target playback duration.
[0054] An embodiment of the present application provides an electronic device, including:
[0055] A memory for storing executable instructions;
[0056] A processor, when executing the executable instructions stored in the memory, implements the media information playback method provided by the embodiment of the present application.
[0057] An embodiment of the present application provides a computer-readable storage medium storing executable instructions for causing a processor to implement the media information playback method provided by the embodiment of the present application when executed.
[0058] An embodiment of the present application provides a computer program product including a computer program or instructions, and when the computer program or instructions are executed by a processor, implements the media information playback method provided by the embodiment of the present application.
[0059] The embodiment of the present application has the following beneficial effects:
[0060] During the process of playing media information, by using the positioning time input on the playback page to determine the target time point of the playback progress, and then after the positioning time input is completed, in response to the triggered progress adjustment instruction, directly adjust the playback progress of the media information to the target time point. In this way, the playback progress of the media information can be adjusted quickly and accurately. Description of the Drawings
[0061] Figure 1 is a schematic diagram of the architecture of the media information playback system 100 provided by the embodiment of the present application;
[0062] Figure 2 is a schematic diagram of the structure of the electronic device provided by the embodiment of the present application;
[0063] Figure 3 is a schematic diagram of the process of media information playback provided by the embodiment of the present application;
[0064] Figure 4 is a schematic diagram of the positioning mode startup method provided by the embodiment of the present application;
[0065] Figure 5A is a schematic diagram of the graphic drawing provided by the embodiment of the present application;
[0066] Figure 5B It is a schematic diagram of the caching process of the graphic drawing parameters provided by the embodiments of the present application;
[0067] Figure 5C It is an example diagram of the failure to start the positioning mode provided by the embodiments of the present application;
[0068] Figure 6 It is a schematic diagram of the starting method of the positioning mode provided by the embodiments of the present application;
[0069] Figure 7A-7B It is a schematic diagram of the positioning mode control provided by the embodiments of the present application;
[0070] Figure 8 It is a schematic diagram of the positioning mode setting guide provided by the embodiments of the present application;
[0071] Figure 9 It is a flowchart of the drawing method of the positioning time provided by the embodiments of the present application;
[0072] Figure 10 It is a schematic diagram of the first digital drawing operation provided by the embodiments of the present application;
[0073] Figure 11 It is a flowchart of the drawing method of the positioning time provided by the embodiments of the present application;
[0074] Figure 12 It is a schematic diagram of the second digital drawing operation provided by the embodiments of the present application;
[0075] Figure 13 It is a flowchart of the input method of the positioning time provided by the embodiments of the present application;
[0076] Figure 14 It is a schematic diagram of the time input method provided by the embodiments of the present application;
[0077] Figure 15 It is a schematic diagram of the positioning time determination method provided by the embodiments of the present application;
[0078] Figure 16 It is a schematic diagram of the data structure of the video data provided by the embodiments of the present application;
[0079] Figure 17 It is a schematic flowchart of the playback progress adjustment method provided by the embodiments of the present application;
[0080] Figure 18 It is a schematic diagram of the sliding trajectory provided by the embodiments of the present application;
[0081] Figure 19 It is a schematic flowchart of the playback progress adjustment method provided by the embodiments of the present application;
[0082] Figure 20 It is a schematic diagram of progress adjustment characters provided by an embodiment of the present application;
[0083] Figure 21 It is a schematic diagram of the process of the playback progress adjustment method provided by an embodiment of the present application;
[0084] Figure 22 It is a schematic diagram of the process of the playback progress adjustment method provided by an embodiment of the present application;
[0085] Figure 23A-23B It is a schematic diagram of determining the progress adjustment direction provided by an embodiment of the present application;
[0086] Figure 24 It is a schematic diagram of the process of the playback progress adjustment method provided by an embodiment of the present application;
[0087] Figure 25 It is a schematic diagram of the calculation method of the progress adjustment duration provided by an embodiment of the present application;
[0088] Figure 26 It is a schematic diagram of the playback progress adjustment method provided by an embodiment of the present application;
[0089] Figure 27 It is a schematic diagram of the prompt information provided by an embodiment of the present application;
[0090] Figure 28 It is a schematic diagram of the playback progress adjustment method provided by an embodiment of the present application;
[0091] Figure 29 It is a schematic diagram of the playback method of video information provided by an embodiment of the present application;
[0092] Figure 30 It is a schematic diagram of the progress adjustment method provided by an embodiment of the present application;
[0093] Figure 31 It is a schematic diagram of the hierarchical structure of the video client playback page provided by an embodiment of the present application;
[0094] Figure 32 It is a schematic diagram of the video playback progress adjustment method provided by an embodiment of the present application. Specific implementation manners
[0095] In order to make the objectives, technical solutions and advantages of the present application clearer, the present application will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be construed as limitations on the present application. All other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the scope of protection of the present application.
[0096] In the following description, reference is made to "some embodiments", which describe a subset of all possible embodiments. However, it is understood that "some embodiments" may be the same subset or different subsets of all possible embodiments, and may be combined with each other without conflict.
[0097] If a similar description such as "first / second" appears in the application documents, the following explanation shall be added. In the following description, the terms "first", "second", and "third" are only used to distinguish similar objects, and do not represent a specific order for the objects. It can be understood that, where permitted, "first", "second", and "third" can be interchanged in a specific order or sequence, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.
[0098] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those of ordinary skill in the technical field to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.
[0099] Before further elaborating on the embodiments of this application, the nouns and terms involved in the embodiments of this application are described. The nouns and terms involved in the embodiments of this application are subject to the following explanations.
[0100] 1) Floating layer: It refers to a temporary view that appears on the page when the user first enters the page or interacts on the current page. This view is used to display prompt information. That is to say, the floating layer is a semi-transparent temporary view that emerges when the user clicks on a control or a certain area of the interface. The style of the floating layer is very similar to that of the action bar, and both can display multiple function options to the user. However, the floating layer can appear at any position on the screen and can give the user more targeted prompts.
[0101] 2) Client: An application program running on the terminal that provides various services, such as a video playback client, an audio playback client, etc.
[0102] 3) In response to: It is used to represent the conditions or states on which the executed operations depend. When the dependent conditions or states are met, one or more of the executed operations can be real-time or can have a set delay; without special instructions, there is no limit on the execution sequence of the multiple executed operations.
[0103] 4) Frame image: It refers to the smallest unit of a video and is a static image; for example, when playing video information, the picture frozen at any moment is a frame image.
[0104] 5) Shot: The basic unit of video data. During video shooting, a continuous and uninterrupted segment of video captured by the camera is called a shot.
[0105] In the related art, on the terminal screen, the playback progress is controlled by performing a left - right swipe operation, or the playback progress is adjusted by continuously performing fast - forward or rewind operations in a fixed multiple. When the fixed multiple is small and the playback duration of the media information is long, it is necessary to continuously perform fast - forward or rewind operations multiple times. This not only makes the operation cumbersome, but also the adjustment of the playback progress of the media information is inaccurate.
[0106] Based on this, the embodiments of the present application provide a method, device, equipment, computer - readable storage medium, and computer program product for playing media information, which can accurately adjust the playback progress of media information.
[0107] See Figure 1 , Figure 1 FIG. is a schematic structural diagram of a media information playback system 100 provided by the embodiments of the present application. The terminal 400 (exemplarily showing the terminal 400 - 1 and the terminal 400 - 2) is connected to the server 200 through the network 300. The network 300 can be a wide - area network, a local - area network, or a combination of the two.
[0108] In practical applications, the terminal 400 can be various types of user terminals such as smart phones, tablet computers, and laptop computers, and can also be a desktop computer, a media player, a game console, a television, a smart vehicle terminal, or a combination of any two or more of these data - processing devices; the server 200 can be an independent physical server, a server cluster or a distributed system composed of multiple physical servers, and can also be a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain - name services, security services, content delivery networks (CDNs, Content Delivery Networks), and big - data and artificial - intelligence platforms.
[0109] In actual implementation, a media information playback client (exemplarily showing the playback clients 410 - 1 and 410 - 2) is deployed on the terminal 400, such as a video playback client, an audio playback client, etc. When the user 1 opens the playback client 410 - 1 of the terminal 400 - 1 to play media information, the terminal 400 - 1 is configured to send a media information acquisition request to the server, receive the media information returned by the server, and play the media information in the media information playback interface; during the process of playing the media information, a positioning time input on the playback page of the media information is received; the positioning time is used to adjust the playback progress of the media information to the target time point; based on the positioning time, in response to a progress adjustment instruction for the media information, the playback progress of the media information is adjusted, and the media information is played starting from the adjusted target time point.
[0110] Server 200 is configured to send media information to terminal 400 in response to a media information acquisition request sent by the terminal.
[0111] In some embodiments, as Figure 1 shown, the playback client 410-1 on the terminal 400-1 sends a media information playback request to the server 200 through the network 300. The types of media information include audio, video, etc. The server 200 sends the requested media information to the playback client 410-1 so that the playback client 410-1 decodes and plays it. During the process of the playback client 410-1 playing the media information, the playback client 410-1 receives the positioning time input by user 1 on the playback page, determines the target time point corresponding to the playback progress according to the positioning time, and then adjusts the playback progress of the media information in response to the progress adjustment instruction triggered by user 1 on the playback page, and starts playing the media information from the adjusted target time point.
[0112] See Figure 2 , Figure 2 is a schematic structural diagram of an electronic device provided by an embodiment of the present application. In practical applications, the electronic device 500 can be implemented as Figure 1 the terminal 400 or the server 200 in Figure 2 shown, the electronic device 500 includes: at least one processor 510, a memory 550, at least one network interface 520, and a user interface 530. Each component in the electronic device 500 is coupled together through a bus system 540. It can be understood that the bus system 540 is used to realize the connection and communication between these components. In addition to the data bus, the bus system 540 also includes a power bus, a control bus, and a status signal bus. However, for the sake of clear illustration, in Figure 2 all kinds of buses are labeled as the bus system 540.
[0113] The processor 510 can be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP, Digital Signal Processor), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor can be a microprocessor or any conventional processor, etc.
[0114] In some embodiments, the user interface 530 includes one or more output devices 531 capable of presenting media content, including one or more speakers and / or one or more visual display screens. The user interface 530 also includes one or more input devices 532, including user interface components that facilitate user input, such as a keyboard, a mouse, a microphone, a touch screen display, a camera, other input buttons, and controls.
[0115] The memory 550 can be removable, non-removable, or a combination thereof. Exemplary hardware devices include solid-state memories, hard disk drives, optical disc drives, etc. The memory 550 optionally includes one or more storage devices that are physically remote from the processor 510.
[0116] The memory 550 includes volatile memory or non-volatile memory, and may also include both volatile and non-volatile memory. The non-volatile memory can be read-only memory (ROM), and the volatile memory can be random access memory (RAM). The memory 550 described in the embodiments of the present application is intended to include any suitable type of memory.
[0117] In some embodiments, the memory 550 is capable of storing data to support various operations. Examples of such data include programs, modules, and data structures, or subsets or supersets thereof, which are illustrated below.
[0118] The operating system 551 includes system programs for handling various basic system services and performing hardware-related tasks, such as a framework layer, a core library layer, a driver layer, etc., for implementing various basic services and handling hardware-based tasks;
[0119] The network communication module 552 is used to reach other electronic devices via one or more (wired or wireless) network interfaces 520. Exemplary network interfaces 520 include: Bluetooth, Wi-Fi (Wireless Fidelity), and USB (Universal Serial Bus), etc.;
[0120] The presentation module 553 is used to enable the presentation of information (e.g., a user interface for operating peripheral devices and displaying content and information) via one or more output devices 531 associated with the user interface 530 (e.g., a display screen, a speaker, etc.);
[0121] The input processing module 554 is used to detect and translate one or more user inputs or interactions from one of one or more input devices 532.
[0122] In some embodiments, the media information playback device provided by the embodiments of the present application can be implemented in software. Figure 2 A media information playback device 555 stored in the memory 550 is shown. It can be software in the form of programs and plugins, etc., and includes the following software modules: a playback module 5551, a receiving module 5552, and an adjustment module 5553. These modules are logical, and thus can be combined arbitrarily or further split according to the functions implemented. The functions of each module will be described below.
[0123] In some other embodiments, the media information playing device provided by the embodiments of the present application may be implemented in a hardware manner. As an example, the media information playing device provided by the embodiments of the present application may be a processor in the form of a hardware decoding processor, which is programmed to execute the media information playing method provided by the embodiments of the present application. For example, the processor in the form of a hardware decoding processor may employ one or more application specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field programmable gate arrays (FPGAs), or other electronic components.
[0124] Next, the media information playing method provided by the embodiments of the present application will be described. In some embodiments, the media information playing method provided by the embodiments of the present application may be implemented independently by a terminal or a server, or jointly implemented by a terminal and a server. Taking the implementation by a terminal as an example, the media information playing method provided by the embodiments of the present application will be described.
[0125] See Figure 3 , Figure 3 is a schematic flowchart of the media information playing provided by the embodiments of the present application, which will be described in combination with the steps shown in Figure 3 shown.
[0126] In step 101, the terminal plays media information on the media information playing interface.
[0127] In practical applications, media information playing clients are deployed on the terminal, such as video playing clients, audio playing clients, etc. When a user opens the playing client deployed on the terminal to play media information, the content of the media information is played on the playing interface. The content of playing media information includes the following two scenarios: the content of the media information being played and the content of the media information paused; that is to say, the media information content played on the playing interface may be the media information content in the playing state or the media information content in the paused playing state.
[0128] In step 102, during the process of playing media information, a positioning time input on the playing page of the media information is received, where the positioning time is used to adjust the playing progress of the media information to the target time point.
[0129] In actual implementation, during the playback of media information, the user can accurately control the playback progress of the media information. In the normal playback mode of the media information, the normal playback mode of the media information can be switched to the positioning mode by starting the positioning mode for the media information, and in the positioning mode, the positioning time can be input to achieve the control of the playback progress of the media information. It can be understood that the positioning mode can be used to adjust the playback progress of the media information.
[0130] The method of starting the positioning mode will be described. In some embodiments, refer to Figure 4 , Figure 4 which is a schematic diagram of the method for starting the positioning mode provided by an embodiment of the present application, and will be described in combination with the steps shown in Figure 4 .
[0131] Step 201a, the terminal receives a graphic drawing operation for the playback page.
[0132] In actual implementation, the user can perform a graphic drawing operation (specific form of a sliding operation) for the playback page at any position on the touch screen of the terminal for playing media information, and identify the graphic drawn by the image drawing operation.
[0133] Exemplarily, taking the media information as video information as an example, refer to Figure 5A , Figure 5A which is a schematic diagram of graphic drawing provided by an embodiment of the present application. The user performs a graphic drawing operation for the playback page to obtain the graphic shown by the number 1 in the figure (the specific style of the graphic can be various, such as a circle, a triangle, etc.). It should be noted that in order not to affect the user's viewing experience, the graphic obtained by the graphic drawing operation may not be displayed on the playback page, that is, the graphic shown by the number 1 in the figure may not be displayed when actually playing the video information.
[0134] In actual implementation, when the user performs a graphic drawing operation on the screen of the terminal, the terminal can cache the corresponding graphic drawing parameters in the cache. The graphic drawing parameters can be used to determine whether the drawn graphic meets the conditions for starting the positioning mode according to the image drawing parameters at the end of the graphic drawing operation. In practical applications, the graphic drawing parameters may include the position information at the start of the graphic drawing operation (denoted as pos_start), the position information at M (M is a positive integer) intervals of the sampling time interval (denoted as pos_i, i is a positive integer, i ≤ M), and the position information at the end of the graphic drawing operation (denoted as pos_end), etc. The sampling time interval is used to indicate that the current position information of the graphic drawing operation is cached every fixed time (such as 50 milliseconds (ms)).
[0135] Exemplarily, refer to Figure 5B , Figure 5BIt is a schematic diagram of the caching process of graphic drawing parameters provided by an embodiment of the present application. Taking the graphic drawn by the graphic drawing operation in Figure 5A as an example, when the terminal caches the graphic drawing parameters, it caches the position information shown by the number a in the figure (the position information at the start of the graphic drawing operation), the position information shown by the number b in the figure (the position information after 50 ms of execution of the graphic drawing operation), the position information shown by the number c in the figure (the position information after 2 * 50 ms of execution of the graphic drawing operation), and the position information shown by the number d in the figure (the position information at the end of the graphic drawing operation) in sequence.
[0136] Step 202a, when the graphic drawn by the graphic drawing operation matches the preset graphic, control enters the positioning mode for adjusting the playback progress of the media information.
[0137] In actual implementation, after the terminal obtains the relevant graphic drawing parameters of the graphic drawn by the image drawing operation, it will match them with the graphics in the pre-set graphic library for starting the positioning mode. When the graphic drawn by the user matches the graphics in the graphic library, the positioning mode for adjusting the playback progress of the media information can be enabled.
[0138] The matching method of the drawn image and the preset image will be described. In actual implementation, for the first matching method, it can be determined whether the graphic drawn by the graphic drawing operation matches the preset graphic according to whether the distance between pos_start and pos_end in the graphic drawing parameters exceeds the first distance threshold (which can be denoted as dis_t). That is, when the distance between pos_start and pos_end exceeds the first distance threshold, it is determined that the positioning mode fails to be successfully enabled.
[0139] Exemplarily, refer to Figure 5C , Figure 5C is an example diagram of the failure to start the positioning mode provided by an embodiment of the present application. For the image drawn by the graphic drawing operation shown by the number a in the figure, the starting point (number a-1) and the ending point (number a-2), the distance between the two points is greater than the first distance threshold, and it can be considered that the graphic shown by the number a fails to start the positioning mode, and the media information is still in the normal playback mode.
[0140] In actual implementation, for the second matching method, it can also be determined whether the positioning mode enabling condition is met according to the distance between pos_i and pos_start. The terminal calculates the distance between each pos_i and pos_start (which can be denoted as dis_i), determines the number N (N is an integer) of dis_i that exceeds the second distance threshold. When the ratio of N to M exceeds the preset first ratio threshold, it can be determined that the positioning mode fails to be successfully enabled.
[0141] Exemplarily, refer to Figure 5C, the drawn figure shown by reference numeral b in the figure, assuming it includes 100 sampling points, setting the distance threshold to 200 pixels, presetting the first ratio threshold to 0.6, and the distances from each sampling point to the starting point are dis_1, dis_2, ……, dis_100 respectively. Among them, the number of those exceeding the second distance threshold of 200 pixels is 40 (the ratio value is 0.4), which fails to reach the first ratio threshold of 0.6, and it can be determined that the positioning mode fails to be enabled.
[0142] In actual implementation, for the third matching method, it is also possible to perform block-by-block judgment on the cached location information (which can also be called sampling points) to determine whether the enabling condition of the positioning mode is met. Among them, the principle of dividing the sampling points in the sampling point set can be: assuming there are 2n (n is a positive integer) sampling points in total, then calculate the distance between the 1st point and the nth point, and calculate the distance between the 2nd point and the (n + 1)th point, until the distance between the last nth and 2nth points is calculated. Then count these distances. When the proportion of the number of distances exceeding the preset third distance threshold fails to reach the preset second ratio threshold, it can be determined that the positioning mode fails to be enabled.
[0143] Exemplarily, referring to Figure 5C , assuming the figure shown by reference numeral c in the figure includes 100 location points (sampling points), the third distance threshold is 500 pixels, and the second ratio threshold is 0.4. Calculate the distances of each sampling point group respectively, calculate the distances of the sampling point groups {1, 100}, {2, 99}, {3, 98}, {4, 97}, and obtain 50 distance values. Among them, the number of those greater than the second distance threshold is 10, and the ratio value is 0.2, which is less than the second ratio threshold of 0.4. Then it can be determined that the positioning mode fails to be enabled.
[0144] In actual implementation, through the aforementioned three matching methods, the figures drawn through the graphic drawing operation that do not meet the enabling conditions of the positioning mode can be excluded, so as to be able to determine the drawn figures that meet the enabling conditions of the positioning mode.
[0145] Exemplarily, referring to Figure 5C In, the drawn figure shown by reference numeral d in the figure can be determined to be an image that matches the preset figure. When the figure shown by reference numeral d is drawn, the positioning mode for adjusting the playback progress of the media information will be started (that is, the media information switches from the normal playback mode to the positioning mode).
[0146] In actual implementation, it is also possible to perform prediction on the drawn image through a multi-classification model deployed on the terminal. The input information of the multi-classification model is the location information of the drawn figure (that is, the location information of at least two sampling points), and the output information is the figure category of the drawn figure belonging to the preset figure library.
[0147] Continue to describe the startup method of the positioning mode. In some embodiments, the startup of the positioning mode can also be achieved through a positioning mode control. Refer to Figure 6 , Figure 6 which is a schematic diagram of the startup method of the positioning mode provided by an embodiment of the present application. The description will be made in combination with the steps shown in Figure 6 .
[0148] Step 201b, the terminal presents a positioning mode control in the media information playback interface.
[0149] In actual implementation, the positioning mode can be started by triggering the positioning mode control.
[0150] Exemplarily, taking the media information as video information as an example, Figure 7A-7B which is a schematic diagram of the positioning mode control provided by an embodiment of the present application. Refer to Figure 7A , in the figure, video information is played in the video client, and a positioning mode control numbered 1 in the figure is set in the playback interface. Click the positioning mode control, and the display style of the positioning mode control is as shown in Figure 7B . At this time, it can be determined that the positioning mode has been enabled.
[0151] Step 202b, the terminal responds to the trigger operation on the positioning mode control and controls to enter the positioning mode for adjusting the playback progress of the media information.
[0152] Exemplarily, click the positioning mode control in Figure 7A , and the display style of the positioning mode control is as shown in Figure 7B . At this time, it can be determined that the video information has been switched from the normal playback mode to the positioning mode.
[0153] In actual implementation, when the positioning mode is started, the terminal can use some interface manifestations to prompt the user that the positioning mode has been started currently. The progress bar of the media information can be set to a blinking form, or the progress indication mark in the progress bar blinks to inform the user that the positioning mode has been enabled.
[0154] Exemplarily, refer to Figure 8 , Figure 8It is a schematic diagram of the orientation for setting the positioning mode provided by an embodiment of the present application. After starting the positioning mode through step 201a - 202a or step 201b - 202b, the orientation information for setting the positioning mode is displayed in the form of a semi - transparent floating layer (the floating layer shown by the number 1 in the figure) on the playback interface of the media information. In the form of information prompts (the information prompts shown by the number 2), the user is informed that the current positioning mode has been started. In the case where the user does not perform any operations, the guiding floating layer will automatically disappear after a preset time (as shown in the figure, the guiding floating layer will close after 10s). At the same time, the user can also perform corresponding operations according to the guiding information shown in the guiding floating layer (shown by the numbers 3 and 4 in the figure). For the operation shown by the number 3 in the figure, input digital information (such as 30s) in the current guiding floating layer. When swiping to the right, the playback progress of the media information can be fast - forwarded by 30s; when swiping to the left, the playback progress of the media information can be rewound by 30s. For the operation shown by the number 4 in the figure, input digital information (such as 10 minutes and 30 seconds) in the current guiding floating layer. When performing an upward swipe operation, the playback progress of the media information can be directly positioned from the current 09:49 to the playback progress position of 10:30.
[0155] It should be noted that in practical applications, the guiding floating layer can be a floating layer with the same size as the playback page and fully transparent. In this way, the normal playback of media information can be unaffected.
[0156] Step 203, during the process of playing media information, based on the playback page of the media information, receive the positioning time input in the positioning mode.
[0157] After starting the positioning mode through step 201a - 202a or step 201b - 202b, the positioning time can be input in the positioning mode.
[0158] An explanation of the input method of the positioning time is given. In some embodiments, the positioning time can be determined by performing a digital drawing operation on the playback page and parsing the drawn numbers. Refer to Figure 9 , Figure 9 It is a flowchart of the drawing method of the positioning time provided by an embodiment of the present application. Based on Figure 3 ,step 102 can be implemented by steps 1021a to 1022a.
[0159] Step 1021a, the terminal receives a first digital drawing operation on the playback page of the media information.
[0160] In actual implementation, the terminal can receive a digital drawing operation performed on the playback interface, indicating that the positioning mode for adjusting the playback progress of media information has been enabled. After the positioning mode is enabled, the user can perform a digital drawing operation on the terminal screen, and the terminal parses the number drawn by the digital drawing operation to determine the positioning time.
[0161] Step 1022a: Obtain the time unit corresponding to the playback progress adjustment, and use the time obtained by combining the number drawn by the first digital drawing operation and the time unit as the positioning time, where the positioning time corresponds to the adjustment duration of the media information.
[0162] In actual implementation, after the terminal receives the number drawn by the digital drawing operation, it can obtain the time unit corresponding to the preset playback progress adjustment (such as seconds, minutes, hours, etc.), and combine the drawn number with the time unit to obtain time information.
[0163] Exemplarily, see Figure 10 , Figure 10 FIG. is a schematic diagram of the first digital drawing operation provided by an embodiment of the present application. Taking the time unit as minutes as an example, if the number drawn by the digital drawing operation received by the terminal (the number drawn by the digital drawing operation shown by the number 1 in the figure) is 3, it can be determined that the positioning time is the combination of the number "3" and the time unit "minutes", and the positioning time is determined to be 3 minutes, that is, the adjustment duration corresponding to the media information is 3 minutes.
[0164] In some embodiments, the information drawn by the digital drawing operation can be a number with a certain format, and the terminal determines the positioning time by splitting the number with the target digital format. See Figure 11 , Figure 11 FIG. is a flowchart of the drawing method of the positioning time provided by an embodiment of the present application. Based on Figure 3 ,Step 102 can be implemented by steps 1021b to 10,23b.
[0165] Step 1021b: The terminal receives a second digital drawing operation on the playback page of the media information.
[0166] In actual implementation, the terminal receives a digital drawing operation performed by the user on the playback interface, and the number drawn by the digital drawing operation has a digital format.
[0167] Exemplarily, see Figure 12 , Figure 12 FIG. is a schematic diagram of the second digital drawing operation provided by an embodiment of the present application. The number shown by the number 1 in the figure is the number drawn by performing the second digital drawing operation, and "3.45" is a number with a decimal style.
[0168] Step 1022b: When the number drawn by the second number drawing operation has the target number format, obtain the time units corresponding to each part in the target number format.
[0169] In actual implementation, the terminal obtains the target number format corresponding to the number drawn by the number drawing operation, splits the number drawn by the number drawing operation according to the parsing rules of the target number format to obtain at least two number parts, and obtains the time units corresponding to each part.
[0170] Exemplarily, see Figure 12 , the number drawn by the number drawing operation is "3.45", the number format is a decimal style. The terminal uses the symbol "." as the separator to split the number "3.45" to obtain the first part of the number "3" and the second part of the number "45", and obtains the time units corresponding to each part in the decimal style. The time unit corresponding to the first part is minutes, and the time unit corresponding to the second part is seconds.
[0171] Step 1023b: Combine the time units and the numbers in the target number format to obtain the positioning time, and the positioning time corresponds to the adjustment duration of the media information.
[0172] In actual implementation, combine each number part determined in step 1022b and the corresponding time units to determine the positioning time.
[0173] Exemplarily, see Figure 12 , it can be determined that the positioning time determined according to the current number drawing operation is 3 minutes and 45 seconds.
[0174] In some embodiments, see Figure 13 , Figure 13 is the flowchart of the input method of the positioning time provided by the embodiment of the present application. Based on Figure 3 , step 102 can also be implemented through steps 1021c to 1022c.
[0175] Step 1021c: The terminal presents a time input box in the target time format on the playback page of the media information.
[0176] In actual implementation, a time input box can be presented on the playback page of the media information, and the positioning time is determined according to the number input in the time input box.
[0177] In some embodiments, the time input box for the positioning time can be presented in the following way: on the playback page of the media information, present the time input box in the target time format in the form of a floating window, and the time input box has a preset transparency.
[0178] In actual implementation, after the positioning mode is turned on, the time input box can be presented in the form of a floating window for the user to input time in the input box.
[0179] Exemplarily, refer to Figure 14 , Figure 14 which is a schematic diagram of the time input method provided by an embodiment of the present application. After the positioning mode is turned on, a time input box (the time input box numbered 1 in the figure) is presented in the form of a floating window (the floating window numbered 0 in the figure). In order to facilitate user input and recognition, a time input box containing hours, minutes, and seconds can be directly presented. The input box numbered 2 in the figure is the time input box corresponding to "hours", the input box numbered 3 in the figure is the time input box corresponding to "minutes", and the input box numbered 4 in the figure is the time input box corresponding to "seconds". The input cursor blinks at the input box numbered 2. The user can input the corresponding time in the three time input boxes according to actual needs. For the time input operation, it can be that after the time input box obtains focus, the numeric keypad is called up and numbers are selected for input; it can also be that after the time input box obtains focus, a digital drawing operation is directly performed, and the numbers drawn by the digital drawing operation are filled into each time input box.
[0180] Step 1022c: Receive the numbers input in the time input box, combine the input numbers and the target time format to obtain the positioning time, and use the positioning time as the target time point.
[0181] In actual implementation, the terminal parses the numbers input in the time input box and determines the positioning time according to the set target time format.
[0182] Exemplarily, refer to Figure 14 , input the number 3 in the time input box corresponding to "minutes" numbered 3, input the number 45 in the time input box corresponding to "seconds" numbered 4, and combine the number format to determine that the positioning time is 3 minutes and 45 seconds.
[0183] In some embodiments, refer to Figure 15 , Figure 15 which is a schematic diagram of the positioning time determination method provided by an embodiment of the present application. Based on Figure 3 , step 102 can also be implemented through steps 1021d to 1022d.
[0184] Step 1021d: The terminal presents a digital input area on the playback page of the media information. The digital input area is used to input numbers corresponding to the duration adjustment unit of the media information, and the numbers are used to indicate the quantity of the duration adjustment unit.
[0185] In some embodiments, the media information can be video data. The data structure of the video data is described. Figure 16 which is a schematic diagram of the data structure of the video data provided by an embodiment of the present application. Refer to Figure 16, video data can be structurally divided into four levels: movie, scene, shot, and frame. Visually continuous video is formed by continuously projecting a series of still images onto a screen or display. These still images are video frames. During video shooting, a continuous segment of video captured by a camera is called a shot. A shot is the basic unit of video data. Several shots with similar content form a scene, which describes the same event from different perspectives, and a movie is composed of many scenes, telling a complete story.
[0186] In actual implementation, when the media information is video data, the scenes, shots, frames, etc. included in the video data can be used as the duration adjustment units to adjust the playback progress of the video data.
[0187] Step 1022d: Receive the number input in the digital input area, and use the time required for the duration adjustment unit of the adjustment quantity as the positioning time.
[0188] Exemplarily, taking a video data as a movie as an example, assume the movie includes 100 scenes and uses the scene as the duration adjustment unit. In the positioning mode, when receiving the number "6" corresponding to the duration adjustment unit of the media information, it can be determined that the positioning time is the duration corresponding to 6 scenes.
[0189] In some embodiments, after the positioning mode is started, the terminal detects the positioning time input operation for the playback page; when no positioning time input operation is detected within the target duration, it controls to exit the positioning mode.
[0190] Exemplarily, in the positioning mode, if the terminal does not receive the user's input operation for the positioning time for more than 3 seconds, it can automatically exit the positioning mode and enter the normal playback mode of the media information.
[0191] In some embodiments, refer to Figure 17 , Figure 17 is the schematic flowchart of the playback progress adjustment method provided by the embodiment of the present application. After the terminal receives the positioning time input on the playback page of the media information, it can also execute steps 301a to 304a to generate the corresponding progress adjustment instruction.
[0192] Step 301a: The terminal receives a sliding operation on the playback page of the media information.
[0193] In actual implementation, after the terminal receives the positioning time, it can trigger the corresponding progress adjustment instruction according to the received sliding operation.
[0194] Step 302a: The terminal obtains the sliding trajectory corresponding to the sliding operation.
[0195] In actual implementation, the terminal obtains the sliding trajectory corresponding to the sliding operation and parses the corresponding sliding trajectory parameters, which may include the sliding direction, the starting position of the slide, the ending position of the slide, the sliding length, etc.
[0196] Exemplarily, referring to Figure 18 , Figure 18 is a schematic diagram of the sliding trajectory provided by an embodiment of the present application. In the positioning mode, for the sliding trajectories corresponding to the sliding operations on the playback page (shown as number 1 in the figure and shown as number 2 in the figure), the sliding direction of the sliding trajectory shown as number 1 is to the right, and the sliding length can be determined by the starting position of the slide (shown as number a) and the ending position of the slide (shown as number b). The sliding direction of the sliding trajectory shown as number 2 in the figure is to the left, and the sliding length can be determined by the starting position shown as number c and the ending position shown as number d.
[0197] Step 303a, when the sliding trajectory meets the first preset condition, the terminal generates a progress adjustment instruction indicating fast-forwarding the playback of the media information.
[0198] In actual implementation, a preset condition for the terminal to generate a progress adjustment instruction according to the sliding operation can be set. The preset condition may include at least one of the sliding trajectory meeting the first sliding direction and the length of the sliding trajectory reaching the sliding length threshold.
[0199] Exemplarily, when the sliding length threshold is set to 3 cm, the sliding trajectory with the sliding direction to the right can trigger a progress adjustment instruction for fast-forwarding the playback of the media information.
[0200] Step 304a, when the sliding trajectory meets the second preset condition, the terminal generates a progress adjustment instruction indicating fast-reverse the playback of the media information.
[0201] Exemplarily, when the sliding length threshold is set to 3 cm, the sliding trajectory with the sliding direction to the left can trigger a progress adjustment instruction for fast-reversing the playback of the media information.
[0202] In some embodiments, referring to Figure 19 , Figure 19 is a schematic flowchart of the playback progress adjustment method provided by an embodiment of the present application. After the terminal receives the positioning time input on the playback page of the media information, it can also execute steps 301b to 303b to generate corresponding progress adjustment instructions.
[0203] Step 301b, the terminal receives the input characters within the area associated with the time in the playback page.
[0204] In actual implementation, a progress adjustment instruction can also be generated according to the received specific characters.
[0205] Exemplarily, refer to Figure 20 , Figure 20 which is a schematic diagram of progress adjustment characters provided by an embodiment of the present application. In the positioning mode, the terminal receives the number "70" drawn by the user through digital drawing operations on the playback page, and the "+" character (shown as number 1 in the figure) drawn on the playback page, or continues to draw the "-" character (shown as number 2 in the figure) on the playback page. It should be noted that the "+" character and the "-" character on the playback page can be drawn on the playback page, or can be directly presented in the form of icons. Through the triggering operation based on the icons, the terminal generates corresponding progress adjustment instructions.
[0206] Step 302b, when the character is the first character, generate a progress adjustment instruction indicating to fast forward the playback of the media information.
[0207] In actual implementation, when the first character received by the terminal matches the preset fast forward character, a progress adjustment instruction indicating to fast forward the playback of the media information can be generated.
[0208] Exemplarily, assume that the preset fast forward characters are the "+" character, the "Q" character, etc. When the first character is the "+" character or the "Q" character, the terminal can generate a progress adjustment instruction for fast forward. Refer to Figure 20 , after the user inputs the positioning time "70" and continues to draw the "+" character shown as number 1, after the "+" character is drawn, the terminal generates a progress adjustment instruction for fast forwarding the playback progress of the video information.
[0209] Step 303b, when the character is the second character, generate a progress adjustment instruction indicating to rewind the playback of the media information.
[0210] In actual implementation, when the second character received by the terminal matches the preset rewind character, a progress adjustment instruction indicating to rewind the playback of the media information can be generated.
[0211] Exemplarily, assume that the preset fast forward characters are the "-" character, the "H" character, etc. When the second character is the "-" character or the "H" character, the terminal can generate a progress adjustment instruction for rewinding. Refer to Figure 20 , after the user inputs the positioning time "70" and continues to draw the "-" character shown as number 2, after the "-" character is drawn, the terminal generates a progress adjustment instruction for rewinding the playback progress of the video information.
[0212] In some embodiments, refer to Figure 21 , Figure 21 which is a schematic diagram of the process of the playback progress adjustment method provided by an embodiment of the present application. Based on Figure 3, after step 102, after the terminal receives the positioning time input on the playback page of the media information, it can also execute steps 301c to 303c to generate a corresponding progress adjustment instruction.
[0213] Step 301c, obtain the number of times of progress adjustment for the media information in history, and the progress adjustment direction corresponding to each progress adjustment.
[0214] In actual implementation, for the same media information within a period of time, multiple progress adjustments can be made. The terminal can record the number of progress adjustments and the progress adjustment direction corresponding to each progress adjustment.
[0215] Exemplarily, within half an hour, video information A has been subjected to 3 progress adjustments, and each time it is a fast-forward operation.
[0216] Step 302c, predict the adjustment direction of the media information based on the number of times and the progress adjustment direction corresponding to each progress adjustment to obtain the target adjustment direction.
[0217] In actual implementation, the number of times of progress adjustment for the media information and the progress adjustment direction in the historical data can be used as training sample features to train a machine learning model for predicting the progress adjustment direction. When the positioning mode is turned on again, after receiving the input positioning time, the terminal predicts the adjustment direction of the media information this time through the trained machine learning model to obtain the predicted adjustment direction, and uses the obtained predicted adjustment direction as the target adjustment direction.
[0218] Step 303c, generate a progress adjustment instruction corresponding to the target adjustment direction.
[0219] In actual implementation, after obtaining the target adjustment direction for the media information, the terminal generates a progress adjustment instruction corresponding to the target adjustment direction. The target adjustment direction can be the fast-forward direction, and the terminal generates a fast-forward adjustment instruction; the target adjustment direction can be the fast-backward direction, and the terminal generates a fast-backward adjustment instruction.
[0220] In step 103, based on the positioning time, in response to the progress adjustment instruction for the media information, adjust the playback progress of the media information, and start playing the media information from the adjusted target time point.
[0221] In some embodiments, refer to Figure 22 , Figure 22 is the schematic flowchart of the playback progress adjustment method provided by the embodiment of the present application. Based on Figure 3 , step 103 can be described through the steps shown in Figure 22 illustrated.
[0222] Step 1031a, the terminal obtains the current playback time point of the media information and the progress adjustment direction indicated by the progress adjustment instruction.
[0223] Exemplarily, Figure 23A-23B is a schematic diagram for determining the progress adjustment direction provided by an embodiment of the present application. Refer to Figure 23A , taking the playback of video information as an example, "09:49" shown by the number a in the figure is the current playback time point of the video information. The terminal receives the number 30 for positioning the time input based on the playback page and combines it with the corresponding adjustment time "second" to form a progress duration "30 seconds" that can be adjusted for the playback progress. At the same time, the terminal receives the "swipe right" operation shown by the number b in the figure (the terminal pre-sets that "swipe right" is a fast-forward operation), that is, a fast-forward progress adjustment instruction is generated for the corresponding progress. Refer to Figure 23B , "09:49" shown by the number d in the figure is the current playback time point of the video information. The terminal receives the number 30 for positioning the time input based on the playback page and combines it with the corresponding adjustment time "second" to form a progress duration "30 seconds" that can be adjusted for the playback progress. At the same time, the terminal receives the "swipe left" operation shown by the number e in the figure (the terminal pre-sets that "swipe left" is a fast-rewind operation), that is, a fast-rewind progress adjustment instruction is generated for the corresponding progress.
[0224] Step 1032a, based on the progress adjustment direction, the current playback time point, and the adjustment duration, determine the target time point.
[0225] Continuing with the above example, refer to Figure 23A , it is obtained that the progress adjustment direction is consistent with the progress control direction of the progress bar in the playback interface (fast-forward direction), the adjustment duration is "30 seconds", and fast-forwarding "30 seconds" from the current playback time point "09:49" gives the target time point as "10:19" shown by the number c in the figure. Refer to Figure 23B , it is obtained that the progress adjustment direction is opposite to the progress control direction of the progress bar in the playback interface (fast-rewind direction), the adjustment duration is "30 seconds", and fast-rewinding "30 seconds" from the current playback time point "09:49" gives the target time point as "09:19" shown by the number f in the figure.
[0226] Step 1033a, adjust the playback progress of the media information to the target time point and start playing the media information from the adjusted target time point.
[0227] Continuing with the above example, refer to Figure 23A , the terminal fast-forwards the playback progress of the media information to the target time point "10:19". Refer to Figure 23B , the terminal fast-rewinds the playback progress of the media information to the target time point "09:19".
[0228] In some embodiments, refer to Figure 24 ,Figure 24 This is a schematic flowchart of the playback progress adjustment method provided by an embodiment of the present application. When the duration adjustment unit is a scene or a shot of media information, based on Figure 3 Step 103 can also be implemented through steps 1031b to 1032b.
[0229] In step 1031b, the terminal obtains the current playback time point of the media information and the progress adjustment direction indicated by the progress adjustment instruction.
[0230] In step 1032b, starting from the current playback time point, according to the progress adjustment direction, the playback progress of the media information is adjusted so that the adjusted playback progress changes the playback scenes or shots of the target number, and starts playing from the changed playback scenes or shots.
[0231] In actual implementation, when the media information is video data (for the data structure of video information, see Figure 16 ), scenes, shots, frames, etc. included in the video data can be used as the duration adjustment unit to adjust the playback progress of the video data. Among them, the adjustable duration of the playback progress can be determined by the number of duration adjustment units. The number of duration adjustment units can be a number input by the user on the playback page, that is, the number input by the user on the playback page can be used as the target number of duration adjustment units. Taking the adjustment of scenes as an example, the terminal receives the number input by the user on the playback page to determine the number of scenes K (K is a positive integer) to be adjusted, the corresponding progress adjustment direction, and obtains the start time point and end time point corresponding to each scene, and determines the playback progress adjustment duration. It should be noted that since the current playback time point may be in the middle of a certain scene, when determining the progress adjustment duration, in addition to calculating the sum of the durations of K scenes, the duration that has not been played in the current scene needs to be added.
[0232] Exemplarily, see Figure 25 , Figure 25It is a schematic diagram of the method for calculating the progress adjustment duration provided by an embodiment of the present application. Taking video data as a movie as an example, assume that the movie includes 40 scenes, and each scene is represented by {s-i, e-i}, where s-i is the start time point of the i-th scene and e-i is the end time point of the i-th scene, i≥1 and i is an integer. Taking the scene as the duration adjustment unit, in the positioning mode, when receiving the number "3" corresponding to the duration adjustment unit of the media information and the corresponding fast-forward adjustment instruction, it can be determined that the adjustment duration is the duration corresponding to 3 scenes. The terminal determines the start time point (the time point shown as s-5 in the figure) and the end time point (the time point shown as e-5 in the figure) corresponding to the scene where the current playback time point shown in the figure is located, and continuously obtains the start time points and end time points corresponding to the subsequent 3 scenes (i.e., {s-6, e-6}, {s-7, e-7}, {s-8, e-8}), and then calculates that the duration to be adjusted is the sum of the differences of the three time points of {s-6, e-6}, {s-7, e-7}, {s-8, e-8}. Since the current playback time point is between {s-5, e-5}, the duration not played between {s-5, e-5} also needs to be added, and it can be adjusted to the time point shown in No. 2.
[0233] In some embodiments, refer to Figure 26 , Figure 26 It is a schematic diagram of the playback progress adjustment method provided by an embodiment of the present application. Based on Figure 3 , step 103 can be implemented through steps 1031c to 1032c.
[0234] Step 1031c, the terminal obtains the playback time axis corresponding to the media information.
[0235] In actual implementation, the playback time axis corresponding to the media information can be the entire playback duration of the media information, or the unplayed playback time axis from the current playback time point to the end time point of the media information playback, or the played playback time from the current playback time point to the start time point of the media information playback.
[0236] Exemplarily, refer to Figure 23A , the playback time axis can be the time between "09:49-44:30", or the time between "00:00-09:49".
[0237] Step 1032c, when it is determined that the target time point is within the playback time axis, adjust the playback progress of the media information to the target time point and start playing the media information from the adjusted target time point.
[0238] Exemplarily, refer to Figure 23A, when the progress adjustment instruction is a fast forward instruction, the corresponding playback timeline is (09:49 - 44:30). When the determined target time point is within (09:49 - 44:30), the terminal can adjust the playback progress of the media information (such as fast forward, etc.). When the progress adjustment instruction is a fast rewind instruction, the corresponding playback timeline is (00:00 - 09:49). When the determined target time point is within (00:00 - 09:49), the terminal can adjust the playback progress of the media information to the target time point (such as fast rewind to the target time point, etc.), and start playing the media information from the adjusted target time point.
[0239] Step 1033c, when it is determined that the target time point is not within the playback timeline, present an error prompt message or a repositioning indication message.
[0240] It should be noted that the error prompt message is used to indicate that the input of the positioning time size is incorrect; the repositioning indication message is used to indicate re - entering the positioning time on the playback page.
[0241] Exemplarily, refer to Figure 27 , Figure 27 is a schematic diagram of the prompt message provided by an embodiment of the present application. The terminal receives the positioning time "40:12" input by the user on the playback page and a progress adjustment instruction indicating fast forward. When the target time point (09:49 + 40:12 = 50:01) determined by the terminal is not within the (09:49 - 44:30) playback timeline, present the error prompt message "The adjustment duration determined by the positioning time has exceeded the adjustable duration. Please re - enter" shown as No. 1 in the figure in the form of a pop - up window or floating layer on the playback page.
[0242] In some embodiments, refer to Figure 28 , Figure 28 is a schematic diagram of the playback progress adjustment method provided by an embodiment of the present application. Based on Figure 3 , step 103 can be implemented through steps 1031d to 1032d.
[0243] Step 1031d, when the number of positioning times is at least two, obtain the progress adjustment direction indicated by the progress adjustment instruction.
[0244] Step 1032d, starting from the current playback time point of the media information, in accordance with the progress adjustment direction, using the positioning time as the adjustment duration, continuously perform at least two progress adjustments on the media information, where the media information playback duration corresponding to adjacent two progress adjustments is the target playback duration.
[0245] In actual implementation, the target playback duration can be pre - set by the user or be the system default.
[0246] Exemplarily, assume that the total duration of the media information is 30 minutes, the current playback time point of the media information is "3 minutes and 1 second", the target playback duration preset by the user is 5 minutes, and the terminal receives the positioning time "30-40-50" input by the user on the playback page. That is to say, the progress adjustment needs to be executed three times continuously. If the adjustment direction is fast forward, the first fast forward is 30 seconds, that is, from "3 minutes and 1 second" to "3 minutes and 31 seconds", and the media information starts to be played from "3 minutes and 31 seconds". After playing for 5 minutes, the second fast forward is 40 seconds, that is, from "8 minutes and 31 seconds" to "9 minutes and 11 seconds", and the media information starts to be played from "9 minutes and 11 seconds". After playing for 5 minutes again, the third fast forward is 50 seconds, that is, from "14 minutes and 11 seconds" to "15 minutes and 1 second", and the media information continues to be played from "15 minutes and 1 second".
[0247] In the embodiment of the present application, during the playback of media information, it is judged whether the positioning mode is started by the graph drawn by the received image drawing operation. In the case where the positioning mode is started, the positioning time input by the user through the digital drawing operation or the control input operation, and the progress adjustment instruction triggered by the user can directly adjust the playback progress of the media information to the target time point. In this way, the playback progress of the media information can be accurately adjusted to the specified time point. At the same time, only by inputting the positioning time on the playback page and then triggering the corresponding progress adjustment operation, it can help the user simply and accurately control the video playback progress and improve the user experience.
[0248] Next, the exemplary application of the embodiment of the present application in an actual application scenario will be described.
[0249] In the related art, the video playback client can realize the fast forward (or rewind) function for the played video by dragging the screen to the right (or left). This progress adjustment method is not easy to control. For different video playback clients, the time progress corresponding to the length of the drag distance is inconsistent. Some video playback clients can fast forward (or rewind) 30 minutes with a slight drag, but most video playback clients can fast forward 2 minutes by dragging the entire screen distance. If you want to fast forward for a relatively long time, you have to drag the screen multiple times, and the user experience is relatively poor. Moreover, when dragging the screen, the playback progress is not easy to accurately locate to a certain second, which affects the user experience. It is also possible to directly drag the video playback progress bar to achieve the purpose of positioning the video progress. However, since the progress block on the progress bar is relatively small, when the user's finger clicks on this small progress block on the screen, it is easy to misposition and cause mis-triggering. At the same time, when dragging the progress block, the user's hand will block the screen, and it is not easy to see the specific time dragged to currently, which also affects the user experience.
[0250] Based on this, an embodiment of the present application provides a method for playing video information, which can accurately locate the video progress and also implement fast forward or rewind operations for the video. Refer to Figure 29 , Figure 29 which is a schematic diagram of the method for playing video information provided by an embodiment of the present application. The method for playing video information will be described in combination with the steps shown in Figure 29 .
[0251] Step 401, the terminal presents a playback page and plays video information in the playback page.
[0252] In actual implementation, a video playback client is deployed on the terminal, and the video playback client plays video information in the playback page.
[0253] Step 402, when the terminal receives a graph drawn by a user through a graph drawing operation in the playback page of the video client, the accurate positioning mode is started.
[0254] In actual implementation, the terminal receives a graph drawing operation (user gesture) performed by the user in the playback page of the video client (on the terminal screen).
[0255] Exemplarily, refer to Figure 5A , the terminal receives a circular trajectory swiped out by the user in the video playback page (the graph numbered 1 in the figure), and the circular trajectory numbered 1 in the figure may not be displayed in actual implementation.
[0256] Step 403, in the accurate positioning mode, when the terminal receives the number drawn by the number drawing operation and the progress adjustment instruction triggered by the progress adjustment operation, the video information is adjusted to the specified playback progress.
[0257] In actual implementation, the user performs a number drawing operation on the terminal screen to obtain the drawn number. After the number drawing operation is completed, the terminal receives the user's operation of swiping from left to right (swiping right) or from right to left (swiping left) on the screen, triggering a fast forward adjustment instruction or a rewind adjustment instruction for the video, and the video can be fast forwarded or rewound by the number of seconds corresponding to the number from the current playback time point for playback. When the terminal receives the user's operation of swiping upward on the screen, a progress adjustment instruction for direct positioning of the video is triggered, and the video can be directly positioned to the specified time point for playback. If the number drawn by the number drawing operation contains a decimal point, the number before the decimal point can be regarded as the number of minutes, and the number after the decimal point can be regarded as the number of seconds.
[0258] Exemplarily, refer to Figure 30 , Figure 30It is a schematic diagram of the progress adjustment method provided by the embodiment of the present application. By performing a digital drawing operation to draw the number "34" shown in No. 1 on the playback page, and then swiping the page to the right, the video fast-forwards by 34 seconds; by performing a digital drawing operation to draw the number "13.45" shown in No. 2 on the playback page, and swiping the page to the right, the video fast-forwards by 13 minutes and 45 seconds. By performing a digital drawing operation to draw the number "14.5" shown in No. 3 on the playback page, and swiping the page upwards, the video directly jumps to 14 minutes and 5 seconds. After the video fast-forwards, rewinds, or directly jumps, all the sliding tracks on the screen disappear, and the video plays normally.
[0259] In actual implementation, refer to Figure 31 , Figure 31 It is a schematic diagram of the hierarchical structure of the video client playback page provided by the embodiment of the present application. After entering the video playback page, the video playback client (terminal) loads a transparent layer (the gesture response layer shown in the figure). This layer uniformly processes all the operation gestures of the received users, such as clicking to pause, double-clicking to like, etc. The trigger gesture of the precise positioning mode is also responded to on this layer. The transparent layer is above the video playback layer to ensure that the user's gestures can be normally responded to.
[0260] In the normal playback mode, the transparent layer normally responds to the user's gestures. Once it detects that the user triggers the precise positioning gesture, it enters the precise positioning mode. In the precise positioning mode, the touches and swipes of the user on the terminal screen are all considered to be fast-forwarding or rewinding operations. At this time, operations such as double-clicking to like and pausing cannot be performed. In the precise positioning mode, if the user does not click on the screen for more than the preset time threshold (such as 3 seconds), it automatically exits the precise positioning mode and enters the normal playback mode. At this time, the user can normally double-click to like, pause, etc.
[0261] For the recognition of the trigger of the precise positioning gesture, it is completed by the video playback client and can be divided into three steps. When these three steps are all completed, it can be determined that the precise positioning gesture has been completed. Otherwise, it is processed according to the normal click or drag gesture. The implementation process is as follows: 1. Start trigger. In the playback page, when the finger touches the screen, it is considered that the start trigger step is completed. When starting the trigger, the position where the screen is clicked needs to be recorded. 2. Swipe. After the finger touches the screen, it cannot leave the screen, and a circle needs to be drawn. When the finger slides on the screen, the mobile phone system will feedback the current position of the finger to the video playback client. At this time, the video playback client samples and records the finger position every certain period of time (such as 50ms). The sampling and recording process continues until the user's finger leaves the screen. 3. Complete trigger. When the user's finger leaves the screen, it is considered that the overall process of the trigger is completed. At this time, the video playback client needs to record the position where the finger leaves the screen.
[0262] After the above three steps are completed, the video playback client will record the click start position, end position, and several sampled positions recorded during the sliding process. The video playback client will judge whether the precise positioning gesture is triggered based on these positions. The judgment process can be: if the distance between the start position and the end position exceeds a certain threshold (such as 200 pixels), it is considered that the user fails to draw a circle and does not trigger the precise positioning gesture. It can also be that more than 40% of the position points in the sampled points are at a distance exceeding a certain threshold (such as 500 pixels) from the start position, otherwise it is considered that the user fails to draw a circle and does not trigger the precise positioning gesture. It is also possible to perform a block judgment on the sampled points. The rule for block division is: assume that there are 2n (n is a positive integer) sampled points in total, then calculate the distance between the first point and the nth point, and calculate the distance between the second point and the (n + 1)th point until the distance between the last nth and 2nth points is calculated. Then count these distances. When more than 40% of the distance lengths exceed a certain threshold (such as 500 pixels), the gesture is considered to be triggered successfully, otherwise it is considered that the user fails to draw a circle and does not trigger the precise positioning gesture.
[0263] If all the above steps are completed and the above judgment process is passed, it is considered that the user has triggered the precise positioning gesture. Otherwise, it is processed according to the ordinary gesture.
[0264] Exemplarily, see Figure 5C , in the first figure, because the start position and the end position are too far apart, it is considered an invalid gesture. In the second figure, because less than 40% of the sampled points are at a distance exceeding the threshold from the starting point, it is considered an invalid gesture. In the third figure, because the distances between the points do not meet the condition that more than 40% exceed the threshold, it is considered an invalid gesture. In the fourth figure, since the above conditions are met, it can be considered a valid gesture.
[0265] In actual implementation, in the precise positioning mode, any click or slide operation on the screen by the user is considered to be writing numbers or drawing a completed gesture. At this time, the entire transparent layer is regarded as a canvas, and the trajectory of the user's slide gesture and click gesture will be drawn on the transparent layer. Since the transparent layer and the playback layer are separate, the process of the user's drawing does not affect the video playback.
[0266] In actual implementation, the recognition of the completed gesture is completed by the video client's judgment of the user's gesture. The whole process is similar to the process of drawing a circle, but it is not as complex as drawing a circle. It only needs to judge whether it is a simple gesture such as from top to bottom, from left to right, etc.
[0267] In actual implementation, for the recognition of the digits drawn by the digit drawing operation, the optical character recognition (OCR) method or a machine learning model for digit recognition can be used. That is, when the user triggers the precise positioning mode, the transparent layer will monitor each handwritten action of the user and determine whether the current handwritten input is a completion gesture. If a completion gesture is recognized, the offline OCR technology will be used to transfer the current transparent layer to the OCR scanning function. Since the layer only contains handwritten digits and the completion gesture trajectory, even for offline judgment, the recognition time will be extremely short. Moreover, this OCR recognition only recognizes digits. Once a non-digit input is recognized, the current input will be directly discarded and the user will be prompted to input digits. In this way, the recognition success rate will basically reach 100%.
[0268] In actual implementation, each time after fast forward / rewind, it will automatically return to the normal response mode until the user triggers the precise positioning mode again. If the user's input is incorrect or contains other characters, the trajectory of the current input will be cleared, and at the same time, it will remain in the precise positioning mode, waiting for the user's next input. If the user does not touch the screen for 3 seconds, the precise positioning mode will be automatically exited.
[0269] In actual implementation, after recognizing the digits and gestures, the video playback client will increase or decrease the corresponding number of seconds based on the current video progress, and then locate to the new video progress.
[0270] It should be noted that in actual implementation, the gesture for triggering precise positioning is not limited to a circle. It can be any shape such as a square or a star. When writing digits and completing gestures, the color of the sliding trajectory can be customized, and the color of a line segment does not have to be unique. It can be a gradient color.
[0271] Exemplarily, taking the realization of a precise positioning to adjust the video playback progress as an example, see Figure 32 , Figure 32Schematic diagram of the video playback progress adjustment method provided by the embodiments of the present application. The implementation process is as follows: The terminal executes step S1: Present the playback page. Further, the terminal executes step S2: Load the gesture recognition layer. The terminal executes step S3: Play the video information. Further, the terminal executes step S4: Determine whether a precise positioning gesture is triggered, that is, determine whether the gesture trajectory of the user's graphic drawing operation on the gesture recognition layer is a precise positioning gesture. If the trigger of the precise positioning gesture fails, the video is played normally on the playback page. If the trigger of the precise positioning gesture is successful, the terminal executes step S5: The user makes a handwritten input, that is, receives the digital drawing operation executed by the user on the playback page. Then the terminal executes step S6: Determine whether a completion gesture is triggered, that is, when the user's handwritten input is completed, continue to perform a sliding operation on the playback page to trigger the completion gesture. The terminal further determines whether the completion gesture is triggered. If the trigger of the completion gesture fails, execute step S9: Clear the trace, that is, clear the user's handwritten input trace. If the trigger of the completion gesture is successful, generate a corresponding progress adjustment instruction (such as fast forward, fast backward, direct positioning, etc.). After receiving the progress adjustment instruction, before making a progress adjustment, the terminal can execute step S7: Recognize the number, that is, recognize the number drawn by the user's digital drawing operation, which can be recognized by OCR. The terminal continues to execute step S8: Determine whether the number recognition is successful. If the recognition is not successful, step S9 can be executed: Clear the trace, that is, clear the trace drawn by the user's digital drawing operation on the playback page, and after clearing the trace, continue to receive the user's handwritten input operation, that is, step S5 can be continued; if the recognition is successful, step S10 can be executed: Jump to the specified playback progress and execute step S3, that is, start playing the video from the specified playback progress.
[0272] Through the progress adjustment method provided by the embodiments of the present application, the playback progress of video information can be adjusted simply and efficiently. Due to the use of the offline OCR technology and only 10 characters, namely 0-9 and the decimal point, need to be recognized, the recognition accuracy is high and the recognition time is short, which overall improves the user experience of setting the video progress.
[0273] Next, continue to describe the exemplary structure of the software module implementation of the media information playback device 555 provided by the embodiments of the present application. In some embodiments, as Figure 2 shown, the software module in the media information playback device 555 stored in the memory 550 may include:
[0274] The playback module 5551 is used to play media information in the media information playback interface;
[0275] A receiving module 5552, configured to receive a positioning time input on a playback page of the media information during the playback of the media information; wherein the positioning time is used to adjust the playback progress of the media information to a target time point.
[0276] An adjustment module 5553, configured to, based on the positioning time, in response to a progress adjustment instruction for the media information, adjust the playback progress of the media information to the target time point, and start playing the media information from the adjusted target time point.
[0277] In some embodiments, the receiving module is further configured to receive a graphic drawing operation on the playback page before receiving the positioning time input on the playback page of the media information; when the graphic drawn by the graphic drawing operation matches a preset graphic, control enters a positioning mode for adjusting the playback progress of the media information.
[0278] In some embodiments, the receiving module is further configured to present a positioning mode control on the media information playback interface before receiving the positioning time input on the playback page of the media information; in response to a trigger operation on the positioning mode control, control enters a positioning mode for adjusting the playback progress of the media information.
[0279] In some embodiments, the receiving module is further configured to receive a positioning time input in the positioning mode based on the playback page of the media information during the playback of the media information.
[0280] In some embodiments, the receiving module is further configured to detect a positioning time input operation on the playback page after controlling to enter a positioning mode for adjusting the playback progress of the media information; when the positioning time input operation is not detected within a target duration, control exits the positioning mode.
[0281] In some embodiments, the receiving module is further configured to receive a first digital drawing operation on the playback page of the media information; obtain a time unit corresponding to the playback progress adjustment, and use the time obtained by combining the number drawn by the first digital drawing operation and the time unit as the positioning time; wherein the positioning time corresponds to an adjustment duration of the media information.
[0282] In some embodiments, the receiving module is further configured to receive a second digital drawing operation on the playback page of the media information; when the number drawn by the second digital drawing operation has a target digital format, obtain the time units corresponding to each part in the target digital format; combine the time units and the number in the target digital format to obtain the positioning time, where the positioning time corresponds to the adjustment duration of the media information.
[0283] In some embodiments, the receiving module is further configured to present a time input box in the target time format on the playback page of the media information; receive the number input in the time input box, combine the input number and the target time format to obtain the positioning time, and use the positioning time as the target time point.
[0284] In some embodiments, the receiving module is further configured to present a time input box in the target time format in the form of a floating window on the playback page of the media information, and the time input box has a preset transparency.
[0285] In some embodiments, the receiving module is further configured to present a digital input area on the playback page of the media information, where the digital input area is used to input a number corresponding to the duration adjustment unit of the media information, and the number is used to indicate the quantity of the duration adjustment unit; receive the number input in the digital input area, and use the time required to adjust the quantity of the duration adjustment unit as the positioning time.
[0286] In some embodiments, the adjustment module is further configured to obtain the current playback time point of the media information and the progress adjustment direction indicated by the progress adjustment instruction; based on the progress adjustment direction, the current playback time point, and the adjustment duration, determine the target time point; and adjust the playback progress of the media information to the target time point.
[0287] In some embodiments, the duration adjustment unit is a scene or a shot of the media information; when adjusting the playback progress of the media information, the adjustment module is further configured to obtain the current playback time point of the media information and the progress adjustment direction indicated by the progress adjustment instruction; starting from the current playback time point, adjust the playback progress of the media information in the progress adjustment direction so that the adjusted playback progress changes the quantity of the playback scenes or shots.
[0288] In some embodiments, the receiving module is further configured to, after receiving the positioning time input on the playback page of the media information, receive a sliding operation on the playback page of the media information; obtain the sliding trajectory corresponding to the sliding operation; when the sliding trajectory meets the first preset condition, generate a progress adjustment instruction indicating fast-forwarding the playback of the media information; and when the sliding trajectory meets the second preset condition, generate a progress adjustment instruction indicating rewinding the playback of the media information.
[0289] In some embodiments, the receiving module is further configured to, after receiving the positioning time input on the playback page of the media information, receive an input character within the area associated with the positioning time on the playback page; when the character is the first character, generate a progress adjustment instruction indicating fast-forwarding the playback of the media information; and when the character is the second character, generate a progress adjustment instruction indicating rewinding the playback of the media information.
[0290] In some embodiments, the receiving module is further configured to, after receiving the positioning time input on the playback page of the media information, obtain the number of times of progress adjustment for the media information in the past and the progress adjustment direction corresponding to each progress adjustment; based on the number of times and the progress adjustment direction corresponding to each progress adjustment, predict the adjustment direction of the media information to obtain a target adjustment direction; and generate a progress adjustment instruction corresponding to the target adjustment direction.
[0291] In some embodiments, the adjustment module is further configured to obtain the playback timeline corresponding to the media information; when it is determined that the target time point is within the playback timeline, adjust the playback progress of the media information; when it is determined that the target time point is not within the playback timeline, present an error prompt message or a repositioning indication message; wherein, the error prompt message is used to indicate that the input of the size of the positioning time is incorrect; and the repositioning indication message is used to indicate re-inputting the positioning time on the playback page.
[0292] In some embodiments, the adjustment module is further configured to, when the number of positioning times is at least two, obtain the progress adjustment direction indicated by the progress adjustment instruction; starting from the current playback time point of the media information, continuously perform the at least two progress adjustments on the media information in accordance with the progress adjustment direction, with the positioning time as the adjustment duration; wherein, the playback duration of the media information corresponding to two adjacent progress adjustments is the target playback duration.
[0293] An embodiment of the present application provides a computer program product or a computer program. The computer program product or the computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. A processor of an electronic device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the electronic device executes the method for playing media information described above in the embodiment of the present application.
[0294] An embodiment of the present application provides a computer-readable storage medium storing executable instructions, where the executable instructions are stored. When the executable instructions are executed by a processor, the processor will be caused to execute the method for playing media information provided in the embodiment of the present application. For example, as Figure 3 the method for playing media information shown.
[0295] In some embodiments, the computer-readable storage medium may be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash memory, magnetic surface memory, optical disc, or CD-ROM; or may be various devices including one or any combination of the above memories.
[0296] In some embodiments, the executable instructions may be in the form of a program, software, software module, script, or code, and may be written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including being deployed as an independent program or being deployed as a module, component, subroutine, or other unit suitable for use in a computing environment.
[0297] As an example, the executable instructions may or may not correspond to a file in a file system, and may be stored as part of a file that stores other programs or data. For example, stored in one or more scripts in a Hyper Text Markup Language (HTML) document, stored in a single file dedicated to the program being discussed, or stored in multiple cooperating files (for example, files storing one or more modules, subroutines, or code portions).
[0298] As an example, the executable instructions may be deployed to be executed on one electronic device, or on multiple electronic devices located at one location, or on multiple electronic devices distributed at multiple locations and interconnected by a communication network.
[0299] In summary, through the embodiment of the present application, the playing progress of media information can be accurately adjusted to a specified time point. At the same time, only by entering the positioning time on the playing page and then triggering the corresponding progress adjustment operation, it can help users simply and accurately control the video playing progress and improve the user experience.
[0300] The above are only embodiments of the present application and are not intended to limit the protection scope of the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and scope of the present application are all included in the protection scope of the present application.
Claims
1. A method for playing media information, characterized in that The method includes: In a media information playback interface, play media information; During the process of playing the media information, receive a positioning time input on the playback page of the media information; Wherein, the positioning time is used to adjust the playback progress of the media information to a target time point; Based on the positioning time, in response to a progress adjustment instruction for the media information, adjust the playback progress of the media information to the target time point, and start playing the media information from the adjusted target time point; When the number of the positioning times is at least two, the adjusting the playback progress of the media information to the target time point includes: Obtain the progress adjustment direction indicated by the progress adjustment instruction; Starting from the current playback time point of the media information, in accordance with the progress adjustment direction, using the positioning time as the adjustment duration, continuously perform at least two progress adjustments on the media information; Wherein, the playback duration of the media information corresponding to two adjacent progress adjustments is the target playback duration.
2. The method according to claim 1, wherein The receiving a positioning time input on the playback page of the media information during the process of playing the media information includes: During the process of playing the media information, based on the playback page of the media information, receive a positioning time input in a positioning mode; Before receiving the positioning time input on the playback page of the media information, the method further includes: Receive a graphic drawing operation on the playback page; When the graphic drawn by the graphic drawing operation matches a preset graphic, control to enter a positioning mode for adjusting the playback progress of the media information.
3. The method according to claim 1, characterized in that, The receiving a positioning time input on the playback page of the media information during the process of playing the media information includes: During the process of playing the media information, based on the playback page of the media information, receive a positioning time input in a positioning mode; Before receiving the positioning time input on the playback page of the media information, the method further includes: In the media information playback interface, present a positioning mode control; In response to a trigger operation on the positioning mode control, control to enter a positioning mode for adjusting the playback progress of the media information.
4. The method according to claim 2 or 3, characterized in that, After controlling to enter a positioning mode for adjusting the playback progress of the media information, the method further includes: Detect a positioning time input operation on the playback page; When the positioning time input operation is not detected within a target duration, control to exit the positioning mode.
5. The method according to claim 1, wherein The receiving a positioning time input on the playback page of the media information includes: In the playback page of the media information, receive a first digital drawing operation; Obtain the time unit corresponding to the playback progress adjustment, and use the time obtained by combining the number drawn by the first digital drawing operation and the time unit as the positioning time; Wherein, the positioning time corresponds to the adjustment duration of the media information.
6. The method according to claim 1, wherein The receiving a positioning time input on the playback page of the media information includes: In the playback page of the media information, receive a second digital drawing operation; When the number drawn by the second number drawing operation has a target number format, obtain the time units corresponding to each part in the target number format; Combine the time units and the number in the target number format to obtain the positioning time, and the positioning time corresponds to the adjustment duration of the media information.
7. The method according to claim 5 or 6, characterized in that When the number of positioning times is one, adjusting the playback progress of the media information to the target time point includes: Obtain the current playback time point of the media information and the progress adjustment direction indicated by the progress adjustment instruction; Determine the target time point based on the progress adjustment direction, the current playback time point, and the adjustment duration; Adjust the playback progress of the media information to the target time point.
8. The method according to claim 1, characterized in that, Receiving the positioning time input on the playback page of the media information includes: On the playback page of the media information, present a time input box in the target time format; Receive the number input in the time input box, combine the input number and the target time format to obtain the positioning time, and use the positioning time as the target time point.
9. The method according to claim 8, wherein Presenting a time input box in the target time format on the playback page of the media information includes: On the playback page of the media information, present a time input box in the target time format in the form of a floating window, and the time input box has a preset transparency.
10. The method according to claim 1, wherein Receiving the positioning time input on the playback page of the media information includes: On the playback page of the media information, present a digital input area for inputting a number corresponding to the duration adjustment unit of the media information, and the number is used to indicate the quantity of the duration adjustment unit; Receive the number input in the digital input area, and use the time required to adjust the duration of the quantity of the duration adjustment unit as the positioning time.
11. The method according to claim 10, wherein In the case where the positioning time is the time required to adjust the quantity of the duration adjustment unit, the duration adjustment unit is the scene or shot of the media information; adjusting the playback progress of the media information to the target time point includes: Obtain the current playback time point of the media information and the progress adjustment direction indicated by the progress adjustment instruction; Starting from the current playback time point, adjust the playback progress of the media information to the target time point in accordance with the progress adjustment direction, so that the adjusted playback progress changes the quantity of the playback scenes or shots.
12. The method according to claim 1, wherein After receiving the positioning time input on the playback page of the media information, the method further includes: Receiving a sliding operation on the playback page of the media information; Obtain the sliding trajectory corresponding to the sliding operation; When the sliding trajectory meets the first preset condition, generate a progress adjustment instruction indicating fast forward of the playback of the media information; When the sliding trajectory meets the second preset condition, generate a progress adjustment instruction indicating rewind of the playback of the media information.
13. The method according to claim 1, characterized in that, After receiving the positioning time input on the playback page of the media information, the method further includes: In the area associated with the positioning time in the playback page, a character is input received; When the character is the first character, a progress adjustment instruction is generated to indicate fast-forwarding the playback of the media information; When the character is the second character, a progress adjustment instruction is generated to indicate rewinding the playback of the media information.
14. The method according to claim 1, wherein After receiving the positioning time input on the playback page of the media information, the method further includes: Obtaining the number of times of progress adjustment of the media information in history, and the progress adjustment direction corresponding to each progress adjustment; Predicting the adjustment direction of the media information based on the number and the progress adjustment direction corresponding to each progress adjustment to obtain a target adjustment direction; Generating a progress adjustment instruction corresponding to the target adjustment direction.
15. The method according to claim 1, wherein Adjusting the playback progress of the media information to the adjustment made when the target time point is within the playback time axis, the playback time axis being obtained based on the media information, the method further includes: When it is determined that the target time point is not within the playback time axis, presenting an error prompt message or a repositioning indication message; Wherein, the error prompt message is used to indicate that the input of the size of the positioning time is incorrect; the repositioning indication message is used to indicate re-inputting the positioning time on the playback page.
16. A playback device for media information, characterized in that, The apparatus includes: A playback module, configured to play media information in a media information playback interface; A receiving module, configured to receive, during the playback of the media information, a positioning time input on the playback page of the media information; wherein, the positioning time is used to adjust the playback progress of the media information to a target time point; An adjustment module, configured to, based on the positioning time, in response to a progress adjustment instruction for the media information, adjust the playback progress of the media information to the target time point, and start playing the media information from the adjusted target time point; The adjustment module is further configured to, when the number of the positioning times is at least two, obtain the progress adjustment direction indicated by the progress adjustment instruction; Starting from the current playback time point of the media information, continuously performing at least two progress adjustments on the media information in accordance with the progress adjustment direction, with the positioning time as the adjustment duration; Wherein, the playback duration of the media information corresponding to two adjacent progress adjustments is the target playback duration.
17. An electronic device, characterized in that, Includes: A memory, configured to store executable instructions; A processor, configured to, when executing the executable instructions stored in the memory, implement the media information playback method according to any one of claims 1 to 15.
18. A computer-readable storage medium storing executable instructions, characterized in that, The executable instructions, when executed by the processor, implement the media information playback method according to any one of claims 1 to 15.
19. A computer program product comprising a computer program or instructions, characterized in that, The computer program or instruction, when executed by the processor, implements the media information playback method according to any one of claims 1 to 15.
Citation Information
Patent Citations
Video playing method and device, terminal equipment and computer readable storage medium
CN113271490A
Disk recording / Reproducing device
JP2000123553A