A time configuration method, device, equipment and product of an audio clip

Abstract

The embodiment of the present disclosure provides a time configuration method, device, equipment and product of an audio clip, wherein the method comprises the following steps: displaying a first interface, wherein a first video clip and at least one first audio clip are displayed in the first interface; in response to a trigger event, selecting a second audio clip; displaying a first page in the first interface, wherein the first page comprises time configuration information of the second audio clip, and the time configuration information represents a starting playing time of the second audio clip in a playing process of the first video clip, and the time configuration information of the second audio clip is obtained by executing a first script. By executing the first script, the time configuration information of the second audio clip is automatically generated, the time configuration information of at least one second audio clip is automatically batch-set, the efficiency is improved, and human errors are reduced.

Description

Technical Field

[0001] This disclosure relates to the field of audio processing technology, and in particular to a method, apparatus, device, and product for time configuration of audio segments. Background Technology

[0002] In audio and video data processing, to achieve time synchronization between audio segments and video frames, it is usually necessary to configure the start playback time of each audio segment during the playback of the target video segment. Current processing methods primarily rely on operators manually reading the relative time positions of the video and audio based on a time scale in a graphical interface, and then manually calculating and generating the time configuration information for each audio segment.

[0003] When there are a large number of audio segments to be processed, the manual configuration method cannot be used to perform batch linkage calculations using automated scripts. This results in the system having to maintain repetitive scheduling tasks for a long time, leading to low overall data processing efficiency and difficulty in ensuring the consistency of time configuration. Summary of the Invention

[0004] This disclosure provides a method, apparatus, device, and product for configuring the timing of audio segments, thereby enabling automatic batch setting of timing configuration information for audio segments, replacing manual operation, improving efficiency, and reducing human error.

[0005] According to one aspect of this disclosure, a method for time configuration of an audio segment is provided, comprising: A first interface is displayed, which displays a first video clip and at least one first audio clip; In response to a trigger event, a second audio segment is selected, the second audio segment being at least a portion of the first audio segment, and the second audio segment being an audio segment to be played in the first video segment; The first page is displayed in the first interface. The first page includes the time configuration information of the second audio segment. The time configuration information represents the start playback time of the second audio segment during the playback of the first video segment. The time configuration information of the second audio segment is obtained by executing the first script.

[0006] According to another aspect of this disclosure, a time configuration device for an audio segment is provided, comprising: The first display module is used to display a first interface, in which a first video clip and at least one first audio clip are displayed. An audio segment selection module is used to select a second audio segment in response to a trigger event, wherein the second audio segment is at least a portion of the first audio segment and is an audio segment to be played in the first video segment; The second display module is used to display a first page in the first interface. The first page includes the time configuration information of the second audio segment. The time configuration information represents the start playback time of the second audio segment during the playback of the first video segment. The time configuration information of the second audio segment is obtained by executing a first script.

[0007] According to another aspect of this disclosure, an electronic device is provided, the electronic device comprising: At least one processor; and A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to perform the audio segment timing configuration method according to any embodiment of this disclosure.

[0008] According to another aspect of this disclosure, a computer-readable storage medium is provided that stores computer instructions for causing a processor to execute and implement the audio segment timing configuration method according to any embodiment of this disclosure.

[0009] According to another aspect of this disclosure, a computer program product is provided, which, when executed by a processor, implements the time configuration method for audio segments as described in any of the embodiments of this disclosure.

[0010] The technical solution provided in this disclosure displays a first video segment and at least one first audio segment in a first interface. By executing a first script, a second audio segment to be played in the first video segment is automatically selected, and the time configuration information of the second audio segment is displayed. This achieves automatic batch setting of time configuration information for at least one second audio segment, replacing the manual setting process for each audio segment individually. This improves the efficiency of time configuration information and reduces human error introduced by the manual setting process.

[0011] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of this disclosure, nor is it intended to limit the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0012] To more clearly illustrate the technical solutions of the embodiments of this disclosure, the accompanying drawings used in the embodiments will be briefly described below. It should be understood that the following drawings only show some embodiments of this disclosure and should not be regarded as a limitation of the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0013] Figure 1 This is a flowchart of an audio segment timing configuration method according to an embodiment of this disclosure; Figure 2 A schematic diagram of a first interface provided for an embodiment of this disclosure; Figure 3 A schematic diagram of a first interface provided for an embodiment of this disclosure; Figure 4 A schematic diagram of a first interface provided for an embodiment of this disclosure; Figure 5 A schematic diagram of a first interface provided for an embodiment of this disclosure; Figure 6 This is a schematic diagram of the structure of an audio segment timing configuration device according to an embodiment of this disclosure; Figure 7 This is a schematic diagram of the structure of an electronic device according to an embodiment of this disclosure. Detailed Implementation

[0014] To enable those skilled in the art to better understand the present disclosure, the technical solutions of the present disclosure will be clearly and completely described below with reference to the accompanying drawings of the embodiments. Obviously, the described embodiments are only some embodiments of the present disclosure, and not all embodiments. Based on the embodiments of the present disclosure, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present disclosure.

[0015] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this disclosure described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0016] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in this disclosure in an appropriate manner in accordance with relevant laws and regulations, and user authorization should be obtained.

[0017] In the audio production process of online games, operators use audio middleware to set precise timing configuration information for audio files. This timing configuration information can be understood as the trigger time point of the audio file. A game project typically includes hundreds or even thousands of audio files, each of which can contain multiple audio segments, and each audio segment requires timing configuration information. The above-mentioned trigger time point configuration operation has extremely high repetition and precision requirements.

[0018] Currently, setting the time configuration information for audio segments involves the following steps: 1. Manually locate the time region corresponding to an audio segment in the editing interface; 2. Manually move the cursor to the beginning position of the audio file; 3. Manually select all audio segments within the speech interval; 4. Manually exclude audio segments that do not need time calculation; 5. Manually read the timeline position of each audio segment; 6. Manually calculate based on the project's starting offset and manually record the calculation results in the configuration document.

[0019] The above process has the following drawbacks: 1. Low efficiency: Manually performing the process involves multiple clicks and selections, resulting in a long processing time per operation; 2. Poor accuracy: Manual selection is prone to errors such as misselection and omission; 3. Manual time calculation is prone to inaccuracies; 4. Inability to perform batch processing, leading to low processing efficiency.

[0020] To address the aforementioned technical problems, this disclosure provides a method for configuring the time of audio segments. Figure 1 This is a flowchart illustrating a method for time configuration of an audio segment according to an embodiment of the present disclosure. This embodiment is applicable to situations where time configuration information for audio segments is automatically generated. The method can be executed by the audio segment time configuration device described in this disclosure. This device can be implemented in software and / or hardware and can be integrated into electronic devices such as terminal devices, computer devices, and servers. Figure 1 As shown, the method specifically includes the following steps: S110, Display a first interface, in which a first video clip and at least one first audio clip are displayed.

[0021] S120, in response to a trigger event, a second audio segment is selected, the second audio segment being at least a portion of the first audio segment, and the second audio segment being an audio segment to be played in the first video segment.

[0022] S130, a first page is displayed in the first interface. The first page includes the time configuration information of the second audio segment. The time configuration information represents the start playback time of the second audio segment during the playback of the first video segment. The time configuration information of the second audio segment is obtained by executing the first script.

[0023] The first interface can be understood as the interactive interface of the audio middleware. The audio middleware can be understood as an audio editor. Here, the audio middleware is not limited, as long as it can perform audio editing.

[0024] The first interface may include a first video clip and at least one first audio clip. The first video clip and the first audio clip may be imported in batches or selected manually.

[0025] Optionally, the first interface may include multiple tracks, with each track used to display a video clip or an audio clip. For example, see [link to example]. Figure 2 , Figure 2 A schematic diagram of a first interface provided for an embodiment of this disclosure. Figure 2 It includes the first video segment 10 and the first audio segment 20. Figure 2 The first interface shown includes a first video segment 10 and three first audio segments 20. Figure 2 The number of the first audio segment 20 is only one example; furthermore, Figure 2 The graphics shown are only schematic representations of the first video and first audio clips.

[0026] In one scenario, the first interface may include a first display area and a second display area. The first display area includes a first video entry for a first video clip and a first audio entry for a first audio clip. The second display area includes multiple tracks. The first video entry corresponds to the first track, which displays a thumbnail preview of the video frame of the first video clip. The first audio entry corresponds to the second track, which displays the audio waveform of the first audio frame. The amplitude of the audio waveform represents the audio loudness. See also Figure 3 , Figure 3 A schematic diagram of a first interface provided for an embodiment of this disclosure.

[0027] The first video segment can be a video clip from an online game or a portion of the original video. Optionally, the original video is divided into multiple first video segments according to a preset time interval, and time configuration information for the second video segment to be played in each audio segment is set in batches. Optionally, the first video segment is extracted from the original video, and the first video segment is an audio segment including sound effects.

[0028] In some embodiments, the association between video clips and audio clips is obtained. This association can be pre-established, stored in a configuration file, or represented by the association between video clip identifiers and audio clip identifiers, where each identifier is unique. When a first video clip is added to the first interface, at least one first video clip is automatically added to the first interface based on the aforementioned association.

[0029] A trigger event can be understood as an event used to set time configuration information for a batch of audio clips. This trigger event is used to trigger the execution of the first script, which includes the execution logic for setting the time configuration information for the batch of audio clips. The first script can manifest in various execution forms under different audio production environments. In one form, the first script is an automated script chain embedded within the audio middleware, triggered by user interaction, sequentially calling various functional modules through internal software interfaces to complete the time configuration. In another form, the first script is a batch processing program that runs independently of the audio middleware, directly generating time configuration information by parsing project files and writing it back to the project configuration, without relying on the middleware's real-time rendering environment. Both forms aim to improve batch processing efficiency by replacing manual settings one by one with automated execution logic.

[0030] Optionally, the triggering event includes a triggering operation on the first video segment. The triggering operation on the first video segment can be understood as a click operation on the first video segment; specifically, it could be a click operation on the first video item of the first video segment, or a click operation on the first track of the first video segment.

[0031] Optionally, the first interface may also include a first control, which is used to trigger the setting of time configuration information for a batch of audio segments. Correspondingly, the triggering event may include a triggering operation on the first control in the first interface. By triggering the execution of the first script through the aforementioned triggering event, the setting of time configuration information for a batch of audio segments can be performed with a single click, simplifying the processing of time configuration information.

[0032] In response to a trigger event, a second audio segment is selected. This second audio segment is used to set time configuration information in batches, and there can be at least one second audio segment. In one scenario, the second audio segment is the same as the first audio segment. In another scenario, the second audio segment is a portion of the first audio segment. Automatically selecting the second audio segment replaces manual selection, eliminating the need for manual operation, improving selection efficiency, and avoiding misselection and omissions caused by manual selection.

[0033] The second audio segment can be determined based on the first video segment. Optionally, selecting the second audio segment includes: obtaining the segment range corresponding to the first video segment; selecting the second audio segment located within the segment range; and setting a mark on the selected second audio segment, the mark indicating that the second audio segment is in a selected state. The second audio segment can be understood as the audio segment to be played in the first video segment. It can be understood that the time configuration information of the second audio segment can be understood as the triggering time point of the second audio segment during the playback of the first video segment. The second audio segment may include the voice of a character in the first video segment, the entrance sound effect of a character, the sound effect of a skill in the first video segment, or the background music of the first video segment, etc.

[0034] The segment range corresponding to the first video clip can be understood as the segment time range corresponding to the first video clip, which can be determined based on the third start time and the first end time of the first video clip. The third start time of the first video clip can be understood as the relative start time of the first video clip on the first interface. Optionally, the first interface includes a time scale, which provides the same time axis for multiple tracks on the first interface. The time scale can be located at the top and / or bottom of the second display area. The third start time and the first end time of the first video clip are determined based on the times corresponding to the start and end positions of the first video clip on the time scale. The time range between the third start time and the first end time is taken as the segment range corresponding to the first video clip.

[0035] Optionally, a range indicator for the aforementioned segment range can be displayed in the first interface. This range indicator can be set on the time scale to provide a basis for selecting the second audio segment. For example, see [link to example]. Figure 4 , Figure 4 This is a schematic diagram of the first interface provided in an embodiment of this disclosure. The first interface includes a time scale 40 and a segment range identifier 30. The segment range 30 can be a linear identifier, a rectangular representation, etc., and the shape of the range identifier is not limited here.

[0036] Selecting a second audio segment within the first interface based on its time range, where the second audio segment's time range falls within the aforementioned segment range. Optionally, identifying the type of all objects in the first interface, identifying the first audio segment within the first interface, and matching the fourth start time and second end time of the first audio segment with the aforementioned segment range, if both the fourth start time and second end time of the first audio segment fall within the aforementioned segment range, then designating the first audio segment as the second audio segment. Setting the second audio segment to the selected state. The fourth start time and second end time of the first audio segment are the relative start and relative end times of the first audio segment within the first interface, based on a time scale, determined by the time corresponding to the start and end positions of the first audio segment on the time scale within the first interface.

[0037] The objects in the first interface include a first video clip and a first audio clip. The naming information for the first video clip and the first audio clip includes a first field, the content of which can include a type label. The type label represents the type of the object; for example, the type label may include an audio label or a video label. Based on the object's naming information, the first audio clip corresponding to the audio label is determined, avoiding interference from the first video clip.

[0038] Optionally, selecting a second audio segment within the segment range includes: selecting an object within the segment range, the object including the first video segment and the third audio segment, the third audio segment being the first audio segment within the segment range; deselecting the first video segment based on the object's type tag; and retaining the selection of the third audio segment as the second audio segment. By introducing type tags to automatically classify and filter objects within the segment range, non-audio objects can be accurately eliminated in a single selection operation, preventing video segments from being mistakenly included in the time calculation process, reducing the steps of manual secondary checks and manual deselection, thereby improving the accuracy of automatic selection and reducing the probability of cross-type miscalculation.

[0039] For an object in the first interface, obtain its start and end times relative to the time scale on the first interface. If both the start and end times of the object are within the segment range, set the object's selection state. Obtain the object's type label and deselect objects with the "video" type label. This means the first video segment has the "video" type label, and the first audio segment has the "audio" type label. Objects with the "audio" type label and are selected are the third audio segment, which is then used as the second audio segment.

[0040] In some embodiments, the third audio segment includes at least one of a fourth audio segment and a fifth audio segment, wherein the fifth audio segment is used to generate the fourth audio segment, and there is a hierarchical relationship between the fourth and fifth audio segments. The fourth audio segment is a combined audio segment generated from at least two fifth audio segments. There is a hierarchical relationship between the fourth and fifth audio segments, wherein the fifth audio segment is the next-level audio segment after the fourth audio segment. It is understood that the fourth audio segment is the audio segment to be played in the first video segment, and the fifth audio segment is only used to generate the fourth audio segment; it is not the audio segment to be played in the first video segment, and there is no need to set the time configuration information for the fifth audio segment.

[0041] Specifically, the hierarchical relationship between the fourth and fifth audio segments can be represented by a parent-child relationship. For example, the fourth audio segment is the parent audio segment, and the fifth audio segment is the child audio segment of the fourth audio segment.

[0042] Optionally, based on the hierarchical relationship between the fourth and fifth audio segments, the selection of the fifth audio segment is deselected; the selection of the fourth audio segment is retained as the second audio segment.

[0043] For the selected third audio segment, determine whether there is a parent audio segment. If there is, it indicates that the third audio segment is a child audio segment, and the selection of the third audio segment is deselected. If there is no parent audio segment, the selection of the third audio segment is retained.

[0044] For example, if the fifth audio segment has a parent audio segment, namely the fourth audio segment, the selection status of the fifth audio segment is invalidated. Conversely, if the fourth audio segment does not have a parent audio segment, the selection status of the fourth audio segment is retained.

[0045] Optionally, the selected state can be indicated by adjusting display attributes. For example, a first color can indicate selection, and a second color can indicate deselection; for instance, the first color could be red, and the second color could be gray. Accordingly, the fifth audio clip and the first video clip would be displayed in gray, and the fourth audio clip in red.

[0046] Optionally, the selection status can be indicated by setting a marker, such as an asterisk or a checkbox. For example, a checkbox can be set for the fourth audio clip, placing the fourth audio clip within the checkbox, while the fifth audio clip and the first video clip do not have checkboxes set. Audio clips with checkboxes are selected. See also Figure 5 , Figure 5 This is a schematic diagram of the first interface provided in an embodiment of this disclosure.Figure 5 It includes a second audio segment 60 and a selection box 50. The second audio segment 60 is located within the selection box 50.

[0047] The selected third audio segment is used as the second audio segment, and the timing configuration information of the second audio segment is determined.

[0048] Optionally, obtaining the time configuration information of the second audio segment includes: obtaining the first start time of the first video segment; obtaining the first start offset of the second audio segment relative to the first video segment; and obtaining the time configuration information of the second audio segment based on the first start time and the first start offset.

[0049] The first start time of the first video segment can be understood as the absolute start time of the first video segment. Optionally, obtaining the first start time of the first video segment includes: obtaining the second start time of the original video to which the first video segment belongs; obtaining the second start offset of the first video segment relative to the original video; obtaining the third start time of the first video segment relative to the time scale in the first interface; and obtaining the first start time based on the second start time, the second start offset, and the third start time.

[0050] The first video segment is a part of the original video. Based on the name / video representation of the first video segment, the original video to which the first video segment belongs is determined, and the second start time of the original video is read.

[0051] The first video segment includes multiple markers. Different markers can be used to mark key positions in the first video segment. The first marker of the first video segment is obtained, which is used to mark the starting position of the previous video segment. Based on the time interval between the position of the first marker in the original video and the starting position of the original video, a second starting offset is obtained.

[0052] The first interface includes a cursor, which is used to mark the same position on the time scale and multiple tracks. Moving the cursor position in the first interface to the position of the first mark, the time corresponding to the cursor on the time scale is the third start time of the first video segment relative to the time scale in the first interface.

[0053] The first start time of the first video segment is obtained based on the sum of the second start time, the second start offset, and the third start time.

[0054] The first starting offset of the second audio segment relative to the first video segment can be understood as the time interval between the starting position of the second audio segment and the starting position of the first video segment. The fifth starting time corresponding to the starting position of the second audio segment on the time scale is obtained, and the first starting offset is obtained based on the difference between the third and fifth starting times.

[0055] Optionally, the time configuration information of the second audio segment can be obtained based on the sum of the first start time and the first start offset.

[0056] Optionally, obtaining the time configuration information of the second audio segment based on the first start time and the first start offset includes: generating a theoretical start time based on the first start time and the first start offset; updating the theoretical start time based on a preset safety duration to obtain the time configuration information of the second audio segment. The sum of the first start time and the first start offset is used as the theoretical start time, and the time configuration information of the second audio segment is obtained based on the sum of the theoretical start time and the preset safety duration. Specifically, the time configuration information of the second audio segment is obtained based on the sum of the first start time, the first start offset, and the preset safety duration.

[0057] The preset safety duration can be pre-set, such as 10ms or 20ms, to avoid confusion between the second audio segment and the preceding audio segment and to ensure the smooth playback of the second audio segment.

[0058] The technical solution of this embodiment displays a first video segment and at least one first audio segment on a first interface. By executing a first script, a second audio segment to be played in the first video segment is automatically selected, and the time configuration information of the second audio segment is displayed. This achieves automatic batch setting of time configuration information for at least one second audio segment, replacing the manual setting process for each audio segment individually. This improves the efficiency of time configuration information and reduces human error introduced by the manual setting process.

[0059] In some embodiments of this disclosure, a first interface is shown, displaying a first video segment and at least one first audio segment. In response to a trigger operation on the first video segment, or a trigger operation on a first control, a first script is executed. Specifically, a first marker in the first video segment is obtained; a second start time of the original video where the first marker is located is read; a second start offset of the first marker in the original video is obtained; a third start time of the first marker on the time scale of the first interface is obtained; and a first start time of the first video segment is obtained based on the sum of the second start time, the second start offset, and the third start time. A cursor setting method is invoked to set the cursor at the position of the first marker. Based on a zero-point setting method, the first start time is set to the zero point of the time scale.

[0060] Based on the segment region acquisition method, the segment range corresponding to the first video segment is obtained. Based on the start information acquisition method, the start time corresponding to the segment range is obtained. Based on the end time acquisition method, the reception time corresponding to the segment range is obtained. A selection command is executed to select objects within the aforementioned segment range, whose start and end times are within the specified segment range. For the selected object, the parent track query method is called to obtain the top-level parent track of the selected object. If the selected object is the top-level parent track, its selection remains; otherwise, it is deselected. If the top-level parent track of the selected object is not currently selected, its selection is set.

[0061] Iterate through the selected objects, identify the type label of the selected objects, and if the type label of the selected object is video, it indicates that the selected object is the first video object, and deselect the first video object.

[0062] For the selected second audio object, the first offset of the second audio object is obtained based on the offset acquisition method. The time configuration information of the second audio segment is obtained based on the sum of the first time information, the first offset, and the preset safe duration. There can be at least one second audio segment, and the time configuration information of multiple second audio segments can be set in parallel.

[0063] The timing configuration information for the second video segment is output based on the track name-timing configuration information format. The track name can be the naming information for the second audio segment. The first page is displayed on the first interface, showing the timing configuration information for the second audio segment.

[0064] Figure 6 This is a schematic diagram of an audio segment timing configuration device provided in an embodiment of the present disclosure. The device specifically includes: a first display module 210, an audio segment selection module 220, and a second display module 230.

[0065] The first display module 210 is used to display a first interface, in which a first video clip and at least one first audio clip are displayed. The audio segment selection module 220 is used to select a second audio segment in response to a trigger event, wherein the second audio segment is at least a portion of the first audio segment and the second audio segment is an audio segment to be played in the first video segment; The second display module 230 is used to display a first page in the first interface. The first page includes time configuration information of the second audio segment. The time configuration information represents the start playback time of the second audio segment during the playback of the first video segment. The time configuration information of the second audio segment is obtained by executing a first script.

[0066] The technical solution of this embodiment displays a first video segment and at least one first audio segment on a first interface. By executing a first script, a second audio segment to be played in the first video segment is automatically selected, and the time configuration information of the second audio segment is displayed. This achieves automatic batch setting of time configuration information for at least one second audio segment, replacing the manual setting process for each audio segment individually. This improves the efficiency of time configuration information and reduces human error introduced by the manual setting process.

[0067] Based on the above embodiments, optionally, the audio segment selection module 220 is used to obtain the segment range corresponding to the first video segment; select the second audio segment located within the segment range, and set a mark on the selected second audio segment, the mark indicating that the second audio segment is in a selected state.

[0068] Optionally, the audio segment selection module 220 is further configured to: select an object within the segment range, the object including the first video segment and the third audio segment, the third audio segment being the first audio segment located within the segment range; deselect the first video segment according to the type label of the object; and retain the selection of the third audio segment as the second audio segment.

[0069] The third audio segment includes at least one of a fourth audio segment and a fifth audio segment, the fifth audio segment is used to generate the fourth audio segment, and there is a hierarchical relationship between the fourth audio segment and the fifth audio segment; Optionally, the audio segment selection module 220 is further configured to: deselect the fifth audio segment according to the hierarchical relationship between the fourth audio segment and the fifth audio segment; and retain the selection of the fourth audio segment as the second audio segment.

[0070] Based on the above embodiments, the device further includes a time configuration information acquisition module, configured to: acquire a first start time of the first video segment; acquire a first start offset of the second audio segment relative to the first video segment; and obtain time configuration information of the second audio segment based on the first start time and the first start offset.

[0071] Optionally, the time configuration information acquisition module is further configured to acquire a second start time of the original video to which the first video segment belongs; acquire a second start offset of the first video segment relative to the original video; acquire a third start time of the first video segment relative to the time scale in the first interface; and obtain the first start time based on the second start time, the second start offset, and the third start time.

[0072] Optionally, the time configuration information acquisition module is further configured to generate a theoretical start time based on the first start time and the first start offset; update the theoretical start time based on a preset safety duration to obtain the time configuration information of the second audio segment.

[0073] Based on the above embodiments, the triggering event includes at least one of the following: a triggering operation on the first video segment; a triggering operation on the first control in the first interface.

[0074] The above-described products can perform the methods provided in any embodiment of this disclosure, and have the corresponding functional modules and beneficial effects for performing the methods.

[0075] Figure 7 A schematic diagram of an electronic device 10 that can be used to implement embodiments of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices (such as helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0076] like Figure 7As shown, the electronic device 10 includes at least one processor 11 and a memory, such as a read-only memory (ROM) 12 or a random access memory (RAM) 13, communicatively connected to the at least one processor 11. The memory stores computer programs executable by the at least one processor. The processor 11 can perform various appropriate actions and processes based on the computer program stored in the ROM 12 or loaded from storage unit 18 into the RAM 13. The RAM 13 can also store various programs and data required for the operation of the electronic device 10. The processor 11, ROM 12, and RAM 13 are interconnected via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0077] Multiple components in electronic device 10 are connected to I / O interface 15, including: input unit 16, such as keyboard, mouse, etc.; output unit 17, such as various types of displays, speakers, etc.; storage unit 18, such as disk, optical disk, etc.; and communication unit 19, such as network card, modem, wireless transceiver, etc. Communication unit 19 allows electronic device 10 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0078] Processor 11 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Processor 11 performs the various methods and processes described above, such as the time configuration method for audio segments.

[0079] In some embodiments, the audio segment timing configuration method may be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or mounted on electronic device 10 via ROM 12 and / or communication unit 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the audio segment timing configuration method described above may be performed. Alternatively, in other embodiments, processor 11 may be configured to execute the audio segment timing configuration method by any other suitable means (e.g., by means of firmware).

[0080] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0081] Computer programs used to implement the methods of this disclosure may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be performed. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0082] In the context of this disclosure, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium can be a machine-readable signal medium. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0083] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0084] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or middleware components (e.g., application servers), or frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.

[0085] A computing system can include clients and servers. Clients and servers are generally located far apart and typically interact through communication networks. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a hosting product within the cloud computing service system to address the shortcomings of traditional physical hosts and VPS services, such as high management difficulty and weak business scalability.

[0086] It should be understood that the various forms of processes shown above can be used to rearrange, add, or delete steps. For example, the steps described in this disclosure can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this disclosure can be achieved, and this is not limited herein.

[0087] This disclosure also provides a computer program product, including a computer program that, when executed by a processor, implements the audio segment timing configuration method according to any embodiment of this disclosure.

[0088] In implementing a computer program product, computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof. Programming languages ​​include object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as C or similar languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0089] The specific embodiments described above do not constitute a limitation on the scope of protection of this disclosure. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this disclosure should be included within the scope of protection of this disclosure.

Claims

1. A method for time configuration of an audio segment, characterized in that, include: A first interface is displayed, which displays a first video clip and at least one first audio clip; In response to a trigger event, a second audio segment is selected, the second audio segment being at least a portion of the first audio segment, and the second audio segment being an audio segment to be played in the first video segment; The first page is displayed in the first interface. The first page includes the time configuration information of the second audio segment. The time configuration information represents the start playback time of the second audio segment during the playback of the first video segment. The time configuration information of the second audio segment is obtained by executing the first script.

2. The method according to claim 1, characterized in that, Select the second audio segment, including: Obtain the segment range corresponding to the first video segment; Select the second audio segment within the segment range, and set a mark on the selected second audio segment, the mark indicating that the second audio segment is in a selected state.

3. The method according to claim 2, characterized in that, Select the second audio segment located within the specified segment range, including: Select the objects within the segment range, the objects including the first video segment and the third audio segment, the third audio segment being the first audio segment located within the segment range; Based on the type label of the object, deselect the first video segment; The selected state of the third audio segment is retained and used as the second audio segment.

4. The method according to claim 3, characterized in that, The third audio segment includes at least one of a fourth audio segment and a fifth audio segment, the fifth audio segment is used to generate the fourth audio segment, and there is a hierarchical relationship between the fourth audio segment and the fifth audio segment; The method further includes: Based on the hierarchical relationship between the fourth and fifth audio segments, the selection status of the fifth audio segment is deselected; The selected state of the fourth audio segment is retained and used as the second audio segment.

5. The method according to claim 1, characterized in that, Obtain the timing configuration information for the second audio segment, including: Obtain the first start time of the first video segment; Obtain the first starting offset of the second audio segment relative to the first video segment; Based on the first start time and the first start offset, the time configuration information of the second audio segment is obtained.

6. The method according to claim 5, characterized in that, The step of obtaining the first start time of the first video segment includes: Obtain the second start time of the original video to which the first video segment belongs; Obtain the second starting offset of the first video segment relative to the original video; Obtain the third start time of the first video segment relative to the time scale in the first interface; The first start time is obtained based on the second start time, the second start offset, and the third start time.

7. The method according to claim 5, characterized in that, Based on the first start time and the first start offset, the time configuration information of the second audio segment is obtained, including: A theoretical start time is generated based on the first start time and the first start offset; The theoretical start time is updated based on a preset safety duration to obtain the time configuration information of the second audio segment.

8. The method according to claim 1, characterized in that, The triggering event includes at least one of the following: Triggering operation on the first video segment; Triggering operation on the first control in the first interface.

9. A time configuration device for an audio segment, characterized in that, include: The first display module is used to display a first interface, in which a first video clip and at least one first audio clip are displayed. An audio segment selection module is used to select a second audio segment in response to a trigger event, wherein the second audio segment is at least a portion of the first audio segment and is an audio segment to be played in the first video segment; The second display module is used to display a first page in the first interface. The first page includes the time configuration information of the second audio segment. The time configuration information represents the start playback time of the second audio segment during the playback of the first video segment. The time configuration information of the second audio segment is obtained by executing a first script.

10. An electronic device, characterized in that, The electronic device includes: At least one processor; and A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor to enable the at least one processor to perform the time configuration method for audio segments according to any one of claims 1-9.

11. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, implements the time configuration method for audio segments according to any one of claims 1-9.

Images