Methods, electronic devices, storage media, and software products for audio file processing

Abstract

This application discloses a method, electronic device, storage medium, and program product for audio file processing. The method includes: displaying a first interface including at least one note topic; responding to a first operation, displaying recommended content associated with the note corresponding to the first note topic; and responding to a second operation on target content in at least one of the recommended contents, adding a second note topic corresponding to the target content. This application, by displaying a first interface containing note topics of a specific category and showing associated recommended content when a user operates on a note topic, allows users to instantly obtain supplementary information while browsing notes, thereby improving the practicality and richness of the notes. When the user performs a second operation on the recommended content, the system can add a new note topic to the note category view, optimizing the user's note organization process and improving the overall functionality and user satisfaction of the note application.

Description

Technical Field

[0001] This application relates to the field of audio file processing, and in particular to a method, electronic device, storage medium, and program product for audio file processing. Background Technology

[0002] With the rapid development of digital technology, audio files are increasingly used in daily life and work. Whether for meeting minutes, interviews, lectures, or personal creations, audio files play a vital role. However, in the processing of audio files, especially when editing and trimming audio files that have already been converted to text, existing technologies typically only allow for simple waveform editing, failing to provide real-time comparison between audio and text. This makes it impossible for users to visually see the correspondence between audio segments and text content when editing and trimming audio converted to text, leading to inaccurate trimming operations and a tendency for incorrect trimming. This separate editing method not only increases the difficulty for users but may also result in trimming results that do not meet expectations, requiring repeated adjustments and wasting a significant amount of time and effort. Summary of the Invention

[0003] The purpose of this application is to provide a method, electronic device, storage medium, and program product for audio file processing, in order to solve the problem that existing audio processing applications cannot intuitively see the correspondence between audio segments and text content when editing and trimming audio that has been converted to text, which easily leads to erroneous trimming.

[0004] Firstly, this application provides a method for processing audio files, including:

[0005] Display a first interface; the first interface includes a first region and a second region, the first region includes the audio waveform of the audio file, and the second region includes the transcribed text of the audio file;

[0006] In response to a selection operation on the audio waveform, the audio selection range of the audio waveform and the text selection range of the transcribed text are highlighted; the content of the corresponding text selection range in the transcribed text corresponds to the content of the corresponding audio selection range in the audio waveform.

[0007] This application embodiment simultaneously displays audio waveforms and transcribed text on the same interface, and highlights the corresponding audio selection range and transcribed text selection range in real time when the user selects an audio waveform, achieving precise synchronization and intuitive comparison between audio and text. This not only improves the convenience and accuracy of user operation during audio editing, effectively avoiding problems such as incorrect trimming caused by the inability to compare audio and text in real time, but also enhances the efficiency of audio file processing and user experience, enabling users to complete audio file editing and processing tasks more efficiently and accurately.

[0008] In some possible implementations, there is a timestamp correspondence between the audio file, the audio waveform, and the transcribed text;

[0009] In response to a selection operation on the audio waveform, the selected audio region of the audio waveform and the selected text region of the transcribed text are highlighted, including:

[0010] Identify the start and end time points corresponding to the selected audio interval;

[0011] Based on the timestamp correspondence, query the text information in the transcribed text that falls between the start and end times, and determine the text information as the text selection interval.

[0012] In this embodiment, precise synchronization between audio and text is achieved by establishing a timestamp correspondence between the audio file, audio waveform, and transcribed text. When a user selects an audio waveform, the system accurately identifies the start and end times of the selected audio interval and quickly queries the transcribed text for text information within that time interval based on the timestamp correspondence. This text information is then identified as the selected text interval and highlighted. This process improves the efficiency and accuracy of audio and text editing. Users no longer need to manually perform tedious comparisons and positioning between audio and text; the system automatically completes the matching and display, making editing operations more intuitive and convenient, and enhancing the user experience.

[0013] Among the possible implementations are:

[0014] In response to the first cropping operation, the content of the audio selection region in the audio waveform diagram and the content of the text selection region in the transcribed text are deleted.

[0015] This application implements simultaneous cropping of audio waveforms and transcribed text. When the user performs the first cropping operation, the system automatically deletes the content of the selected audio region in the audio waveform and simultaneously deletes the content of the corresponding text region in the transcribed text. This simultaneous deletion mechanism ensures the consistency between the audio file and the transcribed text, avoiding confusion and errors caused by mismatches between audio and text content. Users do not need to manually delete content separately in the audio waveform and transcribed text, greatly improving editing efficiency and accuracy, and making the audio file processing process smoother and more convenient.

[0016] Among the possible implementations are:

[0017] When the content of the audio selection interval in the audio waveform diagram and the content of the text selection interval in the transcribed text are deleted, in response to the first save operation, the audio file after deleting the content between the start time point and the end time point is saved as a new audio file.

[0018] In this embodiment, when a user deletes the selected audio range and corresponding transcribed text in the audio waveform graph, in response to the first save operation, the system automatically saves the audio file after deleting the content between the start and end time points as a new audio file. This process not only ensures the integrity of the original audio file and avoids irreversible damage to the original data due to accidental operations, but also provides users with a flexible file management method. Users can retain the original file as needed and generate a new, edited file, facilitating subsequent sharing, storage, or further processing, thus improving the efficiency of audio file processing and the user experience.

[0019] Among the possible implementations are:

[0020] When the content of the audio selection interval in the audio waveform diagram and the content of the text selection interval in the transcribed text are deleted, in response to the first retraction operation, the content of the deleted audio selection interval in the audio waveform diagram and the content of the text selection interval in the transcribed text are restored to be displayed.

[0021] This application provides a convenient undo mechanism. When a user accidentally deletes the audio selection area in the audio waveform diagram and the corresponding text selection area in the transcribed text, in response to the first undo operation, the system can quickly restore the display of the deleted audio waveform diagram and transcribed text content. This mechanism effectively avoids data loss due to accidental operation, improves the user's operational error tolerance, and eliminates concerns about irreversible losses caused by accidental deletion during audio editing, thereby improving the efficiency of audio editing and the user experience.

[0022] Among the possible implementations are:

[0023] In response to the second cropping operation, the contents of the audio waveform graph other than the audio selection interval and the contents of the transcribed text other than the text selection interval are deleted.

[0024] This application's embodiments achieve precise content retention based on user-specified intervals. When performing the second trimming operation, the system automatically deletes all content in the audio waveform and transcribed text except for the selected intervals, ensuring that only the core parts of interest to the user are retained. This function improves the accuracy and efficiency of audio editing. Users do not need to manually delete redundant parts; the system automatically completes the trimming, simplifying the operation process and making audio editing more convenient and efficient, while ensuring the accuracy and completeness of key information.

[0025] Among the possible implementations are:

[0026] When the content of other intervals in the audio waveform graph besides the audio selection interval and the content of other intervals in the transcribed text besides the text selection interval are deleted, in response to the second save operation, the content between the start time point and the end time point in the audio file is saved as a new audio file.

[0027] This application's embodiments achieve precise content extraction and preservation. When the user performs the second trimming operation, deleting all content in the audio waveform and transcribed text except for the selected interval, in response to the second save operation, the system automatically saves the content between the start and end times in the audio file as a new audio file. This mechanism not only ensures the accurate extraction and preservation of key audio content but also provides users with a convenient file management method. Users do not need to manually segment and save audio segments; the system completes the operation automatically, simplifying the workflow and improving the efficiency and convenience of audio file processing.

[0028] Among the possible implementations are:

[0029] The second interface is displayed; the second interface includes a third area, a fourth area, and audio playback control buttons for audio files. The third area includes an audio waveform diagram, and the fourth area includes transcribed text.

[0030] In response to the minutes generation operation, a pop-up window is displayed on the second interface; the pop-up window includes AI minutes text, which is obtained by recognizing the transcribed text through a preset AI recognition model.

[0031] This embodiment of the application integrates audio waveforms, transcribed text, and audio playback control buttons on a second interface, providing users with comprehensive audio editing and viewing functions. When the user clicks the minutes generation operation, the system displays a pop-up window on the second interface, containing AI minutes text generated by a preset AI recognition model. This function enhances the intelligence level of audio processing; users no longer need to manually organize the transcribed text, as the system automatically generates minutes using AI technology, saving significant time and effort. Simultaneously, the generation of AI minutes text provides users with more accurate and professional text content, helping to improve the application value and usage efficiency of audio files.

[0032] In some possible implementations, after displaying a pop-up window on the second interface in response to the minutes generation operation, the following is also included:

[0033] In response to the insertion of a note, the note application interface is displayed; the note application interface includes a fifth area and a sixth area. The fifth area includes a note audio card, which includes audio playback control buttons for the audio file, an audio waveform graph of the audio file, and transcribed text. The sixth area includes AI summary text.

[0034] This application further enhances the integration of audio processing and note-taking applications. After the user clicks the minutes generation operation and a pop-up window appears, if the user clicks the insert note operation, the system will display the note-taking application interface. This interface not only includes AI minutes text but also integrates audio playback control buttons, audio waveforms, and transcribed text. This design allows users to directly access and process audio files and their related text within the note-taking application without switching between different applications, improving work efficiency and user experience. Users can conveniently play audio, view waveforms, and transcribe text within the notes, while simultaneously using AI minutes text for quick recording and organization, making the use of audio content more convenient and efficient.

[0035] Among the possible implementations are:

[0036] In response to a playback action, play the audio file in the audio card.

[0037] In this embodiment, when a user clicks the play button, the system immediately plays the audio file in the audio card, eliminating the need for the user to perform any additional file search or opening operations. This design improves user efficiency and convenience, enabling users to quickly and intuitively access and play the audio content they need. Simultaneously, the integrated design of the audio cards provides a more unified and seamless user experience, allowing users to perform playback, pause, and stop operations on audio within the same interface, without switching between different interfaces or applications, further enhancing audio processing efficiency and user experience.

[0038] Among the possible implementations are:

[0039] Responding to editing operations, the AI ​​minutes text can be edited.

[0040] This application embodiment allows users to directly edit AI-generated minutes text, improving content personalization and accuracy. Users can modify, supplement, or delete AI-generated minutes text according to their needs and understanding, making it more suitable for actual scenarios and uses. Furthermore, this editing operation can help users better organize and summarize information, creating more valuable documents. Based on the AI ​​minutes, users can further optimize and adjust the content to meet application needs in different scenarios, such as meeting minutes, interview records, and study notes, thereby improving the utilization value of information and work efficiency.

[0041] Secondly, this application also provides an electronic device, comprising:

[0042] processor;

[0043] Memory;

[0044] The memory stores a computer program that, when executed, causes the electronic device to perform any of the methods described in the first aspect.

[0045] Thirdly, this application also provides a computer-readable storage medium including a stored program, wherein, when the program is running, it controls the device on which the computer-readable storage medium is located to execute the method of any one of the first aspects.

[0046] Fourthly, this application also provides a program product storing a program that, when run by an information processing device, causes the information processing device to execute the method described in any of the first aspects.

[0047] This application embodiment simultaneously displays audio waveforms and transcribed text on the same interface, and highlights the corresponding audio selection range and transcribed text selection range in real time when the user selects an audio waveform, achieving precise synchronization and intuitive comparison between audio and text. This not only improves the convenience and accuracy of user operation during audio editing, effectively avoiding problems such as incorrect trimming caused by the inability to compare audio and text in real time, but also enhances the efficiency of audio file processing and user experience, enabling users to complete audio file editing and processing tasks more efficiently and accurately. Attached Figure Description

[0048] Figure 1 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;

[0049] Figure 2 A software structure block diagram of an electronic device provided in an embodiment of this application;

[0050] Figure 3 A flowchart illustrating an audio file processing method provided in an embodiment of this application;

[0051] Figure 4 A flowchart illustrating the display of a first interface provided in an embodiment of this application;

[0052] Figure 5 This is a schematic diagram illustrating the highlighting of an audio selection area and a text selection area, provided as an embodiment of this application.

[0053] Figure 6 for Figure 3A flowchart illustrating an actual manifestation of S02 in a provided audio file processing method;

[0054] Figure 7 This is a schematic diagram illustrating the cropping of audio selection ranges and text selection ranges as provided in an embodiment of this application.

[0055] Figure 8 A schematic diagram of interface changes for a first withdrawal operation provided in an embodiment of this application;

[0056] Figure 9 This is a schematic diagram illustrating another method for cropping audio selection ranges and text selection ranges, provided in an embodiment of this application.

[0057] Figure 10 A flowchart illustrating another audio file processing method provided in this application embodiment;

[0058] Figure 11 This is a schematic diagram illustrating a second interface provided in an embodiment of this application;

[0059] Figure 12 This is a schematic diagram of a note-taking application interface provided in an embodiment of this application. Detailed Implementation

[0060] To better understand the technical solution of this application, the embodiments of this application will be described in detail below with reference to the accompanying drawings.

[0061] It should be understood that the described embodiments are merely some, not all, of the embodiments in this application. All other embodiments obtained by those skilled in the art based on the embodiments in this application without inventive effort are within the scope of protection of this application.

[0062] The terminology used in the embodiments of this application is for the purpose of describing particular embodiments only and is not intended to be limiting of this application. The singular forms “a,” “the,” and “the” used in the embodiments of this application and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise.

[0063] It should be understood that the term "and / or" used in this article is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. Additionally, the character " / " in this article generally indicates that the preceding and following related objects have an "or" relationship.

[0064] The method for processing audio files provided in the embodiments of this application will be described below.

[0065] With the rapid development of digital technology, audio files are increasingly used in daily life and work. Whether for meeting minutes, interviews, lectures, or personal creations, audio files play a vital role. However, in the processing of audio files, especially when editing and trimming audio files that have already been converted to text, existing technologies typically only allow for simple waveform editing, failing to provide real-time comparison between audio and text. This makes it impossible for users to visually see the correspondence between audio segments and text content when editing and trimming audio converted to text, leading to inaccurate trimming operations and a tendency for incorrect trimming. This separate editing method not only increases the difficulty for users but may also result in trimming results that do not meet expectations, requiring repeated adjustments and wasting a significant amount of time and effort.

[0066] In view of this, embodiments of this application provide a method for processing audio files, which can solve the problem of low efficiency in searching and integrating relevant knowledge in notes.

[0067] The following describes the electronic device to which the audio file processing method provided in this application is applicable and the specific process of the method, in conjunction with the embodiments.

[0068] The audio file processing method provided in this application can be applied to devices capable of screen touch control, such as mobile phones, tablets, personal computers (PCs), personal digital assistants (PDAs), smartwatches, netbooks, wearable electronic devices, augmented reality (AR) devices, virtual reality (VR) devices, in-vehicle devices, smart cars, smart speakers, robots, smart glasses, and smart TVs.

[0069] For example, Figure 1 A schematic diagram of the structure of an electronic device is shown. Figure 1 As shown, the electronic device 100 may include a display screen 194, a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, a motor 191, an indicator 192, a camera 193, and a subscriber identification module (SIM) card interface 195, etc.

[0070] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0071] Display screen 194, also known as a display screen or screen, is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel may be an OLED display panel. In some embodiments, electronic device 100 may include one or N displays screens 194, where N is a positive integer greater than 1.

[0072] Processor 110 may include one or more processing units, such as application processor (AP), modem processor, controller, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU). These different processing units may be independent devices or integrated into one or more processors.

[0073] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of fetching and executing instructions.

[0074] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0075] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0076] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0077] Internal memory 121 can be used to store executable program code, including instructions. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as network connection control functions), etc. The data storage area may store data created during the use of electronic device 100. In addition, internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc. Processor 110 executes various functional applications and data processing of electronic device 100 by running instructions stored in internal memory 121 and / or instructions stored in memory located in the processor.

[0078] Touch sensor 180F, also known as a "touch panel," can be located on display screen 194. The touch sensor 180F and display screen 194 together form a touchscreen, also known as a "touch screen." Touch sensor 180F detects touch operations applied to or near it. Touch sensor 180F can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180F may also be located on the surface of electronic device 100, in a different position than display screen 194.

[0079] Camera 193 is used to capture still images or videos.

[0080] See Figure 2 This is a software structure block diagram of an electronic device provided in an embodiment of this application. The software system of the electronic device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This embodiment of the application uses the layered architecture Android system as an example to illustrate the software structure of the electronic device 100. The layered architecture divides the software into several layers, each with a clear role and division of labor. Layers communicate with each other through software interfaces. Figure 2 As shown in the embodiments of this application, the Android system includes, from top to bottom, an application layer, a framework layer, a hardware abstraction layer, and a hardware layer.

[0081] The application layer (App) may include a series of application packages. For example, this application package may include applications such as gallery, file manager, charts, calendar, map, favorites, messaging, shopping, notes, phone, contacts, and browser. In this embodiment, the application also includes a voice recorder application. The voice recorder application is used to record, transcribe, edit, and play audio in response to user operations. Optionally, the voice recorder application can generate audio in response to the user directly clicking the record button on the voice recorder application interface, or it can generate audio in response to the user long-pressing selected audio content and selecting to generate an audio file on another application interface.

[0082] The Framework (FWK) layer provides the application programming interface (API) and programming framework for applications in the application layer, including some predefined functions. Figure 2In this application framework layer, a window manager, content provider, view system, phone manager, and resource manager can be included. The window manager manages window programs. It can obtain the screen size, determine the presence of a status bar, lock the screen, and capture the screen. The content provider stores and retrieves data, making this data accessible to the application. This data can include video, images, audio, made and received calls, browsing history and bookmarks, phone books, etc. The view system includes visual controls, such as controls for displaying text and controls for displaying images. The view system can be used to build the application. The display interface can consist of one or more views. For example, the display interface of an audio file processing application (such as a recorder, audio editor, etc.) can include a view displaying audio waveforms and a view displaying transcribed text. The phone manager provides communication functions for the electronic device 100, such as managing call status (including connection, hang-up, etc.). The resource manager provides various resources for the application, such as localized strings, icons, images, layout files, audio files, etc.

[0083] The Hardware Abstraction Layer (HAL) is an interface layer located between the operating system kernel and the hardware circuitry, designed to abstract the hardware. It hides the hardware interface details of a specific platform, providing the operating system with a virtual hardware platform that is hardware-independent and portable across multiple platforms. For example, the HAL may include a display engine and an audio processing module. The display engine further processes the received content to be displayed, and the audio processing module processes the received audio signals. In this embodiment, the HAL primarily utilizes the display engine to process the notes sent from the display chip and the audio processing module to process the audio data acquired from the hardware.

[0084] The hardware layer (HW) is the lowest level of hardware within the operating system. For example, HW includes microphones, audio processors, displays, and sensors. Microphones can capture audio from different environments, audio processors process the captured audio signals and send the processed audio data to the operating system so that the operating system can determine the audio content recorded by the user through a recording application. The display can show images at different refresh rates, and sensors can detect user actions on the screen and send these actions to the display chip so that the display chip can determine the notes entered by the user in the designated area.

[0085] For ease of understanding, the following embodiments of this application will be described using the following methods: Figure 1 and Figure 2 Taking the electronic device with the structure shown as an example, and in conjunction with the accompanying drawings and application scenarios, the method for audio file processing provided in this application embodiment will be specifically described.

[0086] See Figure 3 This is a flowchart illustrating an audio file processing method provided in an embodiment of this application. It can be understood that... Figure 3 The timing of each step in the audio file processing method described herein is merely an example and does not impose any limitations on the order of action execution. For example... Figure 3 As shown, the main steps of the audio file processing method provided in this application embodiment, applied to electronic devices, include:

[0087] S01: Display the first interface.

[0088] The first interface includes a first region and a second region. The first region includes the audio waveform of the audio file, and the second region includes the transcribed text of the audio file.

[0089] For example, please refer to Figure 4 This is a flowchart illustrating a display of a first interface provided in an embodiment of this application. When the first interface is the interface of a recorder application, Figure 4 Interface ③ is the first interface in this application embodiment. The upper half of the first interface is the first area in this application embodiment, and the lower half of the first interface is the second area in this application embodiment.

[0090] In some embodiments, the process of displaying the first interface mentioned in step S01 can be as follows: Figure 4 As shown:

[0091] When a user clicks on the recorder application, they enter the recorder application interface, which displays multiple recordings. The recorder application interface can display the recordings in the order they were recorded. The name of a recording can be determined based on the start time of the recording; for example, it could be 20240821_172109, which means the recording time was 17:21:09 on August 21, 2024.

[0092] After the user selects an audio file named "Recording 1", the system will display the audio waveform of "Recording 1" in the first area of ​​the recorder application interface and the transcribed text of "Recording 1" in the second area of ​​the recorder application interface.

[0093] In this embodiment, a first interface is displayed, showing the audio waveform and transcribed text of the audio file in a first area and a second area, respectively. This layout allows users to intuitively view the waveform and corresponding transcribed text of the audio file on the same interface, facilitating audio editing and text proofreading. Users can easily compare the audio waveform and transcribed text to quickly locate key parts of the audio and their corresponding text content, thereby improving the efficiency and accuracy of audio processing.

[0094] Meanwhile, this interface design also provides users with a more convenient operating experience. Users can intuitively understand the overall structure and rhythm of the audio through the audio waveform diagram in the first area, while viewing detailed transcribed text in the second area, facilitating text editing and content organization. This integrated display method reduces the frequency of users switching between different interfaces or tools, making the audio processing process smoother and more efficient.

[0095] In some embodiments, audio data can be acquired by an audio processing module and converted into a visualized waveform, and the audio waveform of the audio file can be displayed in a first area so that users can intuitively view the structure and characteristics of the audio; the content of the audio file can be converted into text format by speech recognition technology, and the transcribed text of the audio file can be displayed in a clear and readable manner in a second area.

[0096] For example, a graphical user interface (GUI) framework can be used to construct the first interface. An audio processing library (such as the WebAudio API or other audio processing tools) is used to generate an audio waveform, which is then rendered in the first area. Simultaneously, a speech recognition engine is used to convert the audio file into text, and the generated text is displayed in the second area. In this way, users can intuitively view the audio waveform and corresponding text content in the first interface, thereby improving the efficiency of audio processing and the user experience.

[0097] S02: In response to a selection operation on the audio waveform, highlight the audio selection range of the audio waveform and the text selection range of the transcribed text.

[0098] In this context, the content of the corresponding text selection interval in the transcribed text corresponds to the content of the corresponding audio selection interval in the audio waveform diagram.

[0099] For example, please refer to Figure 5 This is a schematic diagram illustrating a method for highlighting audio and text selection areas, provided in an embodiment of this application. Figure 5 As shown, when a user clicks the "Edit" button for "Record 1" in the recorder application interface, the audio waveform becomes selectable. The user can adjust the audio selection range in the audio waveform using the mouse or touch. The audio selection range will be highlighted, and the text selection space corresponding to the content of the audio selection range in the transcribed text will also be highlighted, so that the user can quickly locate the relevant content when editing audio or modifying text.

[0100] In this application embodiment, a selection operation refers to the operation of a user selecting a specific area or content on the user interface through some interactive method (such as a mouse, touch screen, etc.). In audio processing software, a selection operation refers to a user selecting a specific time interval on an audio waveform graph in order to further process or manipulate the audio content within that interval.

[0101] This application's embodiments achieve synchronous interaction between audio waveform diagrams and transcribed text. When a user selects an audio waveform diagram, the system automatically identifies the selected audio segment and finds the corresponding text content in the transcribed text, simultaneously highlighting both the selected audio segment on the waveform diagram and the selected text segment in the transcribed text. This design allows users to intuitively see the correspondence between audio segments and text content, facilitating precise audio editing and text proofreading.

[0102] This application's embodiments closely link audio waveforms and transcribed text, ensuring users can quickly locate relevant content when editing audio or modifying text, thereby improving work efficiency and accuracy. For example, during the editing of interview recordings, users can easily find audio segments of key statements and their corresponding text locations for trimming, modification, or annotation. This precise synchronization mechanism not only improves the efficiency of audio processing but also reduces errors caused by mismatches between audio and text.

[0103] For example, when a user needs to delete an audio segment, the system will simultaneously delete the corresponding text content to ensure that the audio and text remain consistent. In audio files of multi-person conversations, this synchronization mechanism can help users quickly distinguish the content of different speakers and avoid confusion.

[0104] In some embodiments, the process of highlighting the audio selection range of the audio waveform and the text selection range of the transcribed text mentioned in step S02 can specifically be as follows:

[0105] When generating transcribed text from audio files, the system ensures a timestamp correspondence between the audio file, audio waveform, and transcribed text by adding timestamps to each text segment. Based on this timestamp correspondence and the selected time point, the system uses CSS styles or highlighting techniques to simultaneously highlight the corresponding interval content in both the audio waveform and the transcribed text.

[0106] Based on the above technical solution, this application embodiment simultaneously displays audio waveforms and transcribed text on the same interface. When the user selects an audio waveform, the corresponding audio selection range and the transcribed text selection range are highlighted in real time, achieving precise synchronization and intuitive comparison between audio and text. This not only improves the convenience and accuracy of user operations during audio editing, effectively avoiding problems such as incorrect trimming caused by the inability to compare audio and text in real time, but also enhances the efficiency of audio file processing and user experience, enabling users to complete audio file editing and processing more efficiently and accurately.

[0107] Building upon the above embodiments, in some embodiments, to improve the efficiency and accuracy of audio and text editing and avoid the tedious manual comparison and positioning required by users, the system can also establish a timestamp correspondence between audio files, audio waveforms, and transcribed text to achieve precise synchronization between audio and text. When a user selects an audio waveform, the system can accurately identify the start and end times of the selected audio interval and quickly query the text information within that time interval in the transcribed text based on the timestamp correspondence, identifying this text information as the selected text interval and highlighting it. This achieves automatic matching and highlighting of audio and text selection intervals, making editing operations more intuitive and convenient, and improving the user experience.

[0108] Please refer to Figure 6 ,for Figure 3 This is a flowchart illustrating one practical implementation of step S02 in a method for processing audio files. In some embodiments, a timestamp correspondence exists between the audio file, the audio waveform, and the transcribed text. Based on this, step S02, in response to a selection operation on the audio waveform, highlights the audio selection range of the audio waveform and the text selection range of the transcribed text. Specifically, this can be achieved as follows: Figure 6 The steps shown are as follows:

[0109] S021: Identify the start and end time points corresponding to the selected audio interval.

[0110] In this embodiment, identifying the start and end times of the selected audio interval is to achieve precise synchronization between the audio and the transcribed text. When a user selects an audio interval on the audio waveform, the system can accurately record the start and end times of that interval so that the corresponding text content can be found in the transcribed text, thereby achieving synchronized highlighting of the audio and text selection intervals.

[0111] In some embodiments, the process of identifying the start and end time points corresponding to the audio selection interval mentioned in step S021 can be specifically as follows:

[0112] The system captures user selection actions on the user interface. When a user selects a range on the audio waveform using a mouse or touch, the system can capture the user's selection action using event listeners (such as mousedown, mousemove, mouseup, or touch events) and record the start and end positions of the selection action.

[0113] The system uses the application programming interface (API) of audio processing software or an audio processing library (such as the Web Audio API) to convert the start and end positions of the selection operation into corresponding time points based on the length of the audio waveform and the total duration of the audio file. For example, if the length of the audio waveform is 1000 pixels and the total duration of the audio file is 10 seconds, and the user selects a position from 200 pixels to 600 pixels on the audio waveform, the start time point is 2 seconds and the end time point is 6 seconds. In this way, the system can accurately identify the time range of the audio selection interval, providing a foundation for subsequent audio and text synchronization operations.

[0114] S022: Based on the timestamp correspondence, query the text information in the transcribed text that falls between the start time point and the end time point, and determine the text information as the text selection interval.

[0115] In this embodiment, the system identifies the text content matching these time points in the transcribed text based on the start and end times of the selected audio interval and the timestamp mapping between audio and text. This text is then designated as the selected text interval. The aim is to achieve precise synchronization and intuitive comparison between audio and text content. In this way, when a user selects an audio interval in the audio waveform, the system can quickly locate and highlight the corresponding text content in the transcribed text, thereby helping the user to more intuitively understand and edit the audio and its transcribed text, improving the efficiency and accuracy of audio processing.

[0116] In some embodiments, the system assigns a timestamp to each text segment during the audio file transcription process, indicating the segment's specific location within the audio. Once the system identifies the start and end timestamps corresponding to the selected audio interval, it can combine these timestamps to find matching text content within the transcribed text. For example, if the selected audio interval is from the 5th to the 10th second, the system will find the corresponding timestamp text segments in the transcribed text and highlight them as the selected interval. This precise query and matching mechanism provides users with an intuitive and efficient way to view and edit audio and its corresponding text content.

[0117] Based on the above technical solution, this application embodiment achieves precise synchronization between audio and text by establishing a timestamp correspondence between audio files, audio waveforms, and transcribed text. When a user selects an audio waveform, the system can accurately identify the start and end times of the selected audio interval and quickly query the text information within that time interval in the transcribed text based on the timestamp correspondence. This text information is then identified as the selected text interval and highlighted. This process improves the efficiency and accuracy of audio and text editing. Users no longer need to manually perform tedious comparisons and positioning between audio and text; the system automatically completes the matching and display, making editing operations more intuitive and convenient, and enhancing the user experience.

[0118] Based on the above embodiments, in some embodiments, to further improve the efficiency and accuracy of audio and text editing, after determining the audio selection range and the text selection range, the following steps can also be performed:

[0119] In response to the first cropping operation, the content of the audio selection region in the audio waveform diagram and the content of the text selection region in the transcribed text are deleted.

[0120] Please refer to Figure 7 This is a schematic diagram illustrating a method for cropping audio and text selection ranges according to an embodiment of this application. Figure 7 As shown, after determining the audio selection range and the text selection range, when the user clicks the "Crop" button of "Record 1" in the recorder application interface, the "Keep Selected Area" option and the "Delete Selected Area" option will pop up. If the user enters the first cropping operation at this time, that is, clicks the "Delete Selected Area" option, the system will delete the content of the audio selection range in the audio waveform diagram and the content of the text selection range in the transcribed text.

[0121] In this embodiment of the application, the first trimming operation refers to the user performing a deletion (trimming) operation on a selected interval in the audio waveform graph in the audio editing interface through a specific interaction method (such as clicking the "Delete / Trim" button), which is used to remove unnecessary parts of the audio file, thereby retaining the audio segments that the user is interested in.

[0122] In this embodiment, the system responds to the user's first trimming operation by simultaneously deleting the content of the selected audio region in the audio waveform diagram and the content of the selected text region in the transcribed text. This function ensures synchronous updates of audio and text content during the editing process, avoiding inconsistencies between audio and text. When the user selects a region in the audio waveform diagram and performs a trimming operation, the system not only deletes the audio region but also automatically deletes the corresponding text content in the transcribed text, thereby maintaining the matching between audio and text.

[0123] This application's embodiments improve the efficiency and accuracy of audio editing. By synchronously deleting audio and text content, users no longer need to manually compare and modify the audio and text, reducing content mismatch issues caused by operational errors. Furthermore, this synchronization mechanism provides users with a more intuitive and convenient editing experience, enabling them to complete synchronous editing of audio and text within a single interface, reducing the frequency of switching between different tools and interfaces, thereby enhancing the overall user experience.

[0124] Based on the above embodiments, in some embodiments, after deleting the content of the audio selection interval in the audio waveform diagram and the content of the text selection interval in the transcribed text, in order to generate a new audio file for easier subsequent sharing, storage, or further processing, the following steps may also be performed:

[0125] When the content of the audio selection interval in the audio waveform diagram and the content of the text selection interval in the transcribed text are deleted, in response to the first save operation, the audio file after deleting the content between the start time point and the end time point is saved as a new audio file.

[0126] like Figure 7 As shown, when the content of the selected audio interval in the audio waveform diagram and the selected text interval in the transcribed text are deleted, if the user enters the first save operation, i.e., clicks the "√" button in the upper right corner of the recorder application interface, the system will save the audio file after deleting the content between the start and end time points as a new audio file. This function ensures that users can save the modified version at any time while editing audio, while retaining the original file to avoid data loss.

[0127] This application provides a convenient saving mechanism, enabling users to quickly generate edited audio files without manually exporting or saving them as new files. After deleting audio and text content, users simply click the "√" button to complete the save operation. The system will automatically save the modified audio file as a new file, preserving the integrity of the original audio file. This not only improves user efficiency but also provides a flexible file management method, facilitating subsequent sharing, storage, or further processing.

[0128] Based on the above embodiments, in some embodiments, after deleting the content of the audio selection interval in the audio waveform diagram and the content of the text selection interval in the transcribed text, in order to avoid data loss due to accidental operation and improve the user's operation error tolerance, the following steps can also be performed:

[0129] When the content of the audio selection interval in the audio waveform diagram and the content of the text selection interval in the transcribed text are deleted, in response to the first retraction operation, the content of the deleted audio selection interval in the audio waveform diagram and the content of the text selection interval in the transcribed text are restored to be displayed.

[0130] Please refer to Figure 8 This is a schematic diagram illustrating the interface changes for a first withdrawal operation provided in an embodiment of this application. Figure 8 As shown, when the content of the audio selection interval in the audio waveform diagram and the content of the text selection interval in the transcribed text are deleted, if the user enters the first undo operation, that is, clicks the "Undo" button in the upper right corner of the recorder application interface, the system will restore the display of the deleted audio selection interval in the audio waveform diagram and the text selection interval in the transcribed text.

[0131] This application provides a convenient undo mechanism. When a user accidentally deletes the audio selection area in the audio waveform diagram and the corresponding text selection area in the transcribed text, in response to the first undo operation, the system can quickly restore the display of the deleted audio waveform diagram and transcribed text content. This mechanism effectively avoids data loss due to accidental operation, improves the user's operational error tolerance, and eliminates concerns about irreversible losses caused by accidental deletion during audio editing, thereby improving the efficiency of audio editing and the user experience.

[0132] Based on the above embodiments, in some embodiments, to further improve the efficiency and accuracy of audio and text editing, after determining the audio selection range and the text selection range, the following steps can also be performed:

[0133] In response to the second cropping operation, the contents of the audio waveform graph other than the audio selection interval and the contents of the transcribed text other than the text selection interval are deleted.

[0134] Please refer to Figure 9 This is a schematic diagram illustrating another method for cropping audio and text selection regions according to an embodiment of this application. Figure 9 As shown, after determining the audio selection range and the text selection range, when the user clicks the "Crop" button of "Record 1" in the recorder application interface, the "Keep Selected Area" option and the "Delete Selected Area" option will pop up. If the user enters the second cropping operation at this time, that is, clicks the "Keep Selected Area" option, the system will delete the content of other ranges in the audio waveform graph except for the audio selection range, as well as the content of other ranges in the transcribed text except for the text selection range.

[0135] This application's embodiments achieve precise content retention based on user-specified intervals. When performing the second trimming operation, the system automatically deletes all content in the audio waveform and transcribed text except for the selected intervals, ensuring that only the core parts of interest to the user are retained. This function improves the accuracy and efficiency of audio editing. Users do not need to manually delete redundant parts; the system automatically completes the trimming, simplifying the operation process and making audio editing more convenient and efficient, while ensuring the accuracy and completeness of key information.

[0136] Based on the above embodiments, in some embodiments, after the contents of the intervals other than the audio selection interval in the audio waveform diagram and the contents of the intervals other than the text selection interval in the transcribed text are deleted, in order to generate a new audio file for easy subsequent sharing, storage or further processing, the following steps can also be performed:

[0137] When the content of other intervals in the audio waveform graph besides the audio selection interval and the content of other intervals in the transcribed text besides the text selection interval are deleted, in response to the second save operation, the content between the start time point and the end time point in the audio file is saved as a new audio file.

[0138] like Figure 9 As shown, when content in intervals other than the audio selection interval in the audio waveform graph and content in intervals other than the text selection interval in the transcribed text are deleted, if the user enters a second save operation, i.e., clicks the "√" button in the upper right corner of the recorder application interface, the system will save the content between the start and end times of the audio file as a new audio file. This function ensures that users can save modified versions at any time while editing audio, while retaining the original file to avoid data loss.

[0139] In this embodiment, users can quickly locate and retain key parts of the audio through simple operations, while deleting redundant content, thereby generating a more concise and targeted audio file. Furthermore, the simultaneous saving of corresponding text content provides users with richer information, facilitating further editing, sharing, or archiving. This function is particularly suitable for scenarios requiring the extraction of important segments from long audio files, such as meeting minutes, interview clippings, or the organization of teaching materials.

[0140] This application's embodiments achieve precise content extraction and preservation. When the user performs the second trimming operation, deleting all content in the audio waveform and transcribed text except for the selected interval, in response to the second save operation, the system automatically saves the content between the start and end times in the audio file as a new audio file. This mechanism not only ensures the accurate extraction and preservation of key audio content but also provides users with a convenient file management method. Users do not need to manually segment and save audio segments; the system completes the operation automatically, simplifying the workflow and improving the efficiency and convenience of audio file processing.

[0141] Based on the above embodiments, in some embodiments, such as Figure 9 As shown, when the content of other intervals in the audio waveform graph (excluding the audio selection interval) and the content of other intervals in the transcribed text (excluding the text selection interval) are deleted, if the user enters a second undo operation, that is, clicks the "Undo" button in the upper right corner of the recorder application interface, the system will restore the display of the deleted content of other intervals in the audio waveform graph (excluding the audio selection interval) and the content of other intervals in the transcribed text (excluding the text selection interval).

[0142] This application provides a convenient undo mechanism. When a user accidentally deletes an element, in response to a second undo operation, the system can quickly restore the display of the deleted audio waveform and transcribed text content. This mechanism effectively avoids data loss due to accidental operations, improves the user's operational error tolerance, and eliminates concerns about irreversible losses caused by accidental deletion during audio editing, thereby improving audio editing efficiency and user experience.

[0143] The above embodiments provide an audio file processing method. Its core lies in displaying a first interface that allows users to view the audio waveform and transcribed text of the audio file, and enabling synchronous highlighting of the audio and text through selection. This design provides users with an intuitive audio-text comparison function, facilitating precise editing and proofreading. Furthermore, to facilitate the extraction of key information from the edited audio file to create documentation, a preset AI recognition model can be used to identify the transcribed text, resulting in corresponding AI-generated summary text.

[0144] Please refer to Figure 10 This is a flowchart illustrating another audio file processing method provided in an embodiment of this application, as shown below. Figure 10 As shown, this can be achieved by performing the following steps:

[0145] S11: Display the second interface.

[0146] The second interface includes a third area, a fourth area, and audio playback control buttons for audio files. The third area includes an audio waveform diagram, and the fourth area includes transcribed text.

[0147] In this embodiment, the second interface comprises three main parts: a third area, a fourth area, and audio playback control buttons. The third area displays an audio waveform, allowing users to visually view the structure and rhythm of the audio file. The fourth area displays the transcribed text, facilitating text editing and proofreading by comparing the audio content. The audio playback control buttons control playback, pause, and stop of the audio file, providing users with convenient audio playback control functions. This layout design provides users with an integrated operating environment, facilitating efficient switching between audio playback, editing, and text comparison.

[0148] In this embodiment, users can complete audio playback, waveform viewing, text editing, and proofreading operations within a single interface, eliminating the need for frequent switching between different interfaces. The integrated audio playback control buttons allow users to play, pause, or adjust the audio playback progress at any time, while simultaneously viewing the corresponding content in the waveform and transcribed text in real time. This unified interface layout not only improves the continuity and convenience of operation but also enhances the overall user experience during audio processing.

[0149] S12: In response to the minutes generation operation, a pop-up window is displayed on the second interface.

[0150] The pop-up window includes AI summary text, which is obtained by recognizing the transcribed text through a preset AI recognition model.

[0151] Please refer to Figure 11 This is a schematic diagram illustrating a display of a second interface provided in an embodiment of this application. Figure 11 As shown, when a user enters the minutes generation operation on the second interface, that is, clicks the "AI Minutes" button, the system will use a preset AI recognition model to recognize the transcribed text to obtain the AI ​​minutes text, which will then be displayed in a pop-up window.

[0152] This application's embodiments improve the efficiency and accuracy of information processing. Through the summary text generated by the AI ​​model, users can quickly browse key information in the audio content without having to read the complete transcript word for word. This not only saves time but also provides users with a clearer overview, facilitating further editing and organization. Furthermore, the AI ​​summary function can be customized according to user needs, such as extracting specific topics or keywords, further enhancing its practicality and flexibility.

[0153] Based on the above technical solution, this embodiment of the application integrates audio waveforms, transcribed text, and audio playback control buttons on a second interface, providing users with comprehensive audio editing and viewing functions. When the user clicks the minutes generation operation, the system displays a pop-up window on the second interface, containing AI minutes text generated by a preset AI recognition model. This function enhances the intelligence level of audio processing; users no longer need to manually organize the transcribed text, as the system automatically generates minutes through AI technology, saving significant time and effort. Simultaneously, the generation of AI minutes text provides users with more accurate and professional text content, helping to improve the application value and usage efficiency of audio files.

[0154] Based on the above embodiments, in some embodiments, after the pop-up window is displayed on the second interface in response to the minutes generation operation, in order to simplify user operation steps and improve efficiency and user experience, the following steps can also be performed:

[0155] In response to the insertion of a note, the note application interface is displayed; the note application interface includes a fifth area and a sixth area. The fifth area includes a note audio card, which includes audio playback control buttons for the audio file, an audio waveform graph of the audio file, and transcribed text. The sixth area includes AI summary text.

[0156] Please refer to Figure 12 This is a schematic diagram of a note-taking application interface provided in an embodiment of this application. Figure 12 As shown, when a user enters the "Insert Note" operation in the pop-up window, i.e., clicks the "Insert Note" button, the system will launch the note application and display the first and second areas in the note application interface. The first area displays the note audio card, which includes audio playback control buttons for the audio file, an audio waveform graph, and transcribed text. The sixth area displays the AI ​​summary text.

[0157] In this embodiment, the audio note card not only includes playback control buttons for the audio file, allowing users to easily play or pause the audio, but also an audio waveform diagram, enabling users to intuitively view the structure and progress of the audio. Simultaneously, the transcribed text is also displayed on the card, facilitating user review and editing in conjunction with the audio content. The sixth area displays the summary text generated by an AI recognition model, providing users with a concise overview of the audio content for quick extraction of key information. This layout allows users to complete audio playback, text comparison, and summary viewing within a single interface, improving work efficiency and user experience.

[0158] Based on the above embodiments, in some embodiments, to further improve the efficiency and convenience of user operation, the following steps may also be performed:

[0159] In response to a playback action, play the audio file in the audio card.

[0160] like Figure 12 As shown, when a user enters a play command in the audio card of the notes app (i.e., clicks the audio playback control button), the system will play the audio file within the notes app interface. This feature allows users to play audio directly within the notes app without switching to other apps or interfaces, achieving seamless integration of audio playback and note content, thus improving user experience and operational efficiency. Simultaneously, during audio playback, users can continue to view and edit transcribed text or AI-generated summary text within the notes app interface, while also referring to the audio content for further operations. This design not only improves the continuity of user interaction when processing audio and note content but also reduces the inconvenience caused by frequent interface switching, further enhancing the practicality and convenience of the notes app.

[0161] In this embodiment, when a user clicks the play button, the system immediately plays the audio file in the audio card, eliminating the need for the user to perform any additional file search or opening operations. This design improves user efficiency and convenience, enabling users to quickly and intuitively access and play the audio content they need. Simultaneously, the integrated design of the audio cards provides a more unified and seamless user experience, allowing users to perform playback, pause, and stop operations on audio within the same interface, without switching between different interfaces or applications, further enhancing audio processing efficiency and user experience.

[0162] Based on the above embodiments, in some embodiments, to help users better organize and summarize information and form more valuable documents, the following steps can also be performed:

[0163] Responding to editing operations, the AI ​​minutes text can be edited.

[0164] like Figure 12As shown, when a user edits the AI-generated minutes text within the note-taking application interface, the system provides an editable text box where the user can modify, add to, or delete content. This feature allows users to personalize the AI ​​minutes according to their needs and understanding, resulting in more accurate and practical documents.

[0165] In this embodiment, the AI-generated minutes text editing function provides users with greater flexibility and autonomy. Users can refine and optimize the AI-generated minutes according to their actual needs, such as adding key information, deleting redundant content, or adjusting the text format. This editing function not only improves the accuracy and practicality of the minutes but also helps users better organize and summarize information, forming more valuable documents. Furthermore, by editing the AI-generated minutes text, users can better meet the application needs of different scenarios, such as meeting minutes, interview transcripts, and study notes, further enhancing the application value and user experience of the audio processing tool.

[0166] Based on the above technical solutions, this application embodiment integrates audio playback, editing, and text comparison functions into a single interface, reducing the frequency of user switching between different interfaces and improving the continuity and convenience of operation. Simultaneously, AI technology is used to automatically generate summary text, helping users quickly extract key information, reducing the time and effort required for manual organization, and improving information processing efficiency. Furthermore, this application embodiment allows users to import audio files and AI-generated summary text into the note-taking application interface for further editing and organization, meeting application needs in different scenarios. Moreover, users can directly play audio files within the note-taking application interface without switching to other applications, further enhancing the user experience. Finally, this application embodiment allows users to edit the AI-generated summary text, enabling them to optimize the summary content according to their needs and understanding, generating more accurate and practical documents. The combination of these functions not only improves the efficiency of audio processing and note management but also enhances the user experience, allowing users to more conveniently organize and summarize information, forming more valuable documents.

[0167] This application embodiment also provides an audio file processing apparatus, which may include:

[0168] The first display module is used to display a first interface; the first interface includes a first area and a second area, the first area includes an audio waveform diagram of an audio file, and the second area includes the transcribed text of an audio file.

[0169] The second display module is used to highlight the audio selection range of the audio waveform and the text selection range of the transcribed text in response to the selection operation of the audio waveform; the content of the corresponding text selection range in the transcribed text corresponds to the content of the corresponding audio selection range in the audio waveform.

[0170] Based on the above embodiments, in some embodiments, there is a timestamp correspondence between audio files, audio waveforms, and transcribed text;

[0171] The second display module can be specifically used for:

[0172] Identify the start and end time points corresponding to the selected audio interval;

[0173] Based on the timestamp correspondence, query the text information in the transcribed text that falls between the start and end times, and determine the text information as the text selection interval.

[0174] Based on the above embodiments, in some embodiments, the second display module can also be used for:

[0175] In response to the first cropping operation, the content of the audio selection region in the audio waveform diagram and the content of the text selection region in the transcribed text are deleted.

[0176] Based on the above embodiments, in some embodiments, the second display module can also be used for:

[0177] When the content of the audio selection interval in the audio waveform diagram and the content of the text selection interval in the transcribed text are deleted, in response to the first save operation, the audio file after deleting the content between the start time point and the end time point is saved as a new audio file.

[0178] Based on the above embodiments, in some embodiments, the second display module can also be used for:

[0179] When the content of the audio selection interval in the audio waveform diagram and the content of the text selection interval in the transcribed text are deleted, in response to the first retraction operation, the content of the deleted audio selection interval in the audio waveform diagram and the content of the text selection interval in the transcribed text are restored to be displayed.

[0180] Based on the above embodiments, in some embodiments, the second display module can also be used for:

[0181] In response to the second cropping operation, the contents of the audio waveform graph other than the audio selection interval and the contents of the transcribed text other than the text selection interval are deleted.

[0182] Based on the above embodiments, in some embodiments, the second display module can also be used for:

[0183] When the content of other intervals in the audio waveform graph besides the audio selection interval and the content of other intervals in the transcribed text besides the text selection interval are deleted, in response to the second save operation, the content between the start time point and the end time point in the audio file is saved as a new audio file.

[0184] Based on the above embodiments, in some embodiments, the audio file processing device may further include:

[0185] The third display module is used to display the second interface; the second interface includes a third area, a fourth area and audio playback control buttons for audio files, the third area includes an audio waveform graph, and the fourth area includes transcribed text;

[0186] The fourth display module is used to respond to the minutes generation operation and display a pop-up window on the second interface; the pop-up window includes AI minutes text, which is obtained by recognizing the transcribed text through a preset AI recognition model.

[0187] Based on the above embodiments, in some embodiments, the audio file processing device may further include:

[0188] The fifth display module is used to display the note application interface in response to the note insertion operation. The note application interface includes a fifth area and a sixth area. The fifth area includes a note audio card, which includes audio playback control buttons for the audio file, an audio waveform graph of the audio file, and transcribed text. The sixth area includes AI summary text.

[0189] Based on the above embodiments, in some embodiments, the fifth display module can also be used for:

[0190] In response to a playback action, play the audio file in the audio card.

[0191] Based on the above embodiments, in some embodiments, the fifth display module can also be used for:

[0192] Responding to editing operations, the AI ​​minutes text can be edited.

[0193] It should be understood that the term "module" in the embodiments of this application can be implemented in software and / or hardware, without specific limitation. For example, a "module" can be a software program, hardware circuit, or a combination of both that implements the above-described functions. Hardware circuits may include application-specific integrated circuits (ASICs), electronic circuits, processors (e.g., shared processors, proprietary processors, or group processors, etc.) and memory for executing one or more software or firmware programs, combined logic circuits, and / or other suitable components that support the described functions.

[0194] Therefore, the modules of the various examples described in the embodiments of this application can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0195] This application also provides a computer-readable storage medium storing instructions that, when executed on a computer, cause the computer to perform the various steps of the audio file processing method of this application.

[0196] This application also provides a computer program product containing instructions that, when run on a computer or any at least one processor, cause the computer to execute the various steps of the audio file processing method of this application.

[0197] This application also provides a chip, including a processor and a data interface. The processor reads instructions stored in the memory through the data interface to execute the corresponding operations and / or processes of the audio file processing method provided in this application.

[0198] Optionally, the chip further includes a memory connected to the processor via a circuit or wire, the processor being used to read and execute computer programs stored in the memory. Further optionally, the chip includes a communication interface to which the processor is connected. The communication interface is used to receive data and / or information that needs to be processed, the processor obtaining the data and / or information from the communication interface and processing the data and / or information. The communication interface can be an input / output interface.

[0199] The memory can be read-only memory (ROM), other types of static storage devices that can store static information and instructions, random access memory (RAM), or other types of dynamic storage devices that can store information and instructions. It can also be electrically erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical discs, laser discs, optical discs, digital universal optical discs, Blu-ray discs, etc.), magnetic disk storage media, or other magnetic storage devices. Alternatively, it can be any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer.

[0200] In this embodiment, "and / or" describes the relationship between associated objects, indicating that three relationships can exist. For example, A and / or B can represent the existence of A alone, the simultaneous existence of A and B, or the existence of B alone. A and B can be singular or plural. The character " / " generally indicates that the preceding and following associated objects are in an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, and c can represent: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple.

[0201] Those skilled in the art will recognize that the units and algorithm steps described in the embodiments disclosed herein can be implemented using electronic hardware, computer software, or a combination of electronic hardware and software. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0202] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0203] In the several embodiments provided in this application, any function, if implemented as a software functional unit and sold or used as an independent product, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0204] The above description is merely a specific embodiment of this application. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the protection scope of this application. The protection scope of this application shall be determined by the scope of the claims.

Claims

1. A method for processing audio files, characterized in that, include: Displaying a first interface; the first interface includes a first region and a second region, the first region includes an audio waveform diagram of an audio file, and the second region includes the transcribed text of the audio file; In response to the selection operation of the audio waveform, the audio selection interval of the audio waveform and the text selection interval of the transcribed text are highlighted; the content in the transcribed text corresponding to the text selection interval corresponds to the content in the audio waveform corresponding to the audio selection interval.

2. The method according to claim 1, characterized in that, There is a timestamp correspondence between the audio file, the audio waveform, and the transcribed text; The step of highlighting the audio selection range of the audio waveform and the text selection range of the transcribed text in response to the selection operation of the audio waveform includes: Identify the start and end time points corresponding to the audio selection interval; Based on the timestamp correspondence, query the transcribed text for text information between the start time point and the end time point, and determine the text information as the text selection interval.

3. The method according to claim 2, characterized in that, Also includes: In response to the first cropping operation, the content of the audio selection interval in the audio waveform diagram and the content of the text selection interval in the transcribed text are deleted.

4. The method according to claim 3, characterized in that, Also includes: When the content of the audio selection interval in the audio waveform diagram and the content of the text selection interval in the transcribed text are deleted, in response to the first save operation, the audio file after deleting the content between the start time point and the end time point is saved as a new audio file.

5. The method according to claim 3, characterized in that, Also includes: When the content of the audio selection interval in the audio waveform diagram and the content of the text selection interval in the transcribed text are deleted, in response to the first retraction operation, the content of the deleted audio selection interval in the audio waveform diagram and the content of the text selection interval in the transcribed text are restored to be displayed.

6. The method according to claim 2, characterized in that, Also includes: In response to the second cropping operation, the contents of the audio waveform graph other than the audio selection interval and the contents of the transcribed text other than the text selection interval are deleted.

7. The method according to claim 6, characterized in that, Also includes: When the content of other intervals in the audio waveform diagram besides the audio selection interval and the content of other intervals in the transcribed text besides the text selection interval are deleted, in response to the second save operation, the content of the audio file between the start time point and the end time point is saved as a new audio file.

8. The method according to any one of claims 1-7, characterized in that, Also includes: The second interface is displayed; the second interface includes a third area, a fourth area, and audio playback control buttons for the audio file, the third area includes the audio waveform diagram, and the fourth area includes the transcribed text; In response to the minutes generation operation, a pop-up window is displayed on the second interface; the pop-up window includes AI minutes text, which is obtained by recognizing the transcribed text through a preset AI recognition model.

9. The method according to claim 8, characterized in that, After the second interface displays a pop-up window in response to the minutes generation operation, the method further includes: In response to the insertion of a note, a note application interface is displayed; the note application interface includes a fifth area and a sixth area, the fifth area includes a note audio card, the note audio card includes audio playback control buttons for the audio file, an audio waveform diagram of the audio file, and the transcribed text, and the sixth area includes the AI ​​summary text.

10. The method according to claim 9, characterized in that, Also includes: In response to a playback operation, the audio file in the audio card is played.

11. The method according to claim 9, characterized in that, Also includes: In response to the editing operation, the AI ​​minutes text is edited.

12. An electronic device, characterized in that, include: processor; Memory; The memory stores a computer program that, when executed, causes the electronic device to perform the method described in any one of claims 1-11.

13. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored program, wherein, when the program is executed, it controls the device on which the computer-readable storage medium is located to perform the method according to any one of claims 1-11.

14. A program product, characterized in that, The program product stores a program that, when run by an information processing device, causes the information processing device to perform the method as described in any one of claims 1-11.

Images