Audio track marking method and electronic equipment

Abstract

The invention provides an audio track marking method and electronic equipment. In the method, when the electronic equipment records or plays an audio, an audio track of the audio is displayed in a display screen. In response to a first operation triggered by a user, the electronic equipment displays a first position corresponding to the first operation on the audio track as a first display style; wherein the first operation is used for indicating to mark the first position of the audio track. Through the scheme, the electronic equipment can display the first position on the audio track triggered and marked by the user as the first display style, so that key audio positions in the audio track can be quickly marked, the user can conveniently search key audios at any time, and the user experience is improved.

Description

[0001] Cross-reference instructions

[0002] This application is a divisional application. The application number of the original application is 202210633882.X, and the original application date is June 6, 2022. The entire contents of the original application are incorporated into this application by reference. Technical Field

[0003] The present application relates to the field of terminal technology, and in particular to a method for marking an audio track and an electronic device. Background Art

[0004] Speech transcription refers to a technology that transcribes the speech content in audio into text. It is widely used in conference scenarios and online learning scenarios. For example, when speech transcription is applied in conference scenarios, the conference recording can be transcribed and the conference speech content can be transcribed into text, making it easier to record and view the conference content.

[0005] However, when the user needs to confirm or mark a certain voice transcription content, he needs to listen to the recording repeatedly to find the corresponding voice position, which is cumbersome and inefficient. Summary of the invention

[0006] The present application provides a method for marking an audio track and an electronic device, which are used to provide a method for quickly marking key content on an audio track.

[0007] In a first aspect, the present application provides a method for marking an audio track. The method can be performed by an electronic device, and the method includes: when recording audio or playing the audio, displaying the audio track of the audio on a display screen; in response to a first operation triggered by a user, displaying a first position corresponding to the first operation on the audio track as a first display style; wherein the first operation is used to indicate marking the first position of the audio track.

[0008] Based on the above method, when the electronic device is recording or playing audio, the audio track is displayed on the display screen. The user can trigger the first operation at any time. The electronic device can display the first position corresponding to the first operation on the audio track as a first display style, thereby quickly marking the key audio position in the audio track, making it convenient for the user to find the key audio at any time, thereby improving the user experience.

[0009] In one possible design, after displaying the first position corresponding to the first operation on the audio track as a first display style in response to the first operation triggered by the user, the method further includes: displaying the first area between the first position on the audio track and the second position corresponding to the second operation as the first display style in response to the second operation triggered by the user; wherein the second operation is used to indicate an end mark at the second position of the audio track, and the second position is after the first position.

[0010] Through this design, the electronic device can determine the first area in the audio track according to the first operation and the second operation triggered by the user, and display the first area in the first display style, thereby marking the area corresponding to the key audio in the audio track, making it easy for the user to find it at any time.

[0011] In one possible design, the first display style includes at least one of the following: a background color different from a default display style of the audio track; a track shape different from a default display style of the audio track; and a track color different from a default display style of the audio track.

[0012] In a possible design, the method further includes: performing voice transcription on the audio, displaying the voice transcription content corresponding to the audio; and displaying the voice transcription content corresponding to the first position in the voice transcription content as a second display style. The voice transcription content corresponding to the first position may be the voice transcription content of the audio corresponding to the audio track area of ​​a preset length including the first position, and the first position may be located at the starting position, the ending position, or the middle position of the audio track area.

[0013] In one possible design, the method further includes: performing voice transcription on the audio, displaying the voice transcription content corresponding to the audio; and displaying the voice transcription content corresponding to the first area in the voice transcription content as a second display style. The voice transcription content corresponding to the first area includes the voice transcription content of the audio corresponding to the first area.

[0014] Through the above design, the electronic device can also mark the voice transcription content corresponding to the first position or the first area marked by the user, so that the key content can be highlighted for user viewing.

[0015] In one possible design, the second display style includes at least one of the following: a font different from the default display style of the speech transcription content; a text color different from the default display style of the speech transcription content; a background color different from the default display style of the speech transcription content.

[0016] In one possible design, the method also includes: in response to a third operation triggered by the user, adding an annotation area at a third position corresponding to the third operation; displaying an annotation editing interface on the display screen, receiving annotation content input by the user in the annotation editing interface, and displaying the annotation content in the annotation area.

[0017] Through this design, the electronic device can respond to the third operation triggered by the user and display the annotations input by the user at the third position, thereby marking the key content and making it easier for the user to find audio content or voice transcription content.

[0018] In one possible design, the method further includes: displaying the area corresponding to the third position on the audio track in a third display style.

[0019] In one possible design, displaying the annotation editing interface on the display screen includes: displaying a voice transcription interface and the annotation editing interface in split screens on the display screen; or displaying a floating window on the voice transcription interface displayed on the display screen, and displaying the annotation editing interface in the floating window; wherein the voice transcription interface includes the audio track of the audio and the voice transcription content corresponding to the audio.

[0020] Through this design, the electronic device can display the annotation editing interface in a split screen or in a floating window, and flexibly receive the annotation content input by the user.

[0021] In one possible design, the method also includes: displaying a speech transcription interface and a minutes editing interface in split screen on the display screen; wherein the speech transcription interface includes the audio track of the audio and the speech transcription content corresponding to the audio, and the minutes editing interface includes the target speech transcription content and / or the playback controls corresponding to the target speech transcription content; the target speech transcription content includes the speech transcription content corresponding to the marked audio track area in the audio track and / or the speech transcription content corresponding to the annotated audio track area, and the playback controls corresponding to the target speech transcription content are used to play the audio clip corresponding to the target speech transcription content.

[0022] With this design, the electronic device can also display the voice transcription interface and the minutes editing interface in split screens. The minutes editing interface can include the voice transcription content corresponding to the marked audio track area and / or the voice transcription content corresponding to the annotated audio track area. The user can directly use these contents to edit the minutes, which is convenient for user operation and improves the user experience. In addition, the minutes editing interface can also include a playback control corresponding to the target voice transcription content. The user can click the playback control to repeatedly listen to the audio content corresponding to the marked audio track area at any time, thereby improving the user experience.

[0023] In one possible design, when the audio track includes multiple marked audio track areas, the multiple marked audio track areas correspond to at least one display style, and the at least one display style is user-defined.

[0024] For example, the display styles corresponding to the audio track areas marked by different users are different.

[0025] In one possible design, the method further includes: in response to a movement operation triggered by the user on a sliding control in the display interface, adjusting the speech transcription content displayed in the display interface according to a distance corresponding to the movement operation.

[0026] In a second aspect, the present application provides an electronic device, the electronic device comprising a plurality of functional modules; the plurality of functional modules interact with each other to implement the method shown in the first aspect and its various embodiments. The plurality of functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the plurality of functional modules can be arbitrarily combined or divided based on specific implementations.

[0027] In a third aspect, the present application provides an electronic device comprising at least one processor and at least one memory, wherein the at least one memory stores computer program instructions, and when the electronic device is running, the at least one processor executes the method shown in the above-mentioned first aspect and its various embodiments.

[0028] In a fourth aspect, the present application further provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the method shown in the first aspect and its various embodiments.

[0029] In a fifth aspect, the present application further provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a computer, the computer executes the method shown in the above-mentioned first aspect and its various embodiments.

[0030] In a sixth aspect, the present application further provides a chip, which is used to read a computer program stored in a memory and execute the method shown in the above-mentioned first aspect and its various embodiments.

[0031] In a seventh aspect, the present application further provides a chip system, which includes a processor for supporting a computer device to implement the method shown in the first aspect and its various embodiments. In a possible design, the chip system also includes a memory, which is used to store the necessary programs and data of the computer device. The chip system can be composed of a chip, or it can include a chip and other discrete devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0033] Figure 2 A software structure block diagram of an electronic device provided in an embodiment of the present application;

[0034] Figure 3 A schematic diagram of a display interface for displaying audio tracks of an electronic device provided in an embodiment of the present application;

[0035] Figure 4 A schematic diagram of a user triggering a first operation provided in an embodiment of the present application;

[0036] Figure 5 A schematic diagram of displaying a first position mark provided in an embodiment of the present application;

[0037] Figure 6 A schematic diagram of displaying a sound track provided in an embodiment of the present application;

[0038] Figure 7 A schematic diagram of marking the speech transcription content corresponding to the first position provided in an embodiment of the present application;

[0039] Figure 8 A schematic diagram of marking speech transcription content corresponding to a first area provided in an embodiment of the present application;

[0040] Fig. 9 A schematic diagram of an interface for voice transcription of audio provided in an embodiment of the present application;

[0041] Fig.10 A schematic diagram of displaying a track area including multiple marks on a track provided in an embodiment of the present application;

[0042] Fig.11 A schematic diagram of a first annotation editing interface provided in an embodiment of the present application;

[0043] Fig.12 A schematic diagram of another annotation editing interface provided in an embodiment of the present application;

[0044] Fig.13 A schematic diagram of displaying annotations on a sound track provided in an embodiment of the present application;

[0045] Fig.14 A schematic diagram of a mark display style provided in an embodiment of the present application;

[0046] Fig.15 A schematic diagram of displaying annotations on a sound track provided in an embodiment of the present application;

[0047] Fig.16A schematic diagram of an interface for editing speech transcription content provided in an embodiment of the present application;

[0048] Fig.17 A display schematic diagram of a minutes editing interface provided in an embodiment of the present application;

[0049] Fig.18 A schematic diagram of another display of a minutes editing interface provided in an embodiment of the present application;

[0050] Fig.19 A schematic diagram of displaying speech transcription content provided in an embodiment of the present application;

[0051] Fig. 20 A schematic diagram of a first audio track display method provided in an embodiment of the present application;

[0052] Fig.21 A schematic diagram of another audio track display method provided in an embodiment of the present application;

[0053] Fig. 22 A flowchart of a method for marking an audio track provided in an embodiment of the present application. DETAILED DESCRIPTION

[0054] In order to make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the embodiments of the present application will be further described in detail below in conjunction with the accompanying drawings. Among them, in the description of the embodiments of the present application, the terms "first" and "second" are used only for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features.

[0055] It should be understood that in the embodiments of the present application, "at least one" refers to one or more, and "plurality" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the associated objects before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can represent: a, b, c, a and b, a and c, b and c, or a, b and c, where a, b, c can be single or multiple.

[0056] Speech transcription refers to a technology that transcribes the speech content in audio into text. It is widely used in conference scenarios and online learning scenarios. For example, when speech transcription is applied in conference scenarios, the conference recording can be transcribed and the conference speech content can be transcribed into text, making it easier to record and view the conference content.

[0057] However, when the user needs to confirm or mark a certain voice transcription content, he needs to listen to the recording repeatedly to find the corresponding voice position, which is cumbersome and inefficient.

[0058] Based on the above problems, the present application provides a method for marking an audio track, so as to provide a method for quickly marking key content on an audio track.

[0059] The track marking method provided in the embodiment of the present application can be applied to electronic devices. The following introduces electronic devices and embodiments for using such electronic devices. The electronic devices of the embodiments of the present application can be, for example, tablet computers, mobile phones, vehicle-mounted devices, augmented reality (AR) / virtual reality (VR) devices, laptop computers, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), wearable devices, Internet of Things (IoT) devices, car computers, etc. The embodiments of the present application do not impose any restrictions on the specific types of electronic devices. In some embodiments, the electronic device can support a stylus.

[0060] Figure 1 FIG. 1 is a schematic diagram of the structure of an electronic device 100 provided in an embodiment of the present application. Figure 1 As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0061] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). Among them, different processing units may be independent devices or integrated into one or more processors. Among them, the controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction opcode and the timing signal to complete the control of fetching and executing instructions. A memory may also be set in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a high-speed cache memory. The memory may store instructions or data that the processor 110 has just used or circulated. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. Repeated access is avoided, the waiting time of the processor 110 is reduced, and the efficiency of the system is improved.

[0062] The USB interface 130 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transmit data between the electronic device 100 and peripheral devices. The charging management module 140 is used to receive charging input from the charger. The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and provides power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160.

[0063] The wireless communication function of the electronic device 100 can be implemented by antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modulation and demodulation processor and baseband processor. Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antenna. For example, antenna 1 can be reused as a diversity antenna of a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0064] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0065] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0066] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0067] The display screen 194 is used to display the display interface of the application, such as displaying the display page of the application installed on the electronic device 100. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0068] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0069] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, and software code of at least one application, etc. The data storage area can store data generated during the use of the electronic device 100 (such as captured images, recorded videos, etc.). In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0070] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as pictures and videos are stored in the external memory card.

[0071] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0072] Among them, the sensor module 180 may include a pressure sensor 180A, an acceleration sensor 180B, a touch sensor 180C, etc.

[0073] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194 .

[0074] The touch sensor 180C is also called a "touch panel". The touch sensor 180C can be set on the display screen 194, and the touch sensor 180C and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180C is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180C can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194.

[0075] The button 190 includes a power button, a volume button, etc. The button 190 can be a mechanical button. It can also be a touch button. The electronic device 100 can receive the button input and generate a key signal input related to the user settings and function control of the electronic device 100. The motor 191 can generate a vibration prompt. The motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization. The indicator 192 can be an indicator light, which can be used to indicate the charging status, power changes, and can also be used to indicate messages, missed calls, notifications, etc. The SIM card interface 195 is used to connect the SIM card. The SIM card can be inserted into the SIM card interface 195, or pulled out from the SIM card interface 195 to achieve contact and separation with the electronic device 100.

[0076] Understandably, Figure 1The components shown do not constitute a specific limitation on the electronic device 100. The electronic device may also include more or fewer components than shown, or combine some components, or separate some components, or arrange the components differently. Figure 1 The combination / connection relationship between the components can also be adjusted and modified.

[0077] Figure 2 The software structure block diagram of an electronic device provided in an embodiment of the present application is shown in FIG. Figure 2 As shown, the software structure of the electronic device can be a layered architecture, for example, the software can be divided into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the operating system is divided into four layers, from top to bottom, namely, the application layer, the application framework layer (framework, FWK), the runtime (runtime) and the system library, and the kernel layer.

[0078] The application layer can include a series of application packages. Figure 2 As shown, the application layer may include camera, settings, skin module, user interface (UI), third-party applications, etc. Among them, the third-party applications may include gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc. In the embodiment of the present application, the application layer may include a target installation package of a target application that the electronic device requests to download from a server, and the function files and layout files in the target installation package are adapted to the electronic device.

[0079] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer may include some predefined functions. Figure 2 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, and a notification manager.

[0080] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc. The content provider is used to store and obtain data and make the data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0081] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0082] The phone manager is used to provide communication functions for electronic devices, such as the management of call status (including answering, hanging up, etc.).

[0083] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0084] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0085] The runtime includes the core library and the virtual machine. The runtime is responsible for the scheduling and management of the operating system.

[0086] The core library consists of two parts: one is the function that the Java language needs to call, and the other is the core library of the operating system. The application layer and the application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0087] The system library may include multiple functional modules, such as surface manager, media libraries, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), image processing library, etc.

[0088] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0089] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0090] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0091] A 2D graphics engine is a drawing engine for 2D drawings.

[0092] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0093] The hardware layer can include various types of sensors, such as accelerometers, gyroscopes, touch sensors, etc.

[0094] It should be noted that Figure 1 and Figure 2 The structure shown is only an example of the electronic device provided by the embodiment of the present application, and cannot be used to limit the electronic device provided by the embodiment of the present application. In specific implementation, the electronic device may have more Figure 1 or Figure 2 More or fewer devices or modules may be included in the structures shown.

[0095] The following is an introduction to the audio track marking method provided in an embodiment of the present application.

[0096] In some embodiments of the present application, the electronic device can record audio, for example, the user can trigger the electronic device to record audio. The audio recorded by the electronic device can be displayed on the display interface of the electronic device in the form of an audio track, and different positions on the audio track represent audio content corresponding to different times. Figure 3 A schematic diagram of a display interface for displaying an audio track of an electronic device provided in an embodiment of the present application. Figure 3 , the electronic device can display the audio track of the recorded audio, and the length of the audio track will increase as the recording audio progresses.

[0097] In other embodiments of the present application, the electronic device can also play audio. The audio played by the electronic device can also be displayed on the display interface of the electronic device in the form of an audio track. Figure 3 The display interface shown may be an audio track of the audio played by the electronic device, and the user may click a position on the audio track to trigger the electronic device to play the content at the time corresponding to the position in the audio.

[0098] When the electronic device displays the audio track in the display interface, in response to a first operation triggered by the user, a first position corresponding to the first operation is determined. The first operation can be used to indicate marking the audio track at the first position of the audio track. Figure 4 A schematic diagram of a user triggering a first operation provided in an embodiment of the present application. Figure 4The first operation may be a set gesture triggered by the user, such as double-clicking the screen or long pressing the screen; or the first operation may be a user clicking a control in the display interface or keyboard interface, such as a user clicking Figure 4 The "marking mode" control in the interface shown is used to trigger the first operation; or the first operation can be triggered by the user through a button on the stylus body or after performing a set gesture on the stylus.

[0099] In some embodiments of the present application, the electronic device may display the first position corresponding to the first operation on the audio track as a first display style in response to the first operation triggered by the user. Figure 5 A schematic diagram of displaying a first position mark provided in an embodiment of the present application. Figure 5 In response to a first operation triggered by a user, the electronic device determines a first position corresponding to the first operation, and displays the first position on the audio track in a first display style, such as Figure 5 The first display style is to display the arrow icon in the first position.

[0100] In other embodiments of the present application, after determining the first position corresponding to the first operation, the electronic device may mark the track starting from the first position of the track, and display the track after the first position as a first display style. The first display style may be a display style different from the default display style of the track. For example, the first display style may be a background color different from the default display style, or the first display style may be a track shape or track color different from the default display style.

[0101] The electronic device determines a second position corresponding to the second operation in response to a second operation triggered by the user. The second operation is used to indicate that the marking of the audio track is stopped at the second position of the audio track. For example, Figure 6 A schematic diagram of displaying a sound track provided in an embodiment of the present application. Figure 6 , the electronic device displays the first area between the first position and the second position on the audio track as the first display style, and displays the other areas as the default display style. The background color of the first display style is different from that of the default display style. The way in which the user triggers the second operation can refer to the way in which the user triggers the first operation, and the repeated parts are not repeated.

[0102] It is understandable that in some embodiments, the electronic device can also determine the area on the track corresponding to an operation triggered by the user. For example, if the user triggers a sliding operation on the track, the electronic device can determine the area corresponding to the sliding operation and mark the area. In other words, the embodiment of the present application does not limit the operation method of the user triggering the mark.

[0103] It should be noted that the electronic device can mark the first area on the audio track in response to the first operation and the second operation triggered by the user during the process of recording audio or playing audio. In implementation, the electronic device can respond to the first operation triggered by the user, and display the audio track area after the first position corresponding to the first operation as the audio is recorded or played as the first display style, and the electronic device stops marking in response to the second operation triggered by the user. Or the electronic device can determine the first position corresponding to the first operation in response to the first operation triggered by the user, and determine the second position corresponding to the second operation in response to the second operation triggered by the user, and then display the first area between the first position and the second position as the first display style. In other words, the embodiment of the present application does not limit the way in which the electronic device displays the first area as the first display style.

[0104] Through the above introduction, in the audio track marking method provided in the embodiment of the present application, the electronic device can mark the first position of the first operation triggered by the user, and can also mark the first area determined by the first operation and the second operation triggered by the user.

[0105] In the embodiment of the present application, the electronic device can also perform voice transcription on the audio, convert the audio content into text content, and display the text content in the display interface. The electronic device can perform recording and voice transcription simultaneously, or after the electronic device finishes recording and obtains the audio, it can perform voice transcription on the audio.

[0106] In an optional implementation, when the electronic device performs voice transcription on the audio, it can mark the voice transcription content corresponding to the first position on the audio track, and display the voice transcription content corresponding to the first position as a second display style; wherein the voice transcription content corresponding to the first position can be the voice transcription content of the audio corresponding to the audio track area of ​​a preset length including the first position, and the first position can be located at the starting position, the ending position or the middle position of the audio track area. The second display style is a display style different from the default display style of the voice transcription content, such as the second display style is a font, text color, background color, etc. that is different from the default display style of the voice transcription content.

[0107] For example, Figure 7 A schematic diagram of marking the speech transcription content corresponding to the first position provided in an embodiment of the present application. Figure 7 , the speech transcription content corresponding to the first position can be Figure 7 The corresponding speech transcription content of area A is shown. Figure 7 In the embodiment, the first position is located in the middle of region A. It is understandable that the first position may also be located at the starting position or the ending position of region A. The preset length of region A may be an empirical value of a technician. Figure 7In the example, the voice transcription content corresponding to the first position is "January 1st", and the electronic device displays the voice transcription content corresponding to the first position in a second display style, such as the second display style is a background color different from the default display style of the voice transcription content.

[0108] In another optional implementation, the electronic device may also mark the speech transcription content corresponding to the first area on the audio track, and display the speech transcription content corresponding to the first area in a second display style; wherein the speech transcription content corresponding to the first area includes the speech transcription content of the audio corresponding to the first area. The second display style is a display style different from the default display style of the speech transcription content, such as the second display style is a font, text color, background color, etc. that is different from the default display style of the speech transcription content.

[0109] For example, Figure 8 A schematic diagram of marking the speech transcription content corresponding to the first area provided in an embodiment of the present application. Figure 8 , the speech transcription content corresponding to the first area is "The meeting will start at 2 pm on January 1st", and the electronic device displays the speech transcription content corresponding to the first area in a second display style, such as the second display style is a background color different from the default display style of the speech transcription content. Optionally, the first display style and the second display style can be the same to indicate the corresponding relationship between the first area in the audio track and the speech transcription content, such as Figure 8 The first display style and the second display style are the same. The first display style and the second display style can also be different, such as Fig. 9 A schematic diagram of an interface for voice transcription of audio provided in an embodiment of the present application, referring to Fig. 9 The first display style may be a background color different from the default display style of the audio track, and the second display style may be a font different from the default display style of the speech transcription content.

[0110] In some embodiments of the present application, when a track includes multiple marked track areas, the display styles of different track areas may be the same or different, that is, multiple marked track areas correspond to at least one display style, and at least one display style may be user-defined. For example, multiple marked track areas may all be displayed in the first display style, or track areas marked by different users may correspond to different display styles.

[0111] For example, Fig.10 A schematic diagram of displaying a track area containing multiple marks on a track provided by an embodiment of the present application. Fig.10 , Fig.10Area A on the middle track is the track area marked by user 1, areas B and C are the track areas marked by user 2, and area D is the track area marked by user 3. The display styles of the track areas marked by different users are different.

[0112] In some implementations of the present application, the electronic device may add an annotation area at a third position corresponding to the third operation in response to a third operation triggered by the user. The third operation may be triggered by the user through a set gesture, a control in the display interface, or a stylus. After detecting the third operation triggered by the user, the electronic device may display an annotation editing interface in the display interface, receive the annotation content entered by the user in the annotation editing interface, and display the annotation content in the annotation area. Optionally, the annotation content entered by the user in the annotation editing interface includes but is not limited to text, pictures, audio, and video.

[0113] Optionally, the electronic device may display the voice transcription interface and the annotation editing interface in split screen, or display a floating window on the voice transcription interface and display the annotation editing interface in the floating window.

[0114] For example, Fig.11 This is a schematic diagram of the first annotation editing interface provided in the embodiment of the present application. Fig.11 The left area of ​​the display screen of the electronic device displays the voice transcription interface, and the right area of ​​the display screen of the electronic device displays the annotation editing interface, and the user can enter the annotation content in the annotation editing interface.

[0115] For example, Fig.12 A schematic diagram of another annotation editing interface provided in an embodiment of the present application. Fig.12 When the electronic device displays the voice transcription interface, in response to the third operation triggered by the user, a floating window may be displayed on the voice transcription interface, and an annotation editing interface may be displayed in the floating window. The user may input annotation content in the annotation editing interface.

[0116] After receiving the annotation content input by the user, the electronic device may display the annotation at the third position corresponding to the third operation. Optionally, the electronic device may display the annotation after the user clicks the third position, and hide the annotation after the user clicks other positions in the display interface except the third position; or the electronic device may continue to display the annotation at the third position. For example, Fig.13 A schematic diagram of displaying annotations on a track provided in an embodiment of the present application. Fig.13 , the user is Fig.11 or Fig.12 After entering the text "meeting time" in the annotation editing area shown, the electronic device can display an annotation containing the text "meeting time" at the third position, thereby marking key content and making it easier for users to find audio content or voice transcription content.

[0117] In some embodiments, after detecting a third operation triggered by the user, the electronic device may display the audio track at a third position in a third display style, where the third display style is different from the first display style to distinguish between audio track areas to which the user has added annotations and audio track areas to which the user has not added annotations.

[0118] For example, Fig.14 A schematic diagram of a mark display style provided in an embodiment of the present application. Fig.14 The third display style of the track area indicates that the user has added annotations to the area, and the first display style of the track area indicates that the user has marked the area but has not added annotations to the area. Fig.14 It can be seen that the display styles of the audio track area and the speech transcription content corresponding to the audio track area are consistent, thereby indicating the corresponding relationship between the audio track area and the speech transcription content. Fig.14 In the example, when the user does not click on the track area where the annotation is added, the annotation is hidden. Fig.15 A schematic diagram of displaying annotations on a track provided by an embodiment of the present application. Fig.15 After the user clicks on the audio track area where the annotation is added, the electronic device can display the annotation added by the user above the audio track area.

[0119] In addition, in the audio track marking method provided in the embodiment of the present application, the user can edit the speech transcription content at any time. For example, Fig.16 A schematic diagram of an interface for editing speech transcription content provided in an embodiment of the present application. Fig.16 The electronic device may display a keyboard interface in the display interface, and the user may edit the speech transcription content through the keyboard interface, such as deleting, modifying or adding text. Of course, the user may also edit the speech transcription content through a stylus, and the embodiment of the present application does not limit the method of editing the speech transcription content.

[0120] In some embodiments of the present application, when the electronic device displays the voice transcription interface, it can also display the minutes editing interface in a split screen, and the user can edit the minutes in the minutes editing interface. Optionally, the minutes editing interface may include the target voice transcription content and / or the playback controls corresponding to the target voice transcription content. Among them, the target voice transcription content includes the voice transcription content corresponding to the marked audio track area and / or the voice transcription content corresponding to the annotated audio track area. When the playback controls corresponding to the voice transcription content are displayed in the minutes editing interface, after the user clicks the playback controls corresponding to the voice transcription content, the electronic device can play the audio clip corresponding to the voice transcription content.

[0121] For example, Fig.17 A display diagram of a minutes editing interface provided in an embodiment of the present application. Fig.17 , the left area of ​​the electronic device's display screen displays the voice transcription interface, and the right area of ​​the electronic device's display screen displays the minutes editing interface. After the user triggers the second operation of ending the mark or the third operation of adding an annotation in the voice writing interface, the electronic device can display the voice transcription content corresponding to the marked track area in the track and the voice transcription content corresponding to the annotated track area in the minutes editing interface. Fig.17 In the example, the user triggers the electronic device to add annotations to area A and area B, and marks area C. The electronic device then displays the voice transcription content corresponding to area A, "next meeting", the voice transcription content corresponding to area B, "the meeting will start at 2:30 pm on January 1", and the voice transcription content corresponding to area C, "the meeting location is 101", on the minutes editing interface. The user can edit the minutes on the minutes editing interface. Since the electronic device has displayed the voice transcription content corresponding to the audio track areas annotated or marked by the user on the minutes editing interface, the user can directly use these contents to edit the minutes, which facilitates user operation and improves user experience.

[0122] For example, Fig.18 A schematic diagram of another display interface of the minutes editing interface provided in the embodiment of the present application. Fig.18 , the electronic device displays the voice transcription content corresponding to area A on the track "next meeting", the voice transcription content corresponding to area B "the meeting will start at 2:30 pm on January 1st", and the voice transcription content corresponding to area C "the meeting location is 101" on the minutes editing interface, and the electronic device displays a play control after each voice transcription content. After the user clicks the play control after "the meeting will start at 2:30 pm on January 1st", the electronic device plays the audio clip corresponding to area B on the track. Through this design, the user can repeatedly listen to the audio content corresponding to the marked track area at any time, improving the user experience.

[0123] It should be noted that the drawings of the various display interfaces in the above embodiments are only examples and not limitations, and the display interface may also have other display forms. For example, when there is a lot of voice transcription content, the electronic device may display a sliding control, and the user may control the sliding control to move to view the voice transcription content that is not displayed in the current interface. Fig.19 A schematic diagram of displaying speech transcription content provided in an embodiment of the present application. Fig.19 When the speech transcription content is large and the electronic device cannot fully display all the content in one interface, the user can trigger a moving operation on the sliding control on the right side of the display interface. The electronic device adjusts the speech transcription content displayed in the current display interface according to the distance of the moving operation triggered by the user for the user to check.

[0124] For another example, the embodiment of the present application also provides two audio track display methods. Fig. 20 This is a schematic diagram of the first audio track display method provided in the embodiment of the present application. Fig. 20 , the electronic device can display a mobile control in the track display area, the mobile control on the left can control the track to move to the left, and the mobile control on the right can control the track to move to the right. The electronic device can display different areas of the track in response to the operation triggered by the user on the mobile control.

[0125] Fig.21 A schematic diagram of another audio track display method provided in an embodiment of the present application. Fig.21 , the electronic device can compress and display the audio track of the audio with a duration of 20:30 in the current interface, and the user can click the audio track to trigger the playback of the audio at the clicked position, or the user can drag the progress bar on the audio track to select the audio to be played.

[0126] Based on the above embodiments, the present application also provides a method for marking a track, which can be performed by an electronic device. The electronic device can have Figure 1 and / or Figure 2 The structure shown. Fig. 22 A flowchart of a method for marking a track provided in an embodiment of the present application. Fig. 22 , the method comprises the following steps:

[0127] S2201: When recording or playing audio, the audio track is displayed on the display.

[0128] S2202: In response to a first operation triggered by a user, display a first position corresponding to the first operation on the audio track in a first display style.

[0129] The first operation is used to indicate marking a first position of the audio track.

[0130] It should be noted that this application Fig. 22 The specific implementation of the audio track marking method shown can refer to the above embodiments of the present application, and the repeated parts will not be repeated.

[0131] Based on the above embodiments, the present application further provides an electronic device, the electronic device comprising multiple functional modules; the multiple functional modules interact with each other to implement the functions performed by the electronic device in each method described in the embodiments of the present application. The multiple functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the multiple functional modules can be arbitrarily combined or divided based on specific implementations.

[0132] Based on the above embodiments, the present application also provides an electronic device, which includes at least one processor and at least one memory, wherein the at least one memory stores computer program instructions, and when the electronic device is running, the at least one processor executes the functions performed by the electronic device in each method described in the embodiments of the present application.

[0133] Based on the above embodiments, the present application further provides a computer program product comprising instructions, and when the computer program product is run on a computer, the computer is enabled to execute the methods described in the embodiments of the present application.

[0134] Based on the above embodiments, the present application further provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a computer, the computer executes the methods described in the embodiments of the present application.

[0135] Based on the above embodiments, the present application further provides a chip, which is used to read a computer program stored in a memory to implement the methods described in the embodiments of the present application.

[0136] Based on the above embodiments, the present application provides a chip system, which includes a processor for supporting a computer device to implement the methods described in the embodiments of the present application. In one possible design, the chip system also includes a memory, which is used to store the necessary programs and data for the computer device. The chip system can be composed of a chip, or it can include a chip and other discrete devices.

[0137] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0138] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0139] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0140] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0141] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the scope of protection of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A method for marking a track, characterized in that: The method comprises: When recording or playing audio, the audio track is displayed on the display; In response to a first operation triggered by a user, displaying a first position on the audio track corresponding to the first operation in a first display style; wherein the first operation is used to indicate marking the first position of the audio track; Perform voice transcription on the audio and display the voice transcription content corresponding to the audio; Displaying the speech transcription content corresponding to the first position in the speech transcription content in a second display style, wherein the first display style is the same as the second display style; A speech transcription interface and a minutes editing interface are displayed on the display screen; wherein the speech transcription interface includes the audio track of the audio and the speech transcription content corresponding to the audio, the minutes editing interface includes a playback control corresponding to the target speech transcription content, the target speech transcription content includes the speech transcription content corresponding to the track area marked in the audio track, and the playback control corresponding to the target speech transcription content is used to play the audio segment corresponding to the target speech transcription content.

2. The method according to claim 1, characterized in that After, in response to the first operation triggered by the user, displaying the first position corresponding to the first operation on the audio track in the first display style, the method further includes: In response to a second operation triggered by the user, displaying a first area between the first position on the audio track and a second position corresponding to the second operation as the first display style; The second operation is used to indicate an end mark at the second position of the audio track, and the second position is after the first position.

3. The method according to claim 2, characterized in that The method further comprises: Perform voice transcription on the audio and display the voice transcription content corresponding to the audio; The speech transcription content corresponding to the first area in the speech transcription content is displayed in a second display style.

4. The method according to any one of claims 1 to 3, characterized in that: The first display style includes at least one of the following: a background color that is different from the default display style of the track in question; a track shape that is different from the default display style of said track; A different track color than the default display style for said track.

5. The method according to claim 1 or 3, characterized in that: The second display style includes at least one of the following: A font that is different from the default display style of the speech transcription content; A text color that is different from the default display style of the speech transcription content; A background color that is different from the default display style of the speech transcription content.

6. The method according to any one of claims 1 to 3, characterized in that: The method further comprises: In response to a third operation triggered by the user, adding an annotation area at a third position corresponding to the third operation; An annotation editing interface is displayed on the display screen, annotation content input by the user in the annotation editing interface is received, and the annotation content is displayed in the annotation area.

7. The method according to claim 6, characterized in that The method further comprises: The third position on the audio track is displayed in a third display style.

8. The method according to claim 6, characterized in that The step of displaying the annotation editing interface on the display screen includes: Displaying the speech transcription interface and the annotation editing interface on the display screen in split screens; or Displaying a floating window on the voice transcription interface displayed on the display screen, and displaying the annotation editing interface in the floating window; Among them, the speech transcription interface includes the audio track of the audio and the speech transcription content corresponding to the audio.

9. The method according to any one of claims 1 to 3, characterized in that: The minutes editing interface also includes the target voice transcription content, and the target voice transcription content also includes the voice transcription content corresponding to the annotated audio track area in the audio track.

10. The method according to any one of claims 1 to 3, characterized in that: The displaying of the voice transcription interface and the minutes editing interface on the display screen includes: The voice transcription interface and the minutes editing interface are displayed in split screen on the display screen.

11. The method according to any one of claims 1 to 3, 7 to 8, characterized in that: When the audio track includes multiple marked audio track areas, the multiple marked audio track areas correspond to at least one display style, and the at least one display style is user-defined.

12. The method according to any one of claims 3, 7-8, characterized in that: The method further comprises: In response to a moving operation triggered by the user on a sliding control in a display interface, the speech transcription content displayed in the display interface is adjusted according to a distance corresponding to the moving operation.

13. An electronic device, characterized in that: The system comprises at least one processor, wherein the at least one processor is coupled to at least one memory, and the at least one processor is configured to read a computer program stored in the at least one memory to execute the method according to any one of claims 1 to 12.

14. An electronic device, characterized in that: It comprises a plurality of functional modules; the plurality of functional modules interact with each other to implement the method as claimed in any one of claims 1 to 12.

15. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores instructions, which, when executed on a computer, enable the computer to execute the method according to any one of claims 1 to 12.

Images