Media data processing method, apparatus, device, medium, and program product

Abstract

This paper provides a media data processing method, apparatus, device, medium, and program product, relating to the field of data processing technology. The method includes: displaying a first interface of a first application on a client; receiving a first trigger through the first interface to display a first window on the client, the first window being created by the client's operating system for establishing a session with a first service, the first service being provided by a second application for generating text information; receiving a second trigger through the client, and, with the first window displayed on the client, activating the first service to obtain first text information, and displaying the first text information on the first interface. This method solves the technical problems of cumbersome operation, fragmented interaction flow, and low efficiency in media data processing in related technologies, achieving the technical effects of simplifying the operation process, ensuring smooth interaction, and improving media data processing efficiency.

Description

Technical Field

[0001] This invention relates to the field of data processing technology, and in particular to a media data processing method, apparatus, equipment, medium, and program product. Background Technology

[0002] With the development of multimedia data processing technology, smart terminals are widely equipped with various applications to realize functions such as media data display, information interaction, and content generation. In related application scenarios, multiple applications often need to be used for collaborative processing.

[0003] In related technologies, media data processing often requires frequent switching between the foreground states of multiple applications to invoke services provided by other applications and obtain corresponding data. This approach is cumbersome and fragmented, resulting in low efficiency in media data processing. Summary of the Invention

[0004] This invention provides a media data processing method, apparatus, device, medium, and program product that achieves the technical effect of simplifying the operation process, ensuring smooth interaction, and improving the efficiency of media data processing without frequently switching between multiple application foreground running states during the media data processing process.

[0005] In one scenario, this paper provides a media data processing method, which includes: The first interface of the first application is displayed on the client. The first trigger is received through the first interface, and the first window is displayed in the client. The first window is created by the client's operating system and is used to establish a session relationship with the first service. The first service is provided by the second application and is used to generate text information. Upon receiving a second trigger through the client, and with the first window displayed in the client, the first service is activated to obtain first text information and display the first text information on the first interface.

[0006] In one instance, this document also provides a media data processing apparatus, the apparatus comprising: The first module is used to display the first interface of the first application in the client. The second module is used to receive a first trigger through the first interface and display a first window in the client. The first window is created by the client's operating system and is used to establish a session relationship with the first service. The first service is provided by the second application and is used to generate text information. The third module is used to receive a second trigger through the client, and when the first window is displayed in the client, to enable the first service to obtain first text information and display the first text information on the first interface.

[0007] In one instance, this document also provides an electronic device comprising: One or more processors; Storage device for storing one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement the media data processing method as described herein.

[0008] In one instance, this document also provides a storage medium containing computer-executable instructions that, when executed by a computer processor, are used to perform media data processing methods as described herein.

[0009] In another scenario, this document also provides a computer program product, including a computer program that, when executed by a processor, implements the media data processing method as described herein.

[0010] The above method, when the first interface of the first application is displayed on the client, receives the first trigger through the first interface and displays the first window created by the operating system. This allows establishing a session with the first service provided by the second application without switching the application's foreground running state, avoiding the cumbersome operation of frequently switching application foreground running states in related technologies and ensuring the continuity of the interaction flow. By receiving the second trigger on the client, the first service is activated to obtain the first text information and display it on the first interface while retaining the first window. This allows service calls and data acquisition to be completed directly on the current interface without exiting or jumping to other applications, further simplifying the operation process and ensuring the integrity and smoothness of the media data processing. The above method solves the technical problems of frequent switching between multiple application foreground running states, cumbersome operation, fragmented interaction flow, and low media data processing efficiency in related technologies, achieving the technical effects of simplifying the operation process, ensuring interactive continuity, and improving media data processing efficiency. Attached Figure Description

[0011] The above and other features, advantages, and aspects of the embodiments described herein will become more apparent when taken in conjunction with the accompanying drawings and the following detailed description. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic, and the originals and elements are not necessarily drawn to scale.

[0012] Figure 1This is a schematic diagram of the structure of a first media data processing system under one scenario; Figure 2 This is a flowchart illustrating a media data processing method under one specific scenario. Figure 3 This is a flowchart illustrating a media data processing method under another scenario. Figure 4 This is a flowchart illustrating a media data processing method under another scenario. Figure 5 A sequence diagram of an optional flow of media data processing methods in one scenario; Figure 6 This is an example of an interface diagram for a media data processing method in one scenario. Figure 7 This is an example of an interface diagram for a media data processing method in one scenario. Figure 8 This is an example of an interface diagram for a media data processing method in one scenario. Figure 9 This is a schematic diagram of a media data processing device in one scenario. Figure 10 This is a schematic diagram of the structure of an electronic device used in one scenario. Detailed Implementation

[0013] The embodiments will now be described in more detail with reference to the accompanying drawings. While some embodiments are shown in the drawings, it should be understood that the technical solutions can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the technical solutions herein. It should be understood that the illustrated drawings and embodiments are for illustrative purposes only and are not intended to limit the scope of protection of the technical solutions.

[0014] It should be understood that the steps described in the method implementation may be performed in different orders and / or in parallel. Furthermore, the method implementation may include additional steps and / or omit the steps shown. The scope of this document is not limited in this respect.

[0015] The term "comprising" and its variations as used herein are open-ended inclusions, meaning "including but not limited to". The term "based on" means "at least partially based on". The term "one situation" means "at least one situation"; the term "another situation" means "at least one additional situation"; the term "some situations" means "at least some situations". Definitions of other terms will be given in the following description.

[0016] It should be noted that the concepts of "first" and "second" mentioned are only used to distinguish different devices, modules or units, and are not used to limit the order of the functions performed by these devices, modules or units or their interdependencies.

[0017] It should be noted that the terms "one" and "more" used in this document are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0018] The names of messages or information exchanged between multiple devices in this document are for illustrative purposes only and are not intended to limit the scope of these messages or information.

[0019] It is understood that before using the technical solutions disclosed in the various embodiments of this document, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in this document in an appropriate manner in accordance with relevant laws and regulations, and user authorization should be obtained.

[0020] For example, upon receiving a user's active request, a prompt message is sent to the user to explicitly inform them that the requested operation will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the software or hardware, such as electronic devices, applications, servers, or storage media, that perform the operations described herein, based on the prompt message.

[0021] As an optional but non-limiting implementation, in response to a user's active request, sending a prompt message to the user can be done via a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0022] It is understood that the above notification and user authorization process is merely illustrative and does not limit the implementation method described in this article. Other methods that comply with relevant laws and regulations may also be applied to the implementation method described in this article.

[0023] It is understood that the data involved in the technical solutions in this article (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and related provisions.

[0024] In some cases, the provided solution can be applied to Figure 1The media data processing system shown is illustrated. In practical applications, this media data processing system may include a client 101 and a server 102. The client 101 may include, but is not limited to, browsers, applications (Apps), HyperText Markup Language (HTML) applications, lightweight applications (also known as mini-programs), or cloud applications. The client 101 may be deployed on an electronic device and relies on the operation of that device or certain applications within the device to implement its functions. The electronic device may be, for example, a device with a display screen that supports information browsing, such as a smartphone, tablet, personal computer, or other client terminal. For ease of understanding, Figure 1 The client is primarily represented in the form of a device. Other types of applications can also be configured on the electronic device, such as media content publishing applications, session applications, etc. Server 102 can be one or more servers providing various services. That is, it can be implemented as a distributed server cluster composed of multiple servers, or as a single server; furthermore, it can be a server for a distributed system, a server integrating blockchain technology, a cloud server, or an intelligent cloud computing server or intelligent cloud host deployed with machine learning models, etc.

[0025] The media data processing method described herein allows interaction between client 101 and server 102, such as receiving or sending messages. For example, in this paper, a first interface of a first application is displayed on client 101; a first trigger is received through the first interface, and a first window is displayed on client 101. The first window is created by the operating system of client 101 and is used to establish a session relationship with a first service. The first service is provided by a second application and is used to generate text information; a second trigger is received through client 101. When the first window is displayed on client 101, server 102 can receive a request from client 101 to enable the first service to obtain the first text information and display the first text information on the first interface.

[0026] It should be noted that the media data processing method can be executed by client 101, or by client 101 and server 102, with different functional parts of the corresponding media data processing device deployed on client 101 and server 102 respectively; wherein, the front-end interaction module and local data acquisition module of the device are deployed on client 101, and the back-end data processing module and data storage module are deployed on server 102, and client 101 and server 102 achieve data interaction and functional collaboration through network communication. It should be understood that... Figure 1 The number of clients and servers shown is for illustrative purposes only. Any number of clients and servers can be configured to meet specific implementation requirements.

[0027] Figure 2 This is a flowchart illustrating a media data processing method for one scenario, applicable to media data processing applications. This method can be executed by a media data processing device, which can be implemented in software and / or hardware, optionally through an electronic device such as a mobile terminal, PC, or server. Figure 2 As shown, the media data processing method may specifically include: S210. Display the first interface of the first application in the client.

[0028] In this context, the client can be understood as a terminal device that carries and runs an operating system, which provides a runtime environment for applications. For example, the client may include one of the following: a mobile phone, a laptop, a tablet, a wearable electronic device, etc. The applications installed on the client may include at least a first application and a second application. It should be noted that the first application and the second application are different applications. Within the client, the first application and the second application run independently of each other, and their data and runtime environments are isolated from each other. Specifically, within the client, the first application and the second application are independent of each other, each having its own independent process space and data storage space, isolated from each other, and unable to directly access each other's data or run directly embedded within each other.

[0029] The first application can be understood as the application currently running in the foreground on the client side. Examples include chat applications, search applications, note-taking applications, and browsers. Foreground running can be understood as the state in which the client displays the application's interface on the screen. Therefore, when an application is in the foreground, its interface is displayed on the client's screen. For example, if the client displays the search interface of a search application, then this search application is running in the foreground. The second application can be understood as the application that provides text information generation services. While the first application is running in the foreground, the text information generation services provided by the second application can be provided to the first application; that is, the first application can call the text information generation services provided by the second application.

[0030] The first interface can be understood as the visual interactive interface presented on the client during the operation of the first application. For example, the first interface could be an interactive interface for receiving and editing information; or an interactive interface for information searching; or an interactive interface for messaging or data entry. In one scenario, the first interface could be the interface displayed when the first application finishes launching. In another scenario, the first interface could be the interface displayed after a screen switch following the completion of the first application's launch. It should be noted that the first interface can be displayed full-screen on the client's screen, or it can be displayed in a non-full-screen format on the client's screen; no specific limitation is made here.

[0031] There are several ways to display the first interface of the first application on the client side, and no specific limitation is made here.

[0032] In one scenario, displaying the first interface of a first application on a client may include: in response to a third trigger received by the client, running the first application on the client and displaying the first interface of the first application on the client; wherein the third trigger can be understood as a triggering operation or triggering event for running the first application on the client and displaying the first interface of the first application.

[0033] In another scenario, displaying the first interface of the first application on the client may include: running the first application on the client and displaying the first interface of the first application upon receiving voice information on the client; wherein the voice information can be understood as audio data used to run the first application on the client and display the first interface of the first application.

[0034] In another scenario, displaying the first interface of a first application on the client may include: in response to a fourth trigger received by the client, running the first application on the client and displaying a third interface of the first application on the client. In response to a fifth trigger concerning the third interface, switching the third interface of the first application displayed on the client to the first interface of the first application. The fourth trigger can be understood as a triggering operation or triggering event for running the first application on the client and displaying the third interface of the first application on the client. The fifth trigger can be understood as a triggering operation or triggering event for switching the third interface of the first application displayed on the client to the first interface of the first application.

[0035] S220. Receive a first trigger through the first interface and display a first window in the client. The first window is created by the client's operating system and is used to establish a session relationship with a first service. The first service is provided by a second application and is used to generate text information.

[0036] In this context, the first trigger can be understood as a triggering operation or event used to display the first window on the client. In one scenario, the first interface may include a second control, and the first trigger can be a control triggering operation targeting the second control; the second control can be understood as a control used to display the first window on the client. In another scenario, the first interface may include a first area and a second area; the first trigger can be an area triggering operation acting on the first area of ​​the first interface; the first area can be an interface area in the first interface capable of triggering the display of the first window on the client. The first area can be preset according to actual needs and is not specifically limited here. The second area can be an interface area in the first interface that cannot trigger the display of the first window on the client. In yet another scenario, the first trigger can be a triggering event generated by the client when preset execution conditions are met, used to display the first window.

[0037] The first window can be understood as a window created by the client's operating system to establish a session relationship with the first service. In this method, using the first window as a system-level session carrier allows the second application to maintain its own survival in a low-power manner by relying on the system keep-alive permission of the first window, rather than hardware occupancy. Optionally, the first window can be a floating window created by the operating system installed on the client. The display style of the first window on the client's interface (e.g., display position, display size, etc.) can be set according to actual needs and is not specifically limited here. For example, the first window can be located in the top, bottom, side, or middle area of ​​the client's interface to meet different visual display and operational needs. The display size of the first window can be a fixed size or can be adaptively adjusted according to the interface layout. In different usage scenarios, the display parameters of the first window can be flexibly changed, without being fixed to a single display form, thereby improving the overall flexibility and applicability of the interaction.

[0038] The first service can be understood as a service in the second application used to generate text information. Optionally, the first service may include an audio-to-text service, that is, a service used to convert speech into text information. In other words, the first service is used to obtain text information based on audio information input by the client, and the first window displays the activation status information of the first service, which is associated with the audio information input by the client.

[0039] The audio information can be understood as audio data obtained through the client. The activation status information can be understood as information used to characterize whether the first service is in an activated state at the current moment. In this method, the activation status can be an activated state or an inactivated state. It can be understood that an activated state can indicate that the first service is running. An inactivated state can indicate that the first service is not running. Displaying the activation status information of the first service in the first window allows for timely understanding of the activation status of the first service. The activation status information of the first service is associated with the audio information, and may include association between the activation status information of the first service and the input state and / or pitch of the audio information. In one case, the activation status information of the first service is associated with the input state of the first audio information. In another case, the activation status information of the first service is associated with the pitch of the first audio information. In yet another case, the activation status of the first service is associated with both the input state and the pitch of the first audio information.

[0040] In the method, the input state of audio information can include two states: one is a state where audio information is being input, meaning the client can receive continuous or intermittent audio signals; the other is a state where audio information is not input, meaning the client does not detect any audio signal input. For example, when the audio information is in the input state, the activation status information of the first service can be information indicating that the first service is in an enabled state, such as "Enabled" or "Activating". When the audio information is in the non-input state, the activation status information of the first service can be information indicating that the first service is in an disabled state, such as "Disabled" or "Pending Enabling".

[0041] The activation status information of the first service is associated with the pitch of the first audio information. Specifically, the activation status information is presented in the first window in the form of an audio waveform, and the amplitude of the audio waveform is associated with the acoustic characteristics of the audio information. Specifically, the amplitude of the audio waveform changes with changes in the loudness, frequency, and other acoustic characteristics of the sound in the audio information. When the loudness increases, the amplitude increases accordingly; when the frequency increases, the amplitude may also fluctuate. In this method, associating the activation status information of the first service with the pitch of the first audio information and presenting the amplitude as an audio waveform allows for a more intuitive and dynamic reflection of the service status changes with pitch in real time, thereby enhancing interactive fun and immersion.

[0042] In practical applications, the first application often includes multiple services with different functions. The first window establishes a separate session relationship with the first service provided by the first application, rather than with the first application as a whole. This creates a point-to-point message exchange channel between the first window and the first service to facilitate interaction. Through this channel, the first window can invoke the first service provided by the application to obtain initial text information.

[0043] In related technologies, since the first application is running in the foreground, if the first service provided by a second application running in the background or in an inactive (dormant) state is needed, the second application must be switched to the foreground, and the first application in the foreground must be switched to the background. This involves frequent switching of the running interface, which is cumbersome and interrupts the use of the current application, affecting the continuity of use. In addition, when the second application is running in the background or in a dormant (inactive) state, it is easily identified as an idle process by the operating system and its resources are reclaimed, causing the process to be dormant or terminated, unable to provide continuous service, resulting in poor stability and difficulty in meeting the needs of multi-application collaborative use.

[0044] While the first application is running in the foreground, a first window created by the client's operating system can be displayed on the client. This first window keeps at least some services in the second application (including the first service) active, preventing the second application, which is running in the background or is inactive, from being cleaned up by the operating system. By creating a window at the operating system level, the process priority of the second application can be increased, making the system recognize it as a process that needs to run continuously, rather than a normal background idle process. This prevents the second application from being hibernated or terminated due to system resource reclamation mechanisms, ensuring the stable operation of the services provided by the second application. Displaying the first window on the client allows the services provided by the second application to be directly called and used while the first application is running in the foreground. This eliminates the need to switch to the independent running interface of the second application or to exit or interrupt the use of the current first application, enabling service linkage between different applications within the same interface. This simplifies application switching operations and improves the convenience of using multiple applications on the client.

[0045] It should be noted that background running state can refer to an application where no process is displayed on the screen. In this method, applications running in the background do not display their interface on the screen. When an application is running in the background, the application cannot continue to provide services.

[0046] Optionally, the first window displays first information. The first information can be understood as information that needs to be displayed in the first window. The presentation format of the first information may include one of the following: text format, image format, etc. That is, the first information may include one of the following: text information, image information, etc. The first information may include at least one of the identification information of the second application and the activation status information of the first service. It is understood that the application identification information can be used to distinguish different applications. Optionally, the identification information of the second application may include the icon and / or application name of the second application. The activation status information of the first service can be used to obtain information on whether the first service is in an enabled state. The activation status information may be information that the first service is in an enabled state, or it may be information that the first service is in an disabled state.

[0047] When the first service is enabled, the first window containing the first information in the client is displayed at a first position. When the first service is disabled, the first window containing the first information in the client is displayed at a second position. The first and second display positions may be the same or different. For example, as shown... Figure 3 As shown, the first window 31 is displayed above the input method keyboard; as Figure 4 As shown, the first window can be displayed at the bottom of the client screen.

[0048] This method, by displaying first information in a first window, not only intuitively shows the identifier of the second application providing the service, facilitating quick identification of the currently running application, but also displays the real-time activation status of the first service, allowing for timely understanding of its operational status. Without affecting the normal use of the first application, the activation status of both the second application and the first service can be visualized, thereby improving the ease of operation during multi-application collaborative use and ensuring that the operational status of the first service is perceptible and identifiable.

[0049] Specifically, in response to the first interface receiving a first trigger, a visual window, i.e., a first window, can be created through the client's operating system. Then, in response to the completion event of the first window's creation, the first window can be displayed on the client. Optionally, displaying the first window on the client may include: obtaining the interface layout information of the first window on the client; thereby, the first window can be displayed on the client according to the interface layout information. There are several ways to display the first window on the client, and no specific limitation is made here. In one scenario, displaying the first window on the client may include: floating the first window above all interface layers on the client; in another scenario, displaying the first window on the first interface, with the first window's layer being higher than the first interface's layer. In yet another scenario, the client's interface includes a third area and a fourth area, wherein the third area is used to display the first interface, and the first window is displayed in the fourth area.

[0050] S230. Receive a second trigger through the client. If the first window is displayed in the client, enable the first service to obtain first text information and display the first text information on the first interface.

[0051] The second trigger can be understood as a trigger instruction used to enable the first service when the first window is displayed in the client. In one scenario, the second trigger can be a trigger operation. For example, the second trigger can be a trigger operation acting on a fifth area within the first window; or, if the first window includes a third control, the second trigger can be a trigger operation acting on the third control. In another scenario, the second trigger can be a trigger event. For example, the second trigger can be a trigger event when the first window meets preset display conditions; or, when the first window completes loading, the second trigger can be a trigger event indicating that the first window has completed loading. The first text information can be understood as text information obtained by enabling the first service. In one scenario, the first service can be used to collect image data and obtain text information based on the collected image data. In another scenario, the first service can be used to collect audio data and obtain text information based on the collected audio data.

[0052] Specifically, when the client displays a first window, the client receives a second trigger, and based on the second trigger, activates the first service of the second application, that is, loads the first service into memory and runs it to obtain the first text information. In response to the event of obtaining the first text information, the first text information can be displayed on the first interface. Specifically, displaying the first text information on the first interface can involve obtaining the font display style of the first text information; then, the first text information can be displayed on the first interface according to the font display style. Optionally, the font display style can include one of the following: font size, font color, font format, character spacing, and line spacing.

[0053] In this method, there are several ways to display the first text information on the first interface. In one case, the first interface includes a sixth region; displaying the first text information on the first interface can further mean displaying the first text information in the sixth region. The sixth region can be a pre-defined region in the first interface for displaying the first text information. In one case, the sixth region can be the entire region of the first interface. In another case, the sixth region can be a partial region of the first interface.

[0054] In one scenario, the second application is associated with an input method. When the second application is associated with an input method, displaying the first window in the client may include: displaying the second interface of the input method and the first window in the client, the second interface including multiple first controls for editing text information. Receiving the second trigger through the client may include: receiving a second trigger targeting the first controls through the client. In this method, by displaying the second interface and the first window of the input method in the client, the second application's first service can be directly enabled through the first window while the first application is running in the foreground, making the operation simple and convenient.

[0055] The second interface can be understood as the interactive interface provided by the second application to implement the input method function. The first controls can be understood as controls used for editing text information in the second interface. When the second interface includes multiple first controls, the presentation of these multiple second controls can be set according to actual needs, and is not specifically limited here. The display methods of the multiple first controls and the input method keyboard in the second interface can be set according to actual needs, and are not specifically limited here.

[0056] The second interface may include an input method keyboard and multiple first controls. In one scenario, the input method keyboard may include multiple first controls. In other words, the input method keyboard in the second interface has multiple built-in first controls. Specifically, the first controls can be displayed in response to a display event of the input method keyboard; wherein the input method keyboard includes multiple first controls. In another scenario, the area of ​​the input method keyboard and the area of ​​the first controls in the second interface are two independent areas. The display relationship between these two areas can be set according to actual needs, such as vertical or horizontal position relationships.

[0057] Specifically, when a first interface of a first application is displayed on the client, in response to a first trigger received by the first interface, a second interface and a first window of the input method can be displayed on the client. The second interface includes multiple first controls. In response to a third trigger targeting the second controls, when the first window is displayed on the client, the first service is activated to obtain first text information, and the first text information is displayed on the first interface.

[0058] For example, in an information search scenario, see [link to relevant documentation]. Figure 5 The client displays a first interface 51 of a first application, which includes a search control. In response to a control triggering operation on this search control, the client's display interface can be switched from the first interface to a second interface 52 of the input method. Then, a first window 53 created by the operating system is displayed on the second interface. The second interface includes an area 54 for the input method keyboard.

[0059] There are several ways to display the second interface and the first window of the input method on the client. In one scenario, the second interface and the first window of the input method can be displayed simultaneously on the same interface of the client. In another scenario, the second interface of the input method can be displayed on the client first, and then the first window can be displayed on top of the second interface.

[0060] Optionally, displaying the first text information on the first interface may include: in response to an event that the first text information is obtained, the first text information may be transmitted to the input method keyboard based on an inter-process communication mechanism so that the first text information can be displayed on the first interface through the input method keyboard.

[0061] In one scenario, the second application also provides a second service. This second service can be used to process the text information generated by the first service. Optionally, the second service can generate a text model for the text. The first window is also used to establish a session relationship with the second service. In this scenario, enabling the first service to obtain the first text information may include: enabling the first service to obtain the second text information; and starting the second service to process the second text information into the first text information.

[0062] The second text information can be understood as text information obtained based on the first service. Optionally, the second text information can be text information obtained by collecting and processing media data through the first service. The first text information can be text information obtained by processing the first text information obtained by the first service through the second service. Optionally, the first text information can be text information obtained by continuing the second text information based on its content. Alternatively, it can be text information generated based on the summary content obtained by extracting a summary from the second text information. Alternatively, it can be text information obtained by translating the second text information from a first language to a second language. Alternatively, it can be text information obtained as a response obtained by semantic understanding and generating a response based on the question content of the second text information. Alternatively, it can be corrected or supplemented text information obtained by correcting errors or supplementing missing content in the second text information.

[0063] In this method, the first service is enabled to obtain the second text information; there are multiple ways to start the second service to process the second text information into the first text information.

[0064] In one scenario, activating the first service to obtain second text information and then activating the second service to process the second text information into first text information may include: establishing a session relationship between the first service and a first window; and establishing a session relationship between the second service and the first window. In response to events indicating the completion of the session relationship between the first window and the first service, and the completion of the session relationship between the first window and the second service, the first service and the second service can be activated. Thus, the first text data can be obtained through the first service and sent to the second service. Furthermore, the first text data can be processed through the second service to obtain the processed text data, i.e., the second text data.

[0065] In another scenario, activating the first service to obtain second text information, and then activating the second service to process the second text information into first text information, may include: first establishing a session relationship between the first service and the first window. In response to an event indicating that the session relationship between the first service and the first window is established, the first service can process the collected media data into second text information, and send the second text information to the second service. During the process of the first service processing the media data, a session relationship between the second service and the first window can be established. In response to an event indicating that the session relationship between the second service and the first window is established, the second service can process the second text information into first text information.

[0066] In one scenario, the media data processing method may further include: receiving a third trigger for the first application, terminating the session with the first service, and releasing system resources in the operating system corresponding to the session. Releasing system resources in the operating system corresponding to the session avoids client-side lag, memory leaks, or resource waste caused by prolonged occupation of session resources. The third trigger can be understood as a trigger instruction to terminate the session with the first service. In one scenario, the third trigger may be a trigger operation to terminate the operation of the first application (e.g., a swipe operation, a click operation, etc.). In another scenario, the third trigger may be a trigger event that the first application meets the conditions for termination. System resources can be understood as resources occupied by the first service running in the client's operating system.

[0067] The above method, when the first interface of the first application is displayed on the client, receives the first trigger through the first interface and displays the first window created by the operating system. This allows establishing a session with the first service provided by the second application without switching the application's foreground running state, avoiding the cumbersome operation of frequently switching application foreground running states in related technologies and ensuring the continuity of the interaction flow. By receiving the second trigger on the client, the first service is activated to obtain the first text information and display it on the first interface while retaining the first window. This allows service calls and data acquisition to be completed directly on the current interface without exiting or jumping to other applications, further simplifying the operation process and ensuring the integrity and smoothness of the media data processing. The above method solves the technical problems of frequent switching between multiple application foreground running states, cumbersome operation, fragmented interaction flow, and low media data processing efficiency in related technologies, achieving the technical effects of simplifying the operation process, ensuring interactive continuity, and improving media data processing efficiency.

[0068] Figure 6This is a flowchart illustrating a media data processing method under one scenario. The technical solution in this scenario can be combined with implementation methods in other scenarios. For identical or related parts, descriptions of other scenarios can be used, and will not be repeated here. Figure 6 As shown, the method in this case may specifically include: S310. Display the first interface of the first application in the client.

[0069] S320. Receive a first trigger through the first interface and display a first window in the client. The first window is created by the client's operating system and is used to establish a session relationship with a first service. The first service is provided by a second application and includes an audio-to-text service.

[0070] The first service can be understood as a service for generating text information based on audio information. In short, the first service can be an audio-to-text service. The audio information can be obtained by collecting it through the audio-to-text service. It should be noted that the data storage format of the audio information is set according to actual needs and is not specifically limited here. Optionally, generating text information from the audio information can involve converting the speech content in the first information into corresponding text. Alternatively, it can involve content analysis of the audio information to generate a text summary. Or, it can involve identifying and generating descriptive tags from the audio information; etc.

[0071] S330. Receive a second trigger through the client. If the first window is displayed in the client, enable the audio-to-text service, collect audio information, and convert the collected audio information into first text information.

[0072] The audio-to-text service is used to collect audio information and convert the collected audio information into first text information. The audio-to-text service can have one or more functions. For example, the audio-to-text service includes one function that collects audio information and converts it into first text information. Alternatively, the audio-to-text service includes two functions: a first function and a second function. The first function collects audio information and passes it as an actual parameter to the formal parameter of the second function, which then converts the audio information passed by the first function into text information.

[0073] Specifically, upon receiving a second trigger from the client, and with a second window displayed on the client, the first service can be loaded into memory. In response to the completion of the first service loading event, audio information can be collected via an audio-to-text service, and the audio information can be processed to obtain text information, i.e., the first text information.

[0074] In this method, there are multiple ways to perform information content recognition processing on the audio information. In one scenario, performing information content recognition processing on the audio information may include: performing information content recognition processing on the audio information in response to an event indicating that the audio information acquisition is complete. In another scenario, during audio information acquisition, information content recognition processing is performed on the acquired audio information in real time.

[0075] S340. Display the first text information on the first interface.

[0076] The above method achieves the technical effects of simplifying the process of converting audio information into text information, ensuring smooth interaction, and improving the efficiency of audio information processing.

[0077] Figure 7 This is a flowchart illustrating a media data processing method under one scenario. The technical solution in this scenario can be combined with implementation methods in other scenarios. For identical or related parts, descriptions of other scenarios can be used, and will not be repeated here. Figure 7 As shown, the method in this case may specifically include: S410. Display the first interface of the first application in the client.

[0078] S420. Receive a first trigger through the first interface, render the first information in the first window, and display the first window in the client; the first window is created by the client's operating system and is used to establish a session relationship with the first service, which is provided by the second application and is used to generate text information.

[0079] Specifically, the first interface receives a first trigger, creates a first window, and obtains first information to be displayed in the first window. The first information can then be rendered in the first window. Thus, the rendered first window can be displayed on the client. In this embodiment, displaying the first window on the client includes: creating a first window associated with the second application based on the client's operating system; obtaining the first information to be displayed in the first window; the first window being created by the client's operating system and including a second control; setting the display state of the second control in the first window to invisible; and rendering the first information in the first window to obtain the first window.

[0080] The second control can be understood as a control pre-packaged in the first window by the operating system. Optionally, the first control can be a control used to play media data. The second control is visible in the first window. The display position of the first information can be set according to actual needs and is not specifically limited here. Optionally, the display position of the first information can be the display position of the second control in the first window. In this method, setting the display position of the first information to the display position of the second control in the first window maintains the consistency and neatness of the first window layout and reduces the overhead of window re-layout and rendering.

[0081] Specifically, in response to a first trigger on the first interface, a floating window including the second control in a visible state can be created based on the client's operating system, and floating display permissions can be configured for this floating window. This allows the establishment of an association between the floating window and the second application, thereby obtaining a first window associated with the second application. It should be noted that configuring floating display permissions for this floating window enables it to float above the client's upper-level interface. Optionally, creating the first window may include: calling the floating window creation interface provided by the operating system to create the floating window, i.e., the first window. Before creating the first window, it may further include: setting the window properties of the first window. The window properties may include one of the following: window size, window position, window transparency, and window display layer.

[0082] In this embodiment of the disclosure, the display state of the second control in the first window is set to an invisible state, and the first information is rendered in the first window to obtain a first window. Specifically, this may include: setting the display state of the second control in the first window to an invisible state, so that the second control in the first window is in a hidden state. Then, the first information can be rendered in the first window to obtain a first window displaying the first information.

[0083] In this embodiment of the disclosure, rendering the first information in the first window may include: adding the first information to a view container corresponding to the first window, the view container being used to carry the view content of the first window; drawing a first image of the first information in a graphics context; writing the pixel data of the first image into a first buffer; and rendering the first image in the first window based on the pixel data in the first buffer.

[0084] In this context, the view container can be understood as a pre-created container used to hold the view content of the first window. The first image can be understood as a visual image formed by drawing the first information graphically. In other words, the first image is the visual presentation of the first information on the client screen. In practical applications, the size of the view container is usually consistent with the size of the first window. This setting ensures that all content held within the view container can be fully and without pruning adapted to the window display area. The pixel data of the first image can be understood as the color value of each pixel in the first image. The graphics context can be used to store the drawn image output information, such as saving drawing information and drawing state. The first buffer can be understood as a buffer used to store the pixel data of the first image. Optionally, the first buffer can be a pixel buffer. Drawing the first image in the graphics context first, and then writing the completed image in the graphics context to the first buffer, ensures that the drawn image data can be temporarily stored completely and orderly, avoiding incomplete image rendering when directly rendering to the window, thereby improving the stability and smoothness of the first window rendering.

[0085] Specifically, a view container is pre-created to hold the view content of the first window. First information can then be added to the view container. The first information can then be drawn as an image in the graphics context using a drawing function. In response to an event indicating that the first image has been drawn in the graphics context, the pixel data of the first image drawn in the image context can be copied to a first buffer. The first image can then be rendered in the first window based on the pixel data in the first buffer.

[0086] Optionally, drawing the first image in the first window based on the pixel data in the first buffer may include: packaging the pixel data of the first image in the first buffer, the description information of the first image (e.g., encoding information, image size), and the time information of the first image (e.g., timestamp, duration) to obtain packaged data. The packaged data can then be written to a second buffer. Based on the packaged data in the second buffer, the first image is then rendered in the first window. The second buffer can be understood as a buffer used to store the pixel data, description information, and time information of the first image. Optionally, the second buffer may be a sample buffer.

[0087] S430. Receive a second trigger through the client. If the first window is displayed in the client, enable the first service to obtain first text information and display the first text information on the first interface.

[0088] The above method can establish a connection channel with the second application at the operating system level, completing the association and binding with the target application without switching the foreground application, thus avoiding the cumbersome operation and process fragmentation caused by switching foreground applications. Furthermore, rendering the first information while setting the display state of the original controls in the first window to invisible ensures that the first window can normally carry out information rendering and implement corresponding functions, while reducing the interference of irrelevant controls on the user's vision and operation, maintaining a simple and unified interface.

[0089] An alternative embodiment of a media data processing method is provided herein. A client runs a first application, and the client displays a first interface of the first application. The first interface includes a voice input button. When the client displays the first interface, as... Figure 8 As shown, the specific steps of the media data processing method are as follows: In response to a trigger operation on the voice input control in the first interface, a startup command for launching a first service of the second application is generated. This startup command is then sent to the first application.

[0090] Upon receiving the launch command, the first application can create a first window based on the client operating system to establish a session relationship between the first services. The first application then sends the launch command to the second application. Upon receiving the launch command, the second application can start its first service, namely the speech recognition service.

[0091] In response to the completion event of the first window creation, the first interface of the first application can be hidden in the client, and a second interface including the input method and the first window can be displayed in the client.

[0092] In response to the first trigger operation of the first window, the application status information of the speech recognition service is set to enabled, and the first information of "enabled status" is displayed in the first window. Then, in response to the start event of the speech recognition service, audio data is collected based on the speech recognition service to obtain text information, and the text information is displayed on the target input box of the second interface.

[0093] The target input box can be understood as the input box in the second interface used to display text information.

[0094] In response to the second trigger operation in the first window, the speech recognition service can be terminated, and its application status information can be set to disabled. The first window will display the initial message "Disabled". In response to the termination event of the speech recognition service, the resources occupied by the speech recognition service can be released.

[0095] The above method solves the technical problems in related technologies, such as the need to frequently switch between multiple application foreground running states, cumbersome operation, fragmented interaction flow, and low media data processing efficiency in the media data processing process. It achieves the technical effects of simplifying the operation process, ensuring smooth interaction, and improving the efficiency of media data processing.

[0096] Figure 9 This is a schematic diagram of the structure of a media data processing device in one scenario, such as... Figure 9 As shown, the media data processing device includes: a first module 510, a second module 520, and a third module 530. The first module 510 is used to display a first interface of the first application on the client; the second module 520 is used to receive a first trigger through the first interface and display a first window on the client, the first window being created by the client's operating system and used to establish a session relationship with a first service, the first service being provided by a second application and used to generate text information; the third module 530 is used to receive a second trigger through the client, and when the first window is displayed on the client, to enable the first service to obtain first text information and display the first text information on the first interface.

[0097] The aforementioned device, when displaying the first interface of the first application on the client, receives a first trigger through the first interface and displays a first window created by the operating system. This allows for the establishment of a session with the first service provided by the second application without switching the application's foreground running state, avoiding the cumbersome operation of frequently switching application foreground running states in related technologies and ensuring the continuity of the interaction flow. By receiving a second trigger on the client, the first service is activated to obtain first text information and display it on the first interface while retaining the first window. This allows for direct service calls and data acquisition on the current interface without exiting or jumping to other applications, further simplifying the operation process and ensuring the integrity and smoothness of the media data processing. The above method solves the technical problems of frequent switching between multiple application foreground running states, cumbersome operation, fragmented interaction flow, and low media data processing efficiency in related technologies, achieving the technical effects of simplifying the operation process, ensuring interactive continuity, and improving media data processing efficiency.

[0098] Optionally, in one scenario, the second module 520 is configured to display the second interface and the first window of the input method in the client, wherein the second interface includes a plurality of first controls for editing text information; and the third module 530 is configured to receive a second trigger for the first controls through the client.

[0099] Optionally, in one scenario, the first service includes an audio-to-text service; the third module 530 is configured to enable the first service, collect audio information, and convert the collected audio information into first text information.

[0100] Optionally, in one scenario, the second application also provides a second service for processing the text information generated by the first service; the first window is also used to establish a session relationship with the second service; a third module 530 is used to enable the first service to obtain the second text information; and to start the second service to process the second text information into first text information.

[0101] Optionally, in one scenario, the first window displays first information, which includes at least one of the identification information of the second application and the activation status information of the first service.

[0102] Optionally, in one scenario, the media data processing apparatus further includes a fourth module. This fourth module is used to render the first information in the first window.

[0103] Optionally, in one scenario, the second module 520 is configured to create a first window associated with the second application based on the operating system of the client, the first window including a second control; set the display state of the second control in the first window to an invisible state, and render the first information in the first window to obtain the first window.

[0104] Optionally, in one scenario, the second module 520 is configured to add the first information to a view container corresponding to the first window, the view container being used to carry the view content of the first window; draw a first image of the first information in a graphics context; write the pixel data of the first image to a first buffer; and render the first image in the first window based on the pixel data in the first buffer.

[0105] Optionally, in one scenario, the media data processing further includes a fifth module. This fifth module is configured to receive a third trigger for the first application, terminate the session with the first service, and release system resources in the operating system corresponding to the session.

[0106] Optionally, in one scenario, the first service includes an audio-to-text service, and the first window displays the activation status information of the first service, which is associated with the audio information input by the client.

[0107] Optionally, in one scenario, the enable status information is presented in the first window in the form of an audio waveform, the amplitude of which is associated with the acoustic characteristics of the audio information.

[0108] The aforementioned media data processing apparatus can execute the media data processing method provided in any of the embodiments described herein, and has the corresponding functional modules and beneficial effects for executing the media data processing method.

[0109] It is worth noting that the various units and modules included in the above-mentioned media data processing device are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; in addition, the specific names of each functional unit are only for easy differentiation and are not used to limit the protection scope of the embodiments described herein.

[0110] The following is for reference. Figure 10 The diagram illustrates a structural schematic of an electronic device (e.g., a terminal device or server) 600 suitable for implementing the above-described methods. The terminal device described herein may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital radio receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. Figure 10 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments described herein.

[0111] like Figure 10 As shown, electronic device 600 may include a processing device (e.g., a central processing unit, a graphics processor, etc.) 601, which can perform various appropriate actions and processes according to a program stored in read-only memory (ROM) 602 or a program loaded from storage device 608 into random access memory (RAM) 603. RAM 603 also stores various programs and data required for the operation of electronic device 600. Processing device 601, ROM 602, and RAM 603 are interconnected via bus 604. Input / output (I / O) interface 605 is also connected to bus 604.

[0112] Typically, the following devices can be connected to I / O interface 605: input devices 606 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 607 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 608 including, for example, magnetic tapes, hard disks, etc.; and communication devices 609. Communication device 609 allows electronic device 600 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 10An electronic device 600 with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.

[0113] In particular, according to embodiments of this document, the processes described in the above-referenced flowcharts can be implemented as computer software programs. For example, the technical solutions of this document include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device 609, or installed from a storage device 608, or installed from a ROM 602. When the computer program is executed by a processing device 601, it performs the functions defined in the methods of the embodiments of this document.

[0114] The names of messages or information exchanged between multiple devices in this document are for illustrative purposes only and are not intended to limit the scope of these messages or information.

[0115] The electronic device provided in this embodiment and the media data processing method provided in the above technical solutions belong to the same inventive concept. Technical details not described in detail in this document can be found in the above embodiments, and this embodiment has the same beneficial effects as the above embodiments.

[0116] This article provides a computer storage medium on which a computer program is stored, which, when executed by a processor, implements the media data processing method provided in the above embodiments.

[0117] It should be noted that the computer-readable medium described above can be a computer-readable signal medium, a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this document, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this document, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0118] According to one or more scenarios described herein, Example 1 provides a media data processing method, comprising: displaying a first interface of a first application on a client; receiving a first trigger through the first interface to display a first window on the client, the first window being created by the client's operating system for establishing a session relationship with a first service, the first service being provided by a second application for generating text information; receiving a second trigger through the client, and, when the first window is displayed on the client, enabling the first service to obtain first text information, and displaying the first text information on the first interface.

[0119] According to one or more scenarios described herein, Example 2 provides the method of Example 1, further comprising: optionally, the second application being associated with an input method; displaying the first window in the client comprising: displaying the second interface of the input method and the first window in the client, the second interface including a plurality of first controls, the first controls being used for editing text information; receiving the second trigger through the client comprising: receiving the second trigger for the first control through the client.

[0120] According to one or more scenarios in this article, Example 3 provides the method of Example 2, which further includes: Optionally, the first service is used to generate text information based on audio information; the step of enabling the first service to obtain the first text information includes: enabling the first service, collecting audio information, and converting the collected audio information into the first text information.

[0121] According to one or more scenarios in this document, Example 4 provides the method of Example 2, which further includes: Optionally, the second application also provides a second service, the second service being used to process the text information generated by the first service; the first window is also used to establish a session relationship with the second service; the step of displaying the first text information on the first interface includes: enabling the first service to obtain the second text information; starting the second service to process the second text information into the first text information.

[0122] According to one or more scenarios described herein, Example 5 provides the method of Example 1, which further includes: Optionally, the first window displays first information, the first information including at least one of the identification information of the second application and the activation status information of the first service.

[0123] According to one or more scenarios described herein, Example Six provides the method of Example One, which further includes: rendering the first information in the first window.

[0124] According to one or more scenarios in this document, Example 7 provides the method of Example 1, which further includes: Optionally, displaying the first window in the client includes: creating a first window associated with the second application based on the operating system of the client, the first window including a second control; setting the display state of the second control in the first window to an invisible state, and rendering the first information in the first window to obtain the first window.

[0125] According to one or more scenarios in this document, Example 8 provides the method of Example 1, which further includes: Optionally, rendering the first information in the first window includes: adding the first information to a view container corresponding to the first window, the view container being used to carry the view content of the first window; drawing a first image of the first information in a graphics context; writing the pixel data of the first image to a first buffer; and rendering the first image in the first window based on the pixel data in the first buffer.

[0126] Based on one or more scenarios described in this article, Example 9 provides the method of Example 1, and also includes: Optionally, Upon receiving a third trigger for the first application, terminate the session relationship with the first service and release the system resources in the operating system corresponding to the session relationship.

[0127] According to one or more scenarios in this document, Example 10 provides the method of Example 1, which further includes: Optionally, the first service includes an audio-to-text service, and the first window displays the activation status information of the first service, the activation status information being associated with the audio information input by the client.

[0128] According to one or more scenarios in this article, Example 11 provides the method of Example 1, which further includes: optionally, the enable status information is presented in the first window in the form of an audio waveform, the amplitude of the audio waveform being associated with the acoustic characteristics of the audio information.

[0129] According to one or more scenarios described herein, Example Twelve provides a media data processing apparatus, comprising: a first module for displaying a first interface of a first application on a client; a second module for receiving a first trigger through the first interface to display a first window on the client, the first window being created by the client's operating system for establishing a session relationship with a first service, the first service being provided by a second application for generating text information; and a third module for receiving a second trigger through the client, enabling the first service to obtain first text information when the first window is displayed on the client, and displaying the first text information on the first interface.

[0130] In some implementations, clients and servers can communicate using any currently known or future-developed network protocol such as HTTP (Hypertext Transfer Protocol) and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet of Things), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any currently known or future-developed networks.

[0131] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0132] The aforementioned computer-readable medium carries one or more programs, which, when executed by the electronic device, cause the electronic device to: display a first interface of the first application in a client; receive a first trigger through the first interface to display a first window in the client, the first window being created by the client's operating system for establishing a session relationship with a first service, the first service being provided by a second application for generating text information; and receive a second trigger through the client, and, if the first window is displayed in the client, enable the first service to obtain first text information and display the first text information on the first interface.

[0133] Computer program code for performing the operations described herein can be written in one or more programming languages ​​or a combination thereof, including but not limited to object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as the "C" programming language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0134] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this document. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0135] The modules or units described herein may be implemented in software or hardware. The names of modules or units do not necessarily limit the module or unit itself; for example, a first module may also be described as "a module that displays the first interface of the first application in a client."

[0136] The functions described above in this document can be performed at least in part by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), system-on-a-chip (SoCs), complex programmable logic devices (CPLDs), and so on.

[0137] In the context of this document, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0138] The above description is merely a preferred embodiment and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of disclosure herein is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features disclosed herein that have similar functions.

[0139] Furthermore, while the operations are described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. In certain circumstances, multitasking and parallel processing may be advantageous. Similarly, while several specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of this document. Certain features described in the context of individual implementations may also be implemented in combination in a single implementation. Conversely, various features described in the context of a single implementation may also be implemented individually or in any suitable sub-combination in multiple implementations.

[0140] Although the subject matter has been described using a programming language specific to structural features and / or methodological logic, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are merely illustrative forms of implementing the claims.

Claims

1. A media data processing method, comprising: Display the first interface of the first application in the client; The first trigger is received through the first interface, and the first window is displayed in the client. The first window is created by the client's operating system and is used to establish a session relationship with the first service. The first service is provided by the second application and is used to generate text information. Upon receiving a second trigger through the client, and with the first window displayed in the client, the first service is activated to obtain first text information and display the first text information on the first interface.

2. The media data processing method according to claim 1, wherein the second application is associated with an input method; The step of displaying the first window in the client includes: The second interface and the first window of the input method are displayed on the client. The second interface includes a plurality of first controls, which are used to edit text information. The receipt of the second trigger through the client includes: The client receives a second trigger for the first control.

3. The media data processing method according to claim 1, wherein the first service includes an audio-to-text service; and activating the first service to obtain first text information includes: The audio-to-text service is activated to collect audio information and convert the collected audio information into first text information.

4. The media data processing method according to claim 1, wherein the second application further provides a second service, the second service being used to process the text information generated by the first service; The first window is also used to establish a session relationship with the second service; Enabling the first service to obtain the first text information includes: Activate the first service to obtain the second text information; Start the second service to process the second text information into the first text information.

5. The media data processing method according to claim 1, wherein the first window displays first information, the first information including at least one of the identification information of the second application and the activation status information of the first service.

6. The media data processing method according to claim 5 further includes: The first information is rendered in the first window.

7. The media data processing method according to claim 6, wherein rendering the first information in the first window comprises: Based on the operating system of the client, a first window associated with the second application is created, the first window including a second control; Set the display state of the second control in the first window to invisible, and render the first information in the first window.

8. The media data processing method according to claim 6, wherein rendering the first information in the first window comprises: The first information is added to the view container corresponding to the first window, and the view container is used to hold the view content of the first window; Draw a first image of the first information in a graphics context, write the pixel data of the first image into a first buffer, and render the first image in the first window based on the pixel data in the first buffer.

9. The media data processing method according to claim 1, further comprising: Upon receiving a third trigger for the first application, terminate the session relationship with the first service and release the system resources in the operating system corresponding to the session relationship.

10. The media data processing method according to claim 1, wherein the first service includes an audio-to-text service, the first window displays the activation status information of the first service, and the activation status information is associated with the audio information input by the client.

11. The media data processing method according to claim 10, wherein the activation status information is presented in the first window in the form of an audio waveform, and the amplitude of the audio waveform is associated with the acoustic characteristics of the audio information.

12. A media data processing apparatus, comprising: The first module is used to display the first interface of the first application in the client. The second module is used to receive a first trigger through the first interface and display a first window in the client. The first window is created by the client's operating system and is used to establish a session relationship with the first service. The first service is provided by the second application and is used to generate text information. The third module is used to receive a second trigger through the client, and when the first window is displayed in the client, to enable the first service to obtain first text information and display the first text information on the first interface.

13. An electronic device, the electronic device comprising: One or more processors; Storage device for storing one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement the media data processing method as described in any one of claims 1-11.

14. A storage medium containing computer-executable instructions, characterized in that, The computer-executable instructions, when executed by a computer processor, are used to perform the media data processing method as described in any one of claims 1-11.

15. A computer program product comprising a computer program that, when executed by a processor, implements the media data processing method as described in any one of claims 1-11.

Images