Multimedia data encoding methods, devices, equipment and media

Abstract

This application provides a multimedia data encoding method, apparatus, device, and medium. In this method, after acquiring raw multimedia data and business data information, business configuration information is determined based on the business data information. Then, based on the audio data in the raw multimedia data, business provider text information and business handler text information are determined. Subsequently, based on the business provider text information, business handler text information, business configuration information, raw multimedia data, and business data information, business provider process time period information, at least one business handler response process time period information, and at least one business handler action process time period information corresponding to each business provider's process are generated. Finally, the raw multimedia data is encoded based on these time period information, effectively improving the matching degree between the business data processing flow and the clarity of the encoded multimedia data.

Description

Technical Field

[0001] This application relates to the field of financial technology or other related fields, and in particular to a multimedia data encoding method, apparatus, device and medium. Background Technology

[0002] With the development of technology, after recording multimedia data, the original files often occupy a large amount of space. To reduce this space usage, multimedia data encoding methods can be used to encode the multimedia data. The methods for encoding multimedia data have also evolved from constant bit rate encoding to variable bit rate encoding.

[0003] In existing technologies, constant bitrate encoding uses a fixed bitrate, meaning the amount of data transmitted per second is constant. This can result in poor image quality for segments with complex compositions, numerous colors, and rapid changes. Variable bitrate encoding, on the other hand, dynamically adjusts the encoding bitrate based on the compositional complexity, number of colors, and speed of change of the video segment, resulting in clearer images for segments with complex compositions, numerous colors, and rapid changes. However, in business data processing scenarios, to ensure the security of the business data processing flow and protect the legitimate rights and interests of users, multimedia data is often recorded and then encoded during the business data processing process. This requires high-definition multimedia data for key business data processing flows. Existing encoding methods only consider composition, number of colors, and speed of change, and are not suitable for business data processing scenarios.

[0004] In summary, existing media data encoding methods only consider composition, color quantity, and change rate, resulting in a low degree of matching between business data processing flow and the clarity of encoded multimedia data. Summary of the Invention

[0005] This application provides a multimedia data encoding method, apparatus, device, and medium to solve the problem that existing media data encoding methods only consider composition, color quantity, and change speed, resulting in a low degree of matching between the business data processing flow and the clarity of the encoded multimedia data.

[0006] In a first aspect, embodiments of this application provide a multimedia data encoding method, including:

[0007] Acquire raw multimedia data and business data information, wherein the raw multimedia data includes audio data and video data, and the business data information includes a business identifier;

[0008] Based on the business identifier, determine the business configuration information corresponding to the business identifier. The business configuration information includes at least one business provider process and key business processes among all business provider processes.

[0009] Based on the audio data in the original multimedia data, determine the service provider text information and the service handler text information; wherein, the service provider text information includes at least one service provider text and a text time period corresponding to each service provider text, and the service handler text information includes at least one service handler text and a text time period corresponding to each service handler text;

[0010] Based on the service provider text information, the service handler text information, the service configuration information, the original multimedia data, and the service data information, generate service provider process time period information, at least one service handler response process time period information, and at least one service handler action process time period information corresponding to each service provider process; wherein, each service provider process time period information includes the provider process time period and importance level, each service handler response time period information includes the response process time period and importance level, and each service handler action time period information includes the action process time period and importance level;

[0011] The original multimedia data is encoded based on the process time information of all service providers, the response time information of all service handlers, and the action time information of all service handlers.

[0012] In one specific implementation, determining the service provider text information and the service handler text information based on the audio data in the original multimedia data includes:

[0013] The audio data is processed to separate the speaker, resulting in audio data from the service provider and audio data from the service handler.

[0014] The audio data of the service provider is processed by speech-to-text conversion to obtain at least one text from the service provider and the text time segment corresponding to each text, thereby generating the text information of the service provider;

[0015] The audio data of the business handler is processed by speech-to-text conversion to obtain at least one business handler text and the text time period corresponding to each business handler text, thereby generating the business handler text information.

[0016] In one specific implementation, the step of generating business provider process time period information, at least one business handler response process time period information, and at least one business handler action process time period information corresponding to each business provider process based on the business provider text information, the business handler text information, the business configuration information, the original multimedia data, and the business data information includes:

[0017] Based on the business handler text information and the preset handler text, at least one business handler response time period information is generated, and the importance level in each business handler response time period information is the preset first importance level;

[0018] Based on the text information of the service provider and the preset guidance action text, or based on the video data in the original multimedia data, generate at least one time period information of the action process of the service provider, and the importance level of each time period information of the action process of the service provider is the preset first importance level.

[0019] If the business data information includes time period information corresponding to each business provider process, for each business provider process, business provider process time period information is generated based on the time period information corresponding to the business provider process. The importance level in the business provider process time period information is a preset second importance level, which is lower than the preset first importance level.

[0020] The importance level in the time period information of the business provider corresponding to the key business process is updated to the preset first importance level.

[0021] In one specific implementation, generating at least one service provider action flow time period information based on the service provider's text information and preset guidance action text includes:

[0022] Based on the service provider text information and the preset guidance action text, at least one action text and the end time corresponding to each action text are determined.

[0023] For each action text, the end time of the action text is taken as the start time of the action process period in the action process period information of the business handling party corresponding to the action text.

[0024] The time after the end time of the action text is preset to be used as the end time of the action process period in the action process period information of the business handling party corresponding to the action text.

[0025] The preset first importance level is used as the importance level in the time period information of the business handling party's action process corresponding to the action text.

[0026] In one specific implementation, generating at least one business processing party action flow time period information based on video data in the original multimedia data includes:

[0027] Motion detection is performed on the video data to determine at least one time period of motion flow;

[0028] For each action process time period, determine the action process time period in the action process time period information of the business handling party corresponding to the action process time period;

[0029] The preset first importance level is used as the importance level in the business process time period information corresponding to the action process time period.

[0030] In one specific implementation, the business configuration information further includes preset text corresponding to each business provider process; before updating the importance level in the business provider process time period information corresponding to the key business process to the preset first importance level, the method further includes:

[0031] If the business data information does not include the time period information corresponding to each business provider process, based on the business provider text information and the preset text corresponding to each business provider process, for each business provider process, business provider process time period information is generated. The importance level in the business provider process time period information is a preset second importance level, and the preset second importance level is equal to the preset first importance level.

[0032] In one specific implementation, encoding the original multimedia data based on the process time period information of all service providers, the response time period information of all service handlers, and the action time period information of all service handlers includes:

[0033] The time periods excluding all provider process periods, all response process periods, and all action process periods within the overall time period of the original multimedia data are designated as idle periods.

[0034] For each idle time period, idle time period information is generated, which includes the idle time period and an importance level. The importance level in the idle time period information is a preset third importance level, which is lower than the preset second importance level.

[0035] The original multimedia data is encoded based on the provider process time period in the process time period information of each service provider, the bit rate corresponding to the importance level in the process time period information of each service provider, the response process time period in the response process time period information of each service handler, the bit rate corresponding to the importance level in the response process time period information of each service handler, the action process time period in the action process time period information of each service handler, the bit rate corresponding to the importance level in the action process time period information of each service handler, the idle time period in the idle time period information, and the bit rate corresponding to the importance level in the idle time period information. The importance level is proportional to the bit rate.

[0036] In one specific implementation, before acquiring the original multimedia data and business data information, the method further includes:

[0037] During the process of processing business data and recording the original multimedia data, time period information corresponding to each business provider's process is obtained through data tracking.

[0038] Secondly, embodiments of this application provide a multimedia data encoding apparatus, comprising:

[0039] The acquisition module is used to acquire raw multimedia data and business data information. The raw multimedia data includes audio data and video data, and the business data information includes a business identifier.

[0040] Processing module, used for:

[0041] Based on the business identifier, determine the business configuration information corresponding to the business identifier. The business configuration information includes at least one business provider process and key business processes among all business provider processes.

[0042] Based on the audio data in the original multimedia data, determine the service provider text information and the service handler text information; wherein, the service provider text information includes at least one service provider text and a text time period corresponding to each service provider text, and the service handler text information includes at least one service handler text and a text time period corresponding to each service handler text;

[0043] Based on the service provider text information, the service handler text information, the service configuration information, the original multimedia data, and the service data information, generate service provider process time period information, at least one service handler response process time period information, and at least one service handler action process time period information corresponding to each service provider process; wherein, each service provider process time period information includes the provider process time period and importance level, each service handler response time period information includes the response process time period and importance level, and each service handler action time period information includes the action process time period and importance level;

[0044] The encoding module is used to encode the original multimedia data based on the process time information of all service providers, the response time information of all service handlers, and the action time information of all service handlers.

[0045] Thirdly, embodiments of this application provide an electronic device, including:

[0046] Processor, memory, communication interface;

[0047] The memory is used to store the executable instructions of the processor;

[0048] The processor is configured to execute the multimedia data encoding method according to any one of the first aspects by executing the executable instructions.

[0049] Fourthly, embodiments of this application provide a readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the multimedia data encoding method described in any of the first aspects.

[0050] Fifthly, embodiments of this application provide a computer program product, including a computer program, which, when executed by a processor, is used to implement the multimedia data encoding method described in any of the first aspects.

[0051] The multimedia data encoding method, apparatus, device, and medium provided in this application, after obtaining the original multimedia data and business data information, determines the business configuration information based on the business data information, and then determines the business provider text information and business handler text information based on the audio data in the original multimedia data. Furthermore, based on the business provider text information, business handler text information, business configuration information, original multimedia data, and business data information, it generates business provider process time period information, at least one business handler response process time period information, and at least one business handler action process time period information corresponding to each business provider process. Finally, it encodes the original multimedia data based on these time period information, effectively improving the matching degree between the business data processing flow and the clarity of the encoded multimedia data. Attached Figure Description

[0052] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0053] Figure 1 A flowchart illustrating an embodiment of the multimedia data encoding method provided in this application;

[0054] Figure 2 A flowchart illustrating Embodiment 2 of the multimedia data encoding method provided in this application;

[0055] Figure 3 A flowchart illustrating Embodiment 3 of the multimedia data encoding method provided in this application;

[0056] Figure 4 A flowchart illustrating Embodiment 4 of the multimedia data encoding method provided in this application;

[0057] Figure 5 A flowchart illustrating Embodiment 5 of the multimedia data encoding method provided in this application;

[0058] Figure 6 A flowchart illustrating Embodiment Six of the multimedia data encoding method provided in this application;

[0059] Figure 7 A schematic diagram of the structure of an embodiment of the multimedia data encoding apparatus provided in this application;

[0060] Figure 8 This is a schematic diagram of the structure of an electronic device provided in this application. Detailed Implementation

[0061] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments made by those skilled in the art under the guidance of these embodiments are within the scope of protection of this application.

[0062] The terms “first,” “second,” “third,” “fourth,” etc. (if present) in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a particular order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms “comprising” and “having,” and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0063] With the development of technology, multimedia data is typically encoded to reduce its storage space. Bitrate is a commonly used concept in encoding, referring to the number of bits transmitted per unit of time. A higher bitrate results in higher clarity of the encoded multimedia data. Currently, multimedia data encoding typically employs constant bitrate encoding and variable bitrate encoding. Constant bitrate encoding uses a fixed bitrate, meaning the amount of data transmitted per second is constant. This can lead to poor image quality in segments with complex compositions, numerous colors, and rapid changes. Variable bitrate encoding, on the other hand, dynamically adjusts the encoding bitrate based on the compositional complexity, number of colors, and speed of change of the video segment, resulting in clearer images in segments with complex compositions, numerous colors, and rapid changes.

[0064] However, in business data processing scenarios, in order to ensure the security of business data processing processes and protect the legitimate rights and interests of users, multimedia data is usually recorded during the business data processing process and then encoded. This requires that the multimedia data corresponding to key business data processing processes have high clarity. The encoding methods in the existing technology only consider composition, color quantity, and change speed, which are not suitable for business data processing scenarios.

[0065] Therefore, existing media data encoding methods only consider composition, color quantity, and change rate, resulting in a low degree of matching between business data processing flow and the clarity of encoded multimedia data.

[0066] To address the problems existing in existing technologies, the inventors, during their research on multimedia data encoding methods, discovered that to improve the matching degree between business data processing flows and the clarity of encoded multimedia data, the time period corresponding to each business data processing flow in the multimedia data can be determined. Then, different bit rates are determined for the importance levels corresponding to different time periods, and the multimedia data is encoded according to the bit rates of different time periods. First, the original multimedia data and business data information are acquired. Then, based on the business identifier, business configuration information is determined. The business configuration information includes at least one business provider flow and key business flows among all business provider flows. Next, based on the audio data in the original multimedia data, business provider text information and business handler text information are determined. Then, based on the business provider text information, business handler text information, business configuration information, original multimedia data, and business data information, business provider flow time period information, at least one business handler response flow time period information, and at least one business handler action flow time period information corresponding to each business provider flow are generated. Each time period information includes the corresponding time period and importance level. Therefore, the original multimedia data can be encoded based on this time period information, effectively improving the matching degree between the business data processing flow and the clarity of the encoded multimedia data. Based on the above-mentioned inventive concept, the multimedia data encoding scheme in this application was designed.

[0067] The subject executing the multimedia data encoding method in this application can be a computer, or a server, terminal device, multimedia recording device, or other device capable of multimedia data encoding. This application does not limit it. The following description uses a computer as an example.

[0068] It should be noted that the multimedia data encoding method, apparatus, device, and medium of this application can be used in the financial field. They can also be used in any field other than finance. The application fields of the multimedia data encoding method, apparatus, device, and medium of this application are not limited.

[0069] The application scenarios of the multimedia data encoding method provided in this application are described below.

[0070] For example, in this application scenario, a user conducts business on a computer. The computer can process business data and record multimedia data. During the process of processing business data and recording multimedia data, the computer captures video recording events and process events of each business provider by embedding data points, and generates time period information corresponding to each business provider's process.

[0071] After multimedia data recording is completed, encoding is required to reduce storage space and ensure the clarity of key processes. The computer can obtain the original multimedia data and business data information, and then determine the business configuration information based on the business identifier in the business data information. The business configuration information includes at least one business provider process and key business processes among all business provider processes.

[0072] Then, based on the audio data in the original multimedia data, determine the text information of the service provider and the service handler. Based on the text information of the service handler and the preset service handler text, generate at least one service handler response time period, each of which includes the response time period and importance level.

[0073] Based on the text information from the service provider and the preset guidance action text, or based on the video data in the original multimedia data, generate at least one time period information for the action process of the service provider. Each time period information for the action process of the service provider includes the time period of the action process and the importance level.

[0074] Since the business data information includes time period information corresponding to each business provider process, for each business provider process, business provider process time period information is generated based on the time period information corresponding to the business provider process. Each business provider process time period information includes the provider process time period and importance level.

[0075] Finally, based on the time periods and importance levels in the process time periods of all business providers, the response time periods of all business handlers, and the action time periods of all business handlers, the original multimedia data is encoded to obtain encoded multimedia data. Furthermore, the matching degree between the business data processing flow and the clarity of the encoded multimedia data is relatively high.

[0076] It should be noted that the above scenario is only an example of an application scenario provided by the embodiments of this application. The embodiments of this application do not limit the actual form of the various devices included in the scenario. In the specific application of the solution, it can be set according to actual needs.

[0077] The technical solution of this application will now be described in detail through specific embodiments. It should be noted that the following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments.

[0078] Figure 1This is a flowchart illustrating an embodiment of the multimedia data encoding method provided in this application. This embodiment describes how, after a computer acquires raw multimedia data and business data information, it determines the service provider's process time period information, the service handler's response process time period information, and the service handler's action process time period information, and then performs encoding based on this time period information. The method in this embodiment can be implemented through software, hardware, or a combination of both. Figure 1 As shown, the multimedia data encoding method specifically includes the following steps:

[0079] S101: Obtain raw multimedia data and business data information.

[0080] In order to protect the legitimate rights and interests of users, computers or other devices capable of processing business data will simultaneously record multimedia data during the process of processing business data. After recording, in order to reduce the space occupied, it is necessary to encode it.

[0081] In this step, if a computer is recording multimedia data and processing business data, the original multimedia data and business data information can be obtained after recording is completed. If other devices are recording multimedia data and processing business data, the user can input the original multimedia data and business data information into the computer after recording is completed. The computer can then obtain the original multimedia data and business data information. The original multimedia data includes audio and video data, and the business data information includes business identifiers.

[0082] It should be noted that business data information may also include order number and product type information. This application embodiment does not limit the specific content of business data information, which can be determined according to the actual situation.

[0083] S102: Determine the service configuration information corresponding to the service identifier based on the service identifier.

[0084] In this step, after the computer obtains the original multimedia data and business data information, in order to determine the business provider process in the original multimedia data so that the corresponding time period information can be determined and then encoded, the business configuration information corresponding to the business identifier can be determined based on the business identifier in the business data information. The business configuration information includes at least one business provider process and key business processes among all business provider processes.

[0085] S103: Based on the audio data in the original multimedia data, determine the text information of the service provider and the text information of the service handler.

[0086] In this step, after the computer acquires the original multimedia data and business data information, in order to determine the time periods of the business provider and the business handler, it is also necessary to determine the text information of the business provider and the text information of the business handler based on the audio data in the original multimedia data. The text information of the business provider includes at least one text from the business provider and the corresponding text time period for each text; the text information of the business handler includes at least one text from the business handler and the corresponding text time period for each text.

[0087] It should be noted that the execution order of steps S102 and S103 can be: step S102 is executed first, then step S103; step S103 is executed first, then step S103; or step S102 and step S103 are executed simultaneously. This application embodiment does not limit the execution order of steps S102 and S103, and can be set according to the actual situation.

[0088] S104: Based on the text information of the service provider, the text information of the service handler, the service configuration information, the original multimedia data, and the service data information, generate the service provider process time period information, the response process time period information of at least one service handler, and the action process time period information of at least one service handler corresponding to each service provider process.

[0089] In this step, after obtaining the text information from the service provider, the text information from the service processor, and the service configuration information, the computer can determine at least one service processor's response process time period based on the service processor's text information; determine at least one service processor's action process time period based on the service provider's text information or video data in the original multimedia data; and determine the service provider's process time period information corresponding to each service provider's process based on the service data information or the service provider's text information. Each service provider's process time period information includes the provider's process time period and importance level; each service processor's response time period information includes the response process time period and importance level; and each service processor's action time period information includes the action process time period and importance level.

[0090] It should be noted that the service provider process time period information may also include the service provider process itself. For example, a service provider process time period information might be ([7:31, 15:52], Product Introduction, 2), indicating that the service provider process time period in this information is [7:31, 15:52]; the importance level is 2, indicating a preset second importance level; and the service provider process is a product introduction. This application does not limit the format of the service provider process time period information; it can be set according to actual circumstances.

[0091] S105: Encode the original multimedia data based on the process time information of all service providers, the response time information of all service handlers, and the action time information of all service handlers.

[0092] In this step, after generating the service provider's process time period information, the service provider's response process time period information, and the service provider's action process time period information, the computer removes the time periods from the above three types of time period information from the overall time period corresponding to the original multimedia data. The remaining time period is designated as an idle time period. A corresponding importance level is also set for the idle time period. Then, for each time period, the corresponding bit rate is determined according to the importance level of the time period. The higher the importance level, the higher the corresponding bit rate. The original multimedia data of the time period is then encoded according to the determined bit rate. After encoding each time period, the encoding of the original multimedia data can be achieved.

[0093] The multimedia data encoding method provided in this embodiment, after acquiring the original multimedia data and business data information, determines the business configuration information based on the business identifier in the business data information, and determines the business provider text information and business handler text information based on the audio data in the original business data. Then, based on the business provider text information, business handler text information, business configuration information, original multimedia data, and business data information, it generates business provider process time period information, business handler response process time period information, and business handler action process time period information. Finally, it encodes the original multimedia data based on this time period information. This not only reduces the space occupied by the original multimedia data but also improves the matching degree between the business data processing flow and the clarity of the encoded multimedia data, resulting in higher clarity of the multimedia data corresponding to each business data processing flow and better protecting the legitimate rights and interests of users.

[0094] Figure 2 This is a flowchart illustrating a second embodiment of the multimedia data encoding method provided in this application. Based on the above embodiments, this application describes how a computer determines the service provider's text information and the service handler's text information based on the audio data in the original multimedia data. For example... Figure 2 As shown, the multimedia data encoding method specifically includes the following steps:

[0095] S201: Perform speaker separation processing on the audio data to obtain audio data from the service provider and audio data from the service handler.

[0096] In this step, since the business provider and the business handler are involved in the business data processing, the audio data can be processed by speaker separation to obtain audio data from the business provider and audio data from the business handler.

[0097] It should be noted that the speaker separation processing of audio data can be performed using speaker separation technology or voiceprint segmentation and clustering methods. This application does not limit the speaker separation processing method of audio data, and the method can be selected according to the actual situation.

[0098] S202: Perform speech-to-text processing on the audio data of the service provider to obtain at least one text from the service provider and the corresponding text time period for each text, and generate the text information of the service provider.

[0099] In this step, after the computer obtains the audio data from the service provider and the service handler, it performs speech-to-text processing on the service provider's audio data to obtain at least one service provider text and a corresponding text segment for each service provider text. All service provider texts and the corresponding text segments for each service provider text can constitute the service provider text information.

[0100] S203: Perform speech-to-text processing on the audio data of the business handler to obtain at least one business handler text and the text time period corresponding to each business handler text, and generate business handler text information.

[0101] In this step, after the computer obtains the audio data from the service provider and the service processor, it performs speech-to-text processing on the service processor's audio data to obtain at least one service processor text and a corresponding text segment for each service processor text. All service processor texts and the corresponding text segments for each service processor text can constitute the service processor text information.

[0102] It should be noted that the execution order of steps S202 and S203 can be: step S202 is executed first, then step S203; step S203 is executed first, then step S203; or step S202 and step S203 are executed simultaneously. This application embodiment does not limit the execution order of steps S202 and S203, and can be set according to the actual situation.

[0103] It should be noted that the computer can first process the audio data in the original multimedia data into speech-to-text, obtaining multiple texts and the corresponding text time period for each text. Then, it can perform speaker separation processing to classify the multiple texts into service provider texts and service handler texts, thereby generating service provider text information and service handler text information.

[0104] For example, the service provider's text information can be used with W s W indicates s =W s1 ∪W s2 ∪W s3∪…∪W sn Among them, W si ,i=1,…,n represent each service provider text and its corresponding text time period, W si The format is (time, text), where time is in the format [t1, t2], t1 represents the start time of the text period, t2 represents the end time of the text period, and text represents the text from the service provider. The same applies to text information from the service provider.

[0105] It should be noted that the embodiments of this application do not limit the speech-to-text processing method, and the method can be selected according to the actual situation.

[0106] The multimedia data encoding method provided in this embodiment obtains service provider text information and service handler text information by performing speaker separation and speech-to-text processing on audio data, which effectively improves the accuracy of service provider text information and service handler text information.

[0107] Figure 3 This is a flowchart illustrating a third embodiment of the multimedia data encoding method provided in this application. Based on the above embodiments, this application describes how a computer generates service provider process time period information, service provider response process time period information, and service provider action process time period information based on service provider text information, service handler text information, service configuration information, original multimedia data, and service data information. Figure 3 As shown, the multimedia data encoding method specifically includes the following steps:

[0108] S301: Generate at least one business processing party response time period information based on the business processing party text information and the preset business processing party text.

[0109] In this step, after the computer obtains the text information of the service provider and the service handler, it can generate at least one service handler response time period information based on the service handler text information and the preset service handler text. The importance level of each service handler response time period information is the preset first importance level.

[0110] Since the preset handling party text is the predicted text for the business handling party's response in the business handling party's response process, the business handling party text in the business handling party text information can be matched with the preset handling party text. For each successfully matched business handling party text, the text time period corresponding to the business handling party text is taken as a response process time period in the business handling party's response process time period information, and the preset first importance level is taken as the importance level in the business handling party's response time period information.

[0111] For example, if the preset processing text is "clear, understand, agree, confirm, acknowledge", and one of the processing text messages is "I agree", then the match is successful. If one of the processing text messages is "The weather is nice today", then the match fails.

[0112] It should be noted that the above example is only an illustration of the process of matching the business processing party text with the preset processing party text. This application embodiment does not limit the business processing party text and the preset processing party text, and can be determined according to the actual situation.

[0113] S302: Generate at least one time period information of the action process of the business handler based on the text information of the business provider and the preset guidance action text, or based on the video data in the original multimedia data.

[0114] In this step, after the computer obtains the text information of the service provider and the service handler, it can generate at least one time period information of the service handler's action process based on the text information of the service provider and the preset guidance action text, or based on the video data in the original multimedia data. The importance level of each time period information of the service handler's action is the preset first importance level.

[0115] Based on the text information of the service provider and the preset guidance action text, the start time and end time of the action process time period in the action process time period information of at least one service provider can be determined, and then the importance level of the action process time period information of the service provider can be set to the preset first importance level.

[0116] It can also perform motion detection on video data to identify at least one action time period in the action time period information of the business handler, and then set the importance level of the action time period information of the business handler to the preset first importance level.

[0117] S303: Determine whether the business data information includes time period information corresponding to each business provider's process; if the business data information includes time period information corresponding to each business provider's process, proceed to step S304; if the business data information does not include time period information corresponding to each business provider's process, proceed to step S305.

[0118] In this step, after the computer obtains the text information of the service provider and the service handler, in order to determine how to generate the service provider process time period information, it first needs to determine whether the business data information includes the time period information corresponding to each service provider process. If the business data information includes the time period information corresponding to each service provider process, it means that the service provider process time period information can be generated based on the time period information corresponding to each service provider process; if the business data information does not include the time period information corresponding to each service provider process, it means that the service provider process time period information needs to be generated based on the service provider text information.

[0119] S304: For each service provider process, generate service provider process time period information based on the time period information corresponding to the service provider process.

[0120] In this step, if the business data information includes time period information corresponding to each business provider's process, it means that business provider process time period information can be generated based on the time period information corresponding to each business provider's process. For each business provider's process, business provider process time period information is generated based on the time period information corresponding to the business provider's process. The importance level in the business provider process time period information is a preset second importance level, which is lower than the preset first importance level.

[0121] During the process of processing business data and recording raw multimedia data, data entry points can be used to obtain time period information corresponding to the process of each business provider.

[0122] For example, when recording raw multimedia data, the time point is set to t=0. When a service provider process is initiated, the start time point t1 is recorded; when the service provider process ends, the end time point t2 is recorded, thus generating time period information [t1, t2]. This process can be repeated to obtain time period information for all service provider processes.

[0123] Therefore, for each service provider process, the time period information corresponding to the service provider process is used as the service provider process time period in the service provider process time period information corresponding to the service provider process, and the preset second importance level is used as the importance level in the service provider process time period information corresponding to the service provider process.

[0124] S305: Based on the business provider text information and the preset text corresponding to each business provider process, generate business provider process time period information for each business provider process.

[0125] In this step, if the business data information does not include the time period information corresponding to each business provider process, it means that business provider process time period information needs to be generated based on the business provider text information. Based on the business provider text information and the preset text corresponding to each business provider process, business provider process time period information is generated for each business provider process. The importance level in the business provider process time period information is the preset second importance level, which is equal to the preset first importance level.

[0126] Since the preset text corresponding to each business provider process is the setting text for the business provider to process business data in the business provider process, the business provider text in the business provider text information can be matched with the preset text corresponding to each business provider process. For each successfully matched business provider text, the corresponding business provider process is determined, and the text time period corresponding to the business provider text is used as the provider process time period in the business provider process time period information. Then, the preset second importance level is used as the importance level in the business provider process time period information.

[0127] For example, if the preset text corresponding to a business provider process is "Do you agree to process the data under account number ****", and a business provider text in the business provider text information is "Do you agree to process the data under account number 0000", then it can be successfully matched with the preset text.

[0128] It should be noted that the above example is only an illustration of the process of matching the business provider's text with the preset text. This application embodiment does not limit the business provider's text and the preset text, and can be determined according to the actual situation.

[0129] It should be noted that the execution order of steps S301, S302, and S303-S305 can be as follows: first step S301, then step S302, and finally steps S303-S305; or first steps S303-S305, then step S301, and finally step S302; or first steps S303-S305, then step S302, and finally step S301; or steps S301, S302, and S303-S305 can be executed simultaneously. This application embodiment does not limit the execution order of steps S301, S302, and S303-S305, and can be selected according to the actual situation.

[0130] S306: Update the importance level in the time period information of the business provider corresponding to the key business process to the preset first importance level.

[0131] In this step, in order to better protect the legitimate rights and interests of users, the importance level of key business processes in the business provider's process needs to be clearer in the encoded original multimedia data. Therefore, the importance level of the business provider's process time period information corresponding to the key business processes is updated to the preset first importance level.

[0132] The multimedia data encoding method provided in this embodiment generates at least one business handler response process time period information based on the business handler's text information and preset business handler text; it generates at least one business handler action process time period information based on the business provider's text information and preset guidance action text, or based on video data in the original multimedia data; and it generates business provider process time period information based on the time period information corresponding to each business provider's process, or based on the business provider's text information and preset text corresponding to each business provider's process. This effectively improves the accuracy of generating business provider process time period information, business handler response process time period information, and business handler action process time period information.

[0133] Figure 4 This is a flowchart illustrating a fourth embodiment of the multimedia data encoding method provided in this application. Based on the above embodiments, this application describes the generation of at least one service provider action flow time period information according to the service provider's text information and preset guidance action text. For example... Figure 4 As shown, the multimedia data encoding method specifically includes the following steps:

[0134] S401: Based on the text information from the service provider and the preset guidance action text, determine at least one action text and the end time corresponding to each action text.

[0135] In this step, during the business data processing, the business provider will broadcast preset guidance action text so that the business handler can perform the corresponding actions. Therefore, when generating the action flow time period information of the business handler, it is necessary to first determine at least one action text and the end time corresponding to each action text based on the business provider's text information and the preset guidance action text.

[0136] The service provider text in the service provider text information is matched with the preset guidance action text. For each successfully matched service provider text, the service provider text is used as the action text, and the end time of the text time period corresponding to the service provider text is used as the end time of the action text.

[0137] For example, the preset guidance action text is "Please sign here," and one of the service provider text messages is also "Please sign here," so the two match successfully. The text time period corresponding to this service provider text is [17:10, 17:20], so the end time of the action text is 17:20.

[0138] S402: For each action text, the end time of the action text is used as the start time of the action process period in the action process period information of the corresponding business handler.

[0139] S403: Use the time after the preset duration following the end time of the action text as the end time of the action process period in the action process period information of the business handling party corresponding to the action text.

[0140] In the above steps, after the computer determines the action text and its corresponding end time, for each action text, the end time of the action text is used as the start time of the action process period in the action process period information of the business processing party corresponding to the action text. Then, the time after the end time of the action text, which is a preset duration, is used as the end time of the action process period in the action process period information of the business processing party corresponding to the action text.

[0141] For example, based on the above example, the preset duration is 15 seconds, so the start time of the action flow period is 17:20, the end time of the action flow period is 17:35, and the action flow period is [17:20, 17:35].

[0142] It should be noted that the preset duration can be 15 seconds, 20 seconds, or 25 seconds. This application embodiment does not limit the preset duration and can be set according to the actual situation.

[0143] S404: The first priority level will be preset as the importance level in the time period information of the business process corresponding to the action text.

[0144] In this step, after the computer determines the action flow time period in the action flow time period information of the business handler, it also needs to determine the importance level. Therefore, the first importance level is preset as the importance level in the action flow time period information of the business handler corresponding to the action text.

[0145] The multimedia data encoding method provided in this embodiment determines the time period information of the business processing party's action process by based on the text information of the business provider and the preset guidance action text, which effectively improves the accuracy of determining the time period information of the business processing party's action process.

[0146] Figure 5This is a flowchart illustrating a fifth embodiment of the multimedia data encoding method provided in this application. Based on the above embodiments, this application describes the generation of at least one business processing party action flow time period information based on video data in the original multimedia data. For example... Figure 5 As shown, the multimedia data encoding method specifically includes the following steps:

[0147] S501: Perform motion detection on the video data to determine at least one motion sequence period.

[0148] In this step, to determine the time period of the business transaction process, motion detection can be performed on the video data. By performing motion detection on the video data, the actions of the business transaction process can be determined, thereby identifying at least one time period of the action process.

[0149] It should be noted that the methods for motion detection of video data can be TSN, Two-stream, LRCN, etc. This application embodiment does not limit them and can be determined according to the actual situation.

[0150] S502: For each action process time period, determine the action process time period in the action process time period information of the business handling party corresponding to the action process time period.

[0151] S503: The first priority level will be preset as the importance level in the action process time information of the business handling party corresponding to the action process time period.

[0152] In the above steps, after the computer determines the action flow time period, for each action flow time period, that time period is used as the action flow time period in the corresponding business processing party's action flow time period information. Then, a preset first importance level is used as the importance level in the corresponding business processing party's action flow time period information.

[0153] The multimedia data encoding method provided in this embodiment determines the time period information of the business processing party's action process by performing motion detection on video data, which effectively improves the accuracy of determining the time period information of the business processing party's action process.

[0154] Figure 6 This is a flowchart illustrating a sixth embodiment of the multimedia data encoding method provided in this application. Based on the above embodiments, this application describes the encoding of original multimedia data according to the process time period information of all service providers, the response time period information of all service handlers, and the action time period information of all service handlers. For example... Figure 6 As shown, the multimedia data encoding method specifically includes the following steps:

[0155] S601: The time period excluding all provider process periods, all response process periods, and all action process periods in the overall time period of the original multimedia data is designated as the idle period.

[0156] In this step, since the computer has already identified the provider process time period, response process time period, and action process time period, and these time periods all have corresponding importance levels, it is necessary to process the remaining time periods. This requires that the time periods in the overall time period of the original multimedia data, excluding all provider process time periods, all response process time periods, and all action process time periods, be designated as idle time periods.

[0157] S602: For each idle period, generate idle period information.

[0158] In this step, after the computer determines the idle time period, it generates idle time period information for each idle time period. The idle time period information includes the idle time period and the importance level. The importance level in the idle time period information is the preset third importance level, which is lower than the preset second importance level, and the preset second importance level is lower than the preset first importance level.

[0159] S603: Encode the original multimedia data based on the provider process time period in the process time period information of each service provider, the bit rate corresponding to the importance level in the process time period information of each service provider, the response process time period in the response process time period information of each service handler, the bit rate corresponding to the importance level in the response process time period information of each service handler, the action process time period in the action process time period information of each service handler, the bit rate corresponding to the importance level in the action process time period information of each service handler, the idle time period in the idle time period information, and the bit rate corresponding to the importance level in the idle time period information.

[0160] In this step, after the computer determines the idle time period information, it can determine the corresponding bit rate based on the importance level in the process time period information of each service provider, the corresponding bit rate based on the importance level in the response process time period information of each service handler, the corresponding bit rate based on the importance level in the action process time period information of each service handler, and the corresponding bit rate based on the importance level in the idle time period information. The importance level is directly proportional to the bit rate.

[0161] Therefore, among the three types of time period information—the time period information of the business handling party's response process, the time period information of the business handling party's action process, and the time period information of the business provider's process corresponding to key business processes—the importance level is preset to the first importance level, so the corresponding bit rate is the highest.

[0162] In the time period information of business provider processes other than key business processes, the importance level is the second most important level, and the corresponding bit rate is the next most important.

[0163] The importance level of the idle period information is the preset third importance level, so its corresponding bit rate is the lowest.

[0164] For example, the preset bit rate corresponding to the first importance level is 8500kbps, the preset bit rate corresponding to the second importance level is 3500kbps, and the preset bit rate corresponding to the third importance level is 1500kbps. This application does not limit the preset bit rate corresponding to the first importance level, the preset bit rate corresponding to the second importance level, or the preset bit rate corresponding to the third importance level; these can be set according to actual circumstances.

[0165] Then, for each time period, the original multimedia data of that time period is encoded according to the corresponding bit rate. After encoding each time period, the original multimedia data can be encoded.

[0166] It should be noted that the encoding protocol can be H.261, H.263, H.264, H.265, etc. This application embodiment does not limit it and can be selected according to the actual situation.

[0167] It should be noted that if multiple time periods overlap, the overlapping time periods will be encoded using the highest bit rate among the multiple time periods.

[0168] The multimedia data encoding method provided in this embodiment determines idle time period information, and then encodes the original multimedia data based on the idle time period information, the service provider's process time period information, the service provider's response process time period information, and the service provider's action process time period information, effectively improving the matching degree between the business data processing flow and the clarity of the encoded multimedia data.

[0169] The following are embodiments of the apparatus described in this application, which can be used to execute the embodiments of the method described in this application. For details not disclosed in the apparatus embodiments of this application, please refer to the embodiments of the method described in this application.

[0170] Figure 7 This is a schematic diagram illustrating the structure of an embodiment of the multimedia data encoding apparatus provided in this application. Figure 7 As shown, the multimedia data encoding device 70 includes:

[0171] The acquisition module 71 is used to acquire raw multimedia data and business data information, wherein the raw multimedia data includes audio data and video data, and the business data information includes a business identifier.

[0172] Processing module 72 is used for:

[0173] Based on the business identifier, determine the business configuration information corresponding to the business identifier. The business configuration information includes at least one business provider process and key business processes among all business provider processes.

[0174] Based on the audio data in the original multimedia data, determine the service provider text information and the service handler text information; wherein, the service provider text information includes at least one service provider text and a text time period corresponding to each service provider text, and the service handler text information includes at least one service handler text and a text time period corresponding to each service handler text;

[0175] Based on the service provider text information, the service handler text information, the service configuration information, the original multimedia data, and the service data information, generate service provider process time period information, at least one service handler response process time period information, and at least one service handler action process time period information corresponding to each service provider process; wherein, each service provider process time period information includes the provider process time period and importance level, each service handler response time period information includes the response process time period and importance level, and each service handler action time period information includes the action process time period and importance level;

[0176] The encoding module 73 is used to encode the original multimedia data based on the process time information of all service providers, the response time information of all service handlers, and the action time information of all service handlers.

[0177] Furthermore, the processing module 72 is specifically used for:

[0178] The audio data is processed to separate the speaker, resulting in audio data from the service provider and audio data from the service handler.

[0179] The audio data of the service provider is processed by speech-to-text conversion to obtain at least one text from the service provider and the text time segment corresponding to each text, thereby generating the text information of the service provider;

[0180] The audio data of the business handler is processed by speech-to-text conversion to obtain at least one business handler text and the text time period corresponding to each business handler text, thereby generating the business handler text information.

[0181] Furthermore, the processing module 72 is specifically used for:

[0182] Based on the business handler text information and the preset handler text, at least one business handler response time period information is generated, and the importance level in each business handler response time period information is the preset first importance level;

[0183] Based on the text information of the service provider and the preset guidance action text, or based on the video data in the original multimedia data, generate at least one time period information of the action process of the service provider, and the importance level of each time period information of the action process of the service provider is the preset first importance level.

[0184] If the business data information includes time period information corresponding to each business provider process, for each business provider process, business provider process time period information is generated based on the time period information corresponding to the business provider process. The importance level in the business provider process time period information is a preset second importance level, which is lower than the preset first importance level.

[0185] The importance level in the time period information of the business provider corresponding to the key business process is updated to the preset first importance level.

[0186] Furthermore, the processing module 72 is specifically used for:

[0187] Based on the service provider text information and the preset guidance action text, at least one action text and the end time corresponding to each action text are determined.

[0188] For each action text, the end time of the action text is taken as the start time of the action process period in the action process period information of the business handling party corresponding to the action text.

[0189] The time after the end time of the action text is preset to be used as the end time of the action process period in the action process period information of the business handling party corresponding to the action text.

[0190] The preset first importance level is used as the importance level in the time period information of the business handling party's action process corresponding to the action text.

[0191] Furthermore, the processing module 72 is specifically used for:

[0192] Motion detection is performed on the video data to determine at least one time period of motion flow;

[0193] For each action process time period, determine the action process time period in the action process time period information of the business handling party corresponding to the action process time period;

[0194] The preset first importance level is used as the importance level in the business process time period information corresponding to the action process time period.

[0195] Furthermore, the processing module 72 is also configured to, if the business data information does not include the time period information corresponding to each business provider process, generate business provider process time period information for each business provider process based on the business provider text information and the preset text corresponding to each business provider process, wherein the importance level in the business provider process time period information is a preset second importance level, and the preset second importance level is equal to the preset first importance level.

[0196] Furthermore, the processing module 72 is also used for:

[0197] The time periods excluding all provider process periods, all response process periods, and all action process periods within the overall time period of the original multimedia data are designated as idle periods.

[0198] For each idle time period, idle time period information is generated, which includes the idle time period and an importance level. The importance level in the idle time period information is a preset third importance level, which is lower than the preset second importance level.

[0199] Furthermore, the encoding module 73 is also used to encode the original multimedia data based on the provider process time period in the process time period information of each service provider, the bit rate corresponding to the importance level in the process time period information of each service provider, the response process time period in the response process time period information of each service handler, the bit rate corresponding to the importance level in the response process time period information of each service handler, the action process time period in the action process time period information of each service handler, the bit rate corresponding to the importance level in the action process time period information of each service handler, the idle time period in the idle time period information, and the bit rate corresponding to the importance level in the idle time period information, wherein the importance level is proportional to the bit rate.

[0200] Furthermore, the acquisition module 71 is also used to acquire time period information corresponding to each service provider's process through point-based processing during the process of processing business data and recording the original multimedia data.

[0201] The multimedia data encoding device provided in this embodiment is used to execute the technical solutions in any of the foregoing method embodiments. Its implementation principle and technical effects are similar, and will not be described again here.

[0202] Figure 8 This is a schematic diagram of the structure of an electronic device provided in this application. Figure 8As shown, the electronic device 80 includes:

[0203] Processor 81, memory 82, and communication interface 83;

[0204] The memory 82 is used to store the executable instructions of the processor 81;

[0205] The processor 81 is configured to execute the technical solutions in any of the foregoing method embodiments by executing the executable instructions.

[0206] Optionally, the memory 82 can be either standalone or integrated with the processor 81.

[0207] Optionally, when the memory 82 is a device independent of the processor 81, the electronic device 80 may further include:

[0208] Bus 84, memory 82 and communication interface 83 are connected to processor 81 through bus 84 and complete communication with each other. Communication interface 83 is used to communicate with other devices.

[0209] Optionally, the communication interface 83 can be implemented using a transceiver. The communication interface is used to enable communication between the database access device and other devices (e.g., clients, read-write databases, and read-only databases). The memory may include random access memory (RAM) and may also include non-volatile memory, such as at least one disk storage device.

[0210] Bus 84 can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. Buses can be categorized as address buses, data buses, control buses, etc. For ease of representation, only one thick line is used in the diagram, but this does not indicate that there is only one bus or one type of bus.

[0211] The processors mentioned above can be general-purpose processors, including central processing units (CPUs), network processors (NPs), etc.; they can also be digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components.

[0212] The electronic device is used to execute the technical solutions in any of the foregoing method embodiments. Its implementation principle and technical effect are similar, and will not be described again here.

[0213] This application also provides a readable storage medium storing a computer program thereon, which, when executed by a processor, implements the technical solutions provided in any of the foregoing method embodiments.

[0214] This application also provides a computer program product, including a computer program, which, when executed by a processor, is used to implement the technical solutions provided in any of the foregoing method embodiments.

[0215] Those skilled in the art will understand that all or part of the steps of the above-described method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When executed, the program performs the steps of the above-described method embodiments; and the aforementioned storage medium includes various media capable of storing program code, such as ROM, RAM, magnetic disks, or optical disks.

[0216] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

Claims

1. A multimedia data encoding method, characterized in that, include: Acquire raw multimedia data and business data information, wherein the raw multimedia data includes audio data and video data, and the business data information includes a business identifier; Based on the business identifier, determine the business configuration information corresponding to the business identifier. The business configuration information includes at least one business provider process and key business processes among all business provider processes. Based on the audio data in the original multimedia data, determine the service provider text information and the service handler text information; wherein, the service provider text information includes at least one service provider text and a text time period corresponding to each service provider text, and the service handler text information includes at least one service handler text and a text time period corresponding to each service handler text; Based on the service provider text information, the service handler text information, the service configuration information, the original multimedia data, and the service data information, generate service provider process time period information, at least one service handler response process time period information, and at least one service handler action process time period information corresponding to each service provider process; wherein, each service provider process time period information includes the provider process time period and importance level, each service handler response time period information includes the response process time period and importance level, and each service handler action time period information includes the action process time period and importance level, wherein the importance level in each service handler response time period information is a preset first importance level, and the importance level in each service handler action time period information is a preset first importance level; The original multimedia data is encoded based on the process time information of all service providers, the response time information of all service handlers, and the action time information of all service handlers. Among them, the time periods in the overall time period of the original multimedia data, excluding all provider process periods, all response process periods, and all action process periods, are idle periods. The importance level corresponding to the idle periods is a preset third importance level, which is lower than the preset first importance level. The importance level is proportional to the bit rate.

2. The method according to claim 1, characterized in that, The step of determining the service provider text information and the service handler text information based on the audio data in the original multimedia data includes: The audio data is processed to separate the speaker, resulting in audio data from the service provider and audio data from the service handler. The audio data of the service provider is processed by speech-to-text conversion to obtain at least one text from the service provider and the text time segment corresponding to each text, thereby generating the text information of the service provider; The audio data of the business handler is processed by speech-to-text conversion to obtain at least one business handler text and the text time period corresponding to each business handler text, thereby generating the business handler text information.

3. The method according to claim 1, characterized in that, The step of generating service provider process time period information, at least one service provider response process time period information, and at least one service provider action process time period information corresponding to each service provider process based on the service provider text information, the service handler text information, the service configuration information, the original multimedia data, and the service data information includes: Based on the business handler text information and the preset handler text, generate at least one business handler response process time period information; Based on the text information of the service provider and the preset guidance action text, or based on the video data in the original multimedia data, generate at least one time period information of the service provider's action process; If the business data information includes time period information corresponding to each business provider process, for each business provider process, business provider process time period information is generated based on the time period information corresponding to the business provider process. The importance level in the business provider process time period information is a preset second importance level, which is lower than the preset first importance level. The importance level in the time period information of the business provider corresponding to the key business process is updated to the preset first importance level.

4. The method according to claim 3, characterized in that, The step of generating at least one service provider action flow time period information based on the service provider's text information and preset guidance action text includes: Based on the service provider text information and the preset guidance action text, at least one action text and the end time corresponding to each action text are determined. For each action text, the end time of the action text is taken as the start time of the action process period in the action process period information of the business handling party corresponding to the action text. The time after the end time of the action text is preset to be used as the end time of the action process period in the action process period information of the business handling party corresponding to the action text. The preset first importance level is used as the importance level in the time period information of the business handling party's action process corresponding to the action text.

5. The method according to claim 3, characterized in that, The step of generating at least one time period information of the action flow of a business handler based on the video data in the original multimedia data includes: Motion detection is performed on the video data to determine at least one time period of motion flow; For each action process time period, determine the action process time period in the action process time period information of the business handling party corresponding to the action process time period; The preset first importance level is used as the importance level in the business process time period information corresponding to the action process time period.

6. The method according to claim 3, characterized in that, The business configuration information also includes preset text corresponding to each business provider's process; before updating the importance level in the time period information of the business provider's process corresponding to the key business process to the preset first importance level, the method further includes: If the business data information does not include the time period information corresponding to each business provider process, based on the business provider text information and the preset text corresponding to each business provider process, for each business provider process, business provider process time period information is generated. The importance level in the business provider process time period information is a preset second importance level, and the preset second importance level is equal to the preset first importance level.

7. The method according to any one of claims 3 to 6, characterized in that, The encoding of the original multimedia data based on the process time information of all service providers, the response time information of all service handlers, and the action time information of all service handlers includes: The time periods excluding all provider process periods, all response process periods, and all action process periods within the overall time period of the original multimedia data are designated as idle periods. For each idle time period, idle time period information is generated, which includes the idle time period and an importance level. The importance level in the idle time period information is a preset third importance level, which is lower than the preset second importance level. The original multimedia data is encoded based on the provider process time period in the process time period information of each service provider, the bit rate corresponding to the importance level in the process time period information of each service provider, the response process time period in the response process time period information of each service handler, the bit rate corresponding to the importance level in the response process time period information of each service handler, the action process time period in the action process time period information of each service handler, the bit rate corresponding to the importance level in the action process time period information of each service handler, the idle time period in the idle time period information, and the bit rate corresponding to the importance level in the idle time period information.

8. The method according to claim 3, characterized in that, Before acquiring the original multimedia data and business data information, the method further includes: During the process of processing business data and recording the original multimedia data, time period information corresponding to each business provider's process is obtained through data tracking.

9. A multimedia data encoding device, characterized in that, include: The acquisition module is used to acquire raw multimedia data and business data information. The raw multimedia data includes audio data and video data, and the business data information includes a business identifier. Processing module, used for: Based on the business identifier, determine the business configuration information corresponding to the business identifier. The business configuration information includes at least one business provider process and key business processes among all business provider processes. Based on the audio data in the original multimedia data, determine the service provider text information and the service handler text information; wherein, the service provider text information includes at least one service provider text and a text time period corresponding to each service provider text, and the service handler text information includes at least one service handler text and a text time period corresponding to each service handler text; Based on the service provider text information, the service handler text information, the service configuration information, the original multimedia data, and the service data information, generate service provider process time period information, at least one service handler response process time period information, and at least one service handler action process time period information corresponding to each service provider process; wherein, each service provider process time period information includes the provider process time period and importance level, each service handler response time period information includes the response process time period and importance level, and each service handler action time period information includes the action process time period and importance level, wherein the importance level in each service handler response time period information is a preset first importance level, and the importance level in each service handler action time period information is a preset first importance level; The encoding module is used to encode the original multimedia data based on the process time information of all service providers, the response time information of all service handlers, and the action time information of all service handlers. Among them, the time periods in the overall time period of the original multimedia data, excluding all provider process periods, all response process periods, and all action process periods, are idle periods. The importance level corresponding to the idle periods is a preset third importance level, which is lower than the preset first importance level. The importance level is proportional to the bit rate.

10. An electronic device, characterized in that, include: Processor, memory, communication interface; The memory is used to store the executable instructions of the processor; The processor is configured to execute the multimedia data encoding method according to any one of claims 1 to 8 by executing the executable instructions.

11. A readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the multimedia data encoding method according to any one of claims 1 to 8.

12. A computer program product, characterized in that, Includes a computer program, which, when executed by a processor, is used to implement the multimedia data encoding method according to any one of claims 1 to 8.

Images