Audio and video data processing method, device, electronic device and storage medium

Abstract

The present invention discloses a method, device, electronic device and storage medium for processing audio and video data, and relates to the technical field of audio and video processing. A specific implementation of the method includes: in response to a processing instruction for an audio and video call, obtaining each terminal and call service type corresponding to the audio and video call; querying the state processing strategy corresponding to the call service type to determine the processing class set of the call state; monitoring the call state of each terminal, matching the call state with the processing class set, and obtaining a matching result; in response to the matching result being a successful match, calling the matching successful processing class, generating a call prompt message, and sending it to each terminal. This implementation can solve the problem that the prompt information of various states in audio and video is fixed, cannot meet the needs of call state control in different business scenarios, and reduces the quality of the user's audio and video calls.

Description

Technical Field

[0001] The present invention relates to the technical field of audio and video processing, and in particular to a method, device, electronic equipment and storage medium for audio and video data processing. Background Art

[0002] With the development of network multimedia technology, audio and video technology has gradually improved, so it has become a common way for users to make calls through audio and video to handle business. Audio and video call technology has been applied to many scenarios, such as multi-person conference scenarios, Internet medical treatment scenarios, etc. In the audio and video call scenario, in order to improve the user's call instructions and experience, the user can be prompted for various states during the call. In the prior art, the status prompts for each audio and video call are usually performed in a general manner, resulting in fixed prompt information for various states in the audio and video, which cannot meet the needs of call status control in different business scenarios, and reduces the quality of the user's audio and video calls. Summary of the invention

[0003] In view of this, an embodiment of the present invention provides a method, device, electronic device and storage medium for processing audio and video data, which can solve the problem that the prompt information of various states in audio and video is fixed, cannot meet the needs of call status control in different business scenarios, and reduces the user's audio and video call quality.

[0004] To achieve the above objective, according to one aspect of an embodiment of the present invention, a method for processing audio and video data is provided.

[0005] A method for processing audio and video data in an embodiment of the present invention includes: responding to a processing instruction of an audio and video call, obtaining each terminal and call service type corresponding to the audio and video call; querying the status processing strategy corresponding to the call service type to determine a processing class set for the call status; monitoring the call status of each terminal, matching the call status with the processing class set, and obtaining a matching result; in response to the matching result being a successful match, calling the processing class that successfully matched, generating a call prompt message, and sending it to each terminal.

[0006] In one embodiment, matching the call status with the processing class set to obtain a matching result includes:

[0007] Comparing the call status with the historical call status of the audio and video calls;

[0008] In response to the comparison result being that the call state is updated, matching the call state with the processing class set to obtain a matching result;

[0009] In response to the comparison result that the call status is not updated, no operation is performed on the call status.

[0010] In yet another embodiment, the calling of the successfully matched processing class to generate a call prompt message includes:

[0011] Acquire capability parameters of each of the terminals to determine a corresponding prompt type;

[0012] The matching successful processing class is called to generate a call prompt message matching the prompt type.

[0013] In yet another embodiment, the calling of the successfully matched processing class to generate a call prompt message includes:

[0014] Based on the call service type, query the prompt message template corresponding to the processing class;

[0015] The attribute parameters of the audio and video call are obtained to be combined with the prompt message template to generate a call prompt message.

[0016] In yet another embodiment, after sending to each of the terminals, the method further includes:

[0017] In response to the call status belonging to the call abnormality type, sending a call end instruction to each of the terminals.

[0018] In yet another embodiment, monitoring the call status of each of the terminals includes:

[0019] The call status of each terminal is monitored based on a preset period, and the call status and the corresponding monitoring time are stored in a call details table to determine the historical call status of the audio and video call.

[0020] In yet another embodiment, querying the state processing strategy corresponding to the call service type includes:

[0021] In response to not finding the status processing policy corresponding to the call service type, a preset general status processing policy is determined as the status processing policy corresponding to the call service type.

[0022] To achieve the above objective, according to another aspect of an embodiment of the present invention, a device for processing audio and video data is provided.

[0023] An audio and video data processing device according to an embodiment of the present invention includes: an acquisition unit, which is used to respond to a processing instruction of an audio and video call and acquire each terminal and call service type corresponding to the audio and video call; a determination unit, which is used to query the state processing strategy corresponding to the call service type to determine a processing class set for the call state; a matching unit, which is used to monitor the call state of each terminal, match the call state with the processing class set, and obtain a matching result; and a prompt unit, which is used to call the processing class of the successful match in response to the matching result being a successful match, and generate a call prompt message to send to each terminal.

[0024] In one embodiment, the matching unit is specifically used to:

[0025] Comparing the call status with the historical call status of the audio and video calls;

[0026] In response to the comparison result being that the call state is updated, matching the call state with the processing class set to obtain a matching result;

[0027] In response to the comparison result that the call status is not updated, no operation is performed on the call status.

[0028] In yet another embodiment, the prompting unit is specifically configured to:

[0029] Acquire capability parameters of each of the terminals to determine a corresponding prompt type;

[0030] The matching successful processing class is called to generate a call prompt message matching the prompt type.

[0031] In yet another embodiment, the prompting unit is specifically configured to:

[0032] Based on the call service type, query the prompt message template corresponding to the processing class;

[0033] The attribute parameters of the audio and video call are obtained to be combined with the prompt message template to generate a call prompt message.

[0034] In yet another embodiment, the apparatus further comprises:

[0035] The terminating unit is used for sending a call terminating instruction to each of the terminals in response to the call status belonging to the call abnormality type.

[0036] In yet another embodiment, the matching unit is specifically configured to:

[0037] The call status of each terminal is monitored based on a preset period, and the call status and the corresponding monitoring time are stored in a call details table to determine the historical call status of the audio and video call.

[0038] In yet another embodiment, the determining unit is specifically configured to:

[0039] In response to not finding the status processing policy corresponding to the call service type, a preset general status processing policy is determined as the status processing policy corresponding to the call service type.

[0040] To achieve the above objective, according to another aspect of an embodiment of the present invention, an electronic device is provided.

[0041] An electronic device according to an embodiment of the present invention includes: one or more processors; a storage device for storing one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors implement the method for processing audio and video data provided by the embodiment of the present invention.

[0042] To achieve the above objective, according to another aspect of an embodiment of the present invention, a computer readable medium is provided.

[0043] A computer-readable medium according to an embodiment of the present invention stores a computer program, and when the program is executed by a processor, the method for processing audio and video data provided by the embodiment of the present invention is implemented.

[0044] To achieve the above objective, according to another aspect of an embodiment of the present invention, a computer program product is provided.

[0045] A computer program product according to an embodiment of the present invention includes a computer program, and when the program is executed by a processor, the audio and video data processing method provided by the embodiment of the present invention is implemented.

[0046] One embodiment of the above invention has the following advantages or beneficial effects: In the embodiment of the present invention, in response to the processing instruction of the audio and video call, the corresponding terminals and call service types can be obtained to query the state processing strategy corresponding to the call service type to determine the processing class set of the call status, so the monitoring model can process the call status of each terminal after monitoring the call status of each terminal through the successfully matched processing class to prompt the terminal of different call status. In the embodiment of the present invention, the corresponding state processing strategy can be configured based on the call service type, and then the corresponding processing class set can be determined. Each processing class in the processing class set can be used to process different call states of audio and video calls, so as to meet the status prompt requirements of different call service types, and then provide personalized status prompts for corresponding audio and video call users, thereby improving the audio and video call quality of users.

[0047] The further effects of the above-mentioned non-conventional optional manner will be described below in conjunction with specific implementation examples. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] The accompanying drawings are used to better understand the present invention and do not constitute an improper limitation of the present invention.

[0049] Figure 1 is a schematic diagram of a main process of a method for processing audio and video data according to an embodiment of the present invention;

[0050] Figure 2 is a schematic diagram of another main process of the method for processing audio and video data according to an embodiment of the present invention;

[0051] Figure 3 is a schematic diagram of another main process of the method for processing audio and video data according to an embodiment of the present invention;

[0052] Figure 4 is a schematic diagram of main units of an apparatus for processing audio and video data according to an embodiment of the present invention;

[0053] Figure 5 is an exemplary system architecture diagram to which embodiments of the present invention may be applied;

[0054] Figure 6 It is a schematic diagram of the structure of a computer system suitable for implementing the embodiment of the present invention. DETAILED DESCRIPTION

[0055] The following is a description of exemplary embodiments of the present invention in conjunction with the accompanying drawings, including various details of the embodiments of the present invention to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present invention. Similarly, for clarity and conciseness, the description of well-known functions and structures is omitted in the following description.

[0056] It should be noted that the embodiments and features of the embodiments of the present invention can be combined with each other without conflict. The acquisition, storage, use, and processing of data in the technical solution of this application are in compliance with the relevant provisions of national laws and regulations.

[0057] An embodiment of the present invention provides a data processing system, which can be used in a scenario of processing audio and video call data, and specifically, can be used in a scenario of prompting a call status during an audio and video call.

[0058] Audio and video call technology has been applied to a variety of scenarios, such as multi-person conference scenarios, Internet medical treatment scenarios, etc. These scenarios all involve two or more users making audio and video calls. However, since the service types corresponding to each scenario are different, the processing of call status is also different. For example, time is usually precious in Internet medical treatment scenarios, so it is necessary to prompt the call duration of audio and video calls, while in multi-person conference scenarios, it is more important whether all personnel are complete, so it is necessary to prompt whether each user in the audio and video call is connected. Therefore, in order to adapt to different call service scenarios, in an embodiment of the present invention, the data processing system can configure a corresponding status processing strategy for each call service scenario to meet the needs of each call service scenario, thereby improving the user's video call quality.

[0059] In an embodiment of the present invention, the data processing system may include a server and a client. Users may make audio and video calls through the client. The client may be placed on a terminal used by the user. The data processing system may transmit messages with the terminal through a message middleware.

[0060] It should be noted that audio and video calls refer to voice or video calls. In the embodiment of the present invention, each user can initiate an audio and video call by setting up a client of the terminal. The data processing system can establish an audio and video call for each user to provide audio and video call services to the user.

[0061] The embodiment of the present invention provides a method for processing audio and video data, which can be executed by a data processing system. Figure 1 As shown, the method includes:

[0062] S101: In response to an instruction for processing an audio or video call, obtaining terminals and call service types corresponding to the audio or video call.

[0063] Among them, the processing instruction of the audio and video call can be triggered when the user initiates an audio and video call through the client in the terminal. For example, when the user needs to initiate an audio and video call, he can initiate an audio and video call request to the server of the data processing system through the terminal. The data processing system can establish a corresponding audio and video call for the user, and can also trigger the processing instruction of the audio and video call to prompt and control the call status during the call process.

[0064] The data processing system responds to the processing instruction of the audio and video call and can obtain the terminals of the audio and video call, that is, the terminals participating in the audio and video call, and can also obtain the call service type of the audio and video call.

[0065] Specifically, the data processing system can configure the corresponding call service type for each call service scenario and generate a call type identifier. The user can select the corresponding call service type when initiating an audio or video call. For example, by selecting the corresponding call type identifier, the processing instructions of the audio or video call can carry the call service type.

[0066] In an embodiment of the present invention, in order to better control the audio and video calls, the basic parameters of the audio and video calls can be obtained and stored, which may specifically include call identification, call status, call user information, etc. A call information table can also be generated to store the basic parameters of the audio and video calls.

[0067] It should be noted that in an embodiment of the present invention, after determining each terminal, the data processing system can obtain the audio and video capability parameters of each terminal to determine whether each terminal has the audio and video call capability, and then when the audio and video call capability is not available, a prompt can be sent to the terminal or the audio and video call can be ended.

[0068] S102: Query the status processing strategy corresponding to the call service type to determine a processing class set for the call status.

[0069] After obtaining the call service type of the audio and video call, the data processing system can query the status processing strategy corresponding to the call service type to adapt to the call status prompt requirements of the call service type. Specifically, in the embodiment of the present invention, a call type identifier can be generated for each call service type, and a corresponding status processing strategy can be configured, and then a corresponding relationship between the two can be established to query the status processing strategy corresponding to the call service type through the corresponding relationship.

[0070] In order to implement the call status prompt for audio and video calls, a processing class can be set in the embodiment of the present invention, and each processing class can be used to process a call status prompt task. Specifically, in the embodiment of the present invention, a processing class corresponding to the prompt task of different call status can be set, and then an association relationship with each processing class can be established based on the requirements of the status processing strategy. After the status processing strategy corresponding to the call service type can be obtained, a call status processing class set can be determined based on the preset association relationship. For example, a processing class for processing the prompt task when the call status is rejected can be set in the data processing system, and an association relationship with the status processing strategy is established. In this step, the processing class for processing the prompt task when the call status is rejected can be used as one of the processing class sets. In addition, in the embodiment of the present invention, a corresponding processing class set can also be configured for each status processing strategy to implement the status processing strategy.

[0071] It should be noted that, in the embodiment of the present invention, not all call service types are configured with corresponding status processing strategies, so the data processing system can preset a general status processing strategy so that if there is no corresponding status processing strategy, the general status processing strategy can be used. Specifically, it can be performed as follows: in response to not finding a status processing strategy corresponding to a call service type, the preset general status processing strategy is determined as the status processing strategy corresponding to the call service type.

[0072] S103: Monitor the call status of each terminal, match the call status with the processing class set, and obtain a matching result.

[0073] Among them, a monitoring module can be set in the data processing system to monitor the call status of each terminal participating in the audio and video call. Specifically, in the embodiment of the present invention, the call status can include multiple types, for example, busy, rejected, timed out, connected, hung up, etc. After obtaining the monitoring status of each terminal, the call status can be matched with the processing class of each prompt task for processing the call status in the processing class set to obtain a matching result. The matching result can include a successful match and a failed match. If the matching result is a successful match, it means that the call status belongs to a state that requires prompt processing, so it can be processed by the processing class that successfully matches; if the matching result is a failed match, it means that the call status does not belong to a state that requires prompt processing, so the call status can be not processed.

[0074] In some embodiments, since the call status of the terminal is usually not updated, it means that it maintains a call status, so there is no need for repeated reminders. Therefore, in the embodiments of the present invention, when the call status is monitored to be updated, the updated call status can be matched with the processing class set. Specifically, it can be performed as follows: compare the call status with the historical call status of the audio and video call; in response to the comparison result that the call status is updated, match the call status with the processing class set to obtain a matching result; in response to the comparison result that the call status is not updated, do not operate the call status. Among them, the historical call status of the audio and video call can specifically be the call status before and the most recent call status.

[0075] It should be noted that in an embodiment of the present invention, the call status of each terminal can be periodically monitored, and then the monitored call status and the corresponding monitoring time can be stored in a preset call details table, so that the historical call status of the audio and video calls can be determined to facilitate comparison of whether the call status is updated.

[0076] In some other embodiments, in some scenarios, if the audio and video call remains in a call state for a long time, reminder processing is also required. For example, if the audio and video call is in a connected state for a long time, a reminder of the call duration is required. Therefore, in the embodiments of the present invention, after the call status is obtained through monitoring, the duration of the audio and video remaining in the call state can also be determined based on the corresponding historical call status, and then matched with the processing class set to determine whether there is a processing class that matches successfully.

[0077] It should be noted that, in an embodiment of the present invention, a processing class set may include multiple processing classes, and each processing class can run in parallel. That is to say, the monitored processing status can be matched with each processing class at the same time, so as to obtain the successfully matched processing class in time, thereby improving the efficiency of call status prompts.

[0078] S104: In response to the matching result being a successful match, a successful match processing class is called to generate a call prompt message to be sent to each terminal.

[0079] Among them, after obtaining the matching result in step S103, if the matching result is a successful match, the processing class of the successful match can be run, that is, the processing class of the successful match can be called to generate a call prompt message, which is then sent to each terminal.

[0080] For example, taking an audio or video call between two people as an example, after calling the two terminals, when the data processing system monitors that the call status of one party is timed out, rejected or busy, it can successfully match the corresponding processing class. At this time, the processing class can generate a corresponding prompt message and send it to the other party's terminal.

[0081] In some other embodiments, since the functions of each terminal are different, the types of prompt messages that can be identified are also different. Therefore, in the embodiments of the present invention, the data terminal can first obtain the capability parameters of each terminal to determine the corresponding prompt type, and then call the successfully matched processing class to generate a call prompt message that matches the prompt type. Among them, the capability parameters can be set based on the scenario, such as voice prompt capability, SMS prompt capability, etc. For example, if a terminal has voice prompt capability, a call prompt message of the voice prompt type can be generated and sent in this step.

[0082] In some other embodiments, in order to improve the recognition of the prompt message and to meet the needs of different call service types, in the embodiments of the present invention, prompt message templates for each processing class can be corresponding to different call service types, and then when generating a call prompt message, the prompt message template corresponding to the call service type of the successfully matched processing class can be queried, and then the attribute parameters of the audio and video call can be replaced with the prompt message template to combine the prompt message template and the attribute parameters of the audio and video call to generate a call prompt message. Specifically, this step can be performed as follows: based on the call service type, query the prompt message template corresponding to the processing class; obtain the attribute parameters of the audio and video call to combine with the prompt message template to generate a call prompt message. Among them, the attribute parameters of the audio and video call can include the current call status of the audio and video call and the basic information of the audio and video call.

[0083] In some other embodiments, due to some abnormal behavior of one of the users participating in the audio and video call, the audio and video call can be terminated. For example, when one of the parties in the audio and video call is in the call state of rejection, busy, or hanging up, the entire audio and video call cannot continue, so the audio and video call can be terminated at this time. In the embodiment of the present invention, the call state that causes the end of the audio and video call can be set as a call abnormality type. After sending the call message in this step, it is further determined whether the call state is a call abnormality type. If so, an end call indication is sent to each terminal, that is, in response to the call state belonging to the call abnormality type, an end call indication is sent to each terminal to end the audio and video call.

[0084] In an embodiment of the present invention, in response to a processing instruction for an audio or video call, the corresponding terminals and call service types can be obtained to query the state processing strategy corresponding to the call service type to determine the call status processing class set. Therefore, after monitoring the call status of each terminal, the monitoring model can process it through the successfully matched processing class to prompt the terminal of different call statuses. In an embodiment of the present invention, the corresponding state processing strategy can be configured based on the call service type, and then the corresponding processing class set can be determined. Each processing class in the processing class set can be used to process different call statuses of audio or video calls, so that the status prompt requirements of different call service types can be met, and then personalized status prompts can be provided to the corresponding audio or video call users, thereby improving the audio and video call quality of the users.

[0085] It should be noted that in the embodiment of the present invention, the audio and video status can also be stored, such as the connected and ended status, so as to timely update the audio and video call information. At the same time, the audio and video call information can also be sent to each terminal so that each terminal can perform customized processing, such as differentiated service processing such as text messages and emails.

[0086] The following is a detailed description of the method for processing audio and video data in the embodiment of the present invention in combination with the above-mentioned embodiment. Figure 2 As shown, the method includes:

[0087] S201: In response to an instruction for processing an audio or video call, obtaining terminals and call service types corresponding to the audio or video call.

[0088] S202: Query the status processing strategy corresponding to the call service type.

[0089] S203: In response to not finding the status processing policy corresponding to the call service type, determining a preset general status processing policy as the status processing policy corresponding to the call service type.

[0090] S204: Determine a processing class set for the call status based on the status processing strategy corresponding to the call service type.

[0091] S205: Monitor the call status of each terminal, match the call status with the processing class set, and obtain a matching result.

[0092] S206: In response to the matching result being a successful match, obtaining capability parameters of each terminal to determine a corresponding prompt type.

[0093] S207: calling the successfully matched processing class to generate a call prompt message matching the prompt type, and sending it to each terminal.

[0094] It should be noted that the principle of data processing in the embodiment of the present invention is the same as Figure 1 The principles of corresponding data processing in the illustrated embodiments are the same and will not be described in detail here.

[0095] In combination with the above-mentioned embodiments, the method for processing audio and video data in the embodiment of the present invention is specifically described below by taking the online consultation scenario as an example. Figure 3 As shown, the method includes:

[0096] S301: receiving an audio or video call request to trigger an audio or video call processing instruction.

[0097] In the embodiment of the present invention, an online consultation scenario is taken as an example, so the service type of the audio and video call is an online consultation type, and the audio and video call is used for online consultation, so the participants of the audio and video call are the doctor side and the patient side. In this step, the audio and video call request can be sent by the doctor side or by the patient side. If the doctor side sends an audio and video call request, it can include the information of the patient to be called; if the doctor side sends an audio and video call request, it can include the information of the doctor to be called.

[0098] S302: In response to the processing instruction of the audio and video call, obtain the doctor end, patient end and call service type corresponding to the audio and video call.

[0099] Based on the audio and video call request, the data processing system can determine the terminal information that needs to make an audio and video call, and then obtain the doctor and patient ends of the audio and video call, as well as the call service type.

[0100] S303: Query the status processing strategy corresponding to the online consultation.

[0101] The data processing system can preset the state processing strategy of online consultation and establish the corresponding relationship between it and the call service type of online consultation to implement this step. If the state processing strategy of online consultation is set in the data processing system, the audio and video call can be processed by the general state processing strategy.

[0102] S304: In response to not finding a status processing policy corresponding to the call service type, determining a preset general status processing policy as a status processing policy corresponding to the online consultation.

[0103] In the embodiment of the present invention, the state processing strategy includes a call exception processing strategy and a call timeout reminder strategy, and the general state processing strategy includes a call exception processing strategy. The call exception processing strategy refers to sending corresponding prompt information to each terminal when one or more parties participating in the audio and video call are busy, hung up, etc., resulting in an audio and video call abnormality. The call timeout reminder strategy refers to sending corresponding prompt information to each terminal when the call duration after the audio and video call is connected exceeds a preset threshold.

[0104] In the embodiment of the present invention, a state processing strategy for online consultation that can be preset in a data processing system is taken as an example for explanation.

[0105] S305: Determine a call status processing class set based on a call exception processing strategy and a call timeout reminder strategy.

[0106] After determining the call exception handling strategy and call timeout reminder strategy, the corresponding processing class can be obtained, and then the processing class set can be obtained. Prompt tasks are established in the processing classes corresponding to the call exception handling strategy and the call timeout reminder strategy. The prompt task in the processing class corresponding to the call exception handling strategy is triggered by one or more parties participating in the audio and video call being busy, hanging up, etc., and after being triggered, an abnormal prompt message is sent to each terminal. The prompt task in the processing class corresponding to the call timeout reminder strategy is triggered by the call duration after the audio and video call is connected exceeding the preset threshold, and after being triggered, a timeout prompt message is sent to each terminal.

[0107] S306: Establish an audio and video call between the doctor side and the patient side, monitor the call status between the doctor side and the patient side, match the call status with the processing class set, and obtain a matching result.

[0108] The data processing system can establish an audio and video call between the two based on the audio and video call request, and monitor the call status of the doctor and the patient at the same time, so as to obtain the call status of the doctor and the patient in real time and match it with the task trigger conditions of each processing class in the processing class set to obtain a matching result.

[0109] It should be noted that, when matching the call status with the processing class set in this step, the matching of the call status with each processing class in the processing class set can be performed in parallel, so as to determine the matching result in time.

[0110] S307: In response to the matching result being a successful match, obtaining capability parameters of each terminal to determine a corresponding prompt type.

[0111] In the embodiment of the present invention, the case where the call timeout reminder strategy corresponding to the processing class matching result is a successful match is taken as an example, that is, the duration of the audio and video call between the doctor end and the patient end exceeds the preset threshold, so it is necessary to send a timeout reminder message to the doctor end and the patient end. In this step, after determining that the call timeout reminder strategy corresponding to the processing class matching result is a successful match, the capability parameters of each terminal can be obtained. For example, if the capability parameter of the doctor end is a voice prompt, it can be determined that the prompt type of the prompt message sent by the doctor end is voice, and if the capability parameter of the patient end is a short message prompt, it can be determined that the prompt type of the prompt message sent by the doctor end is a short message.

[0112] S308: Call the successfully matched processing class to generate a call prompt message matching the prompt type to be sent to the doctor side and the patient side.

[0113] It should be noted that the principle of data processing in the embodiment of the present invention is the same as Figure 1 The principles of corresponding data processing in the illustrated embodiments are the same and will not be described in detail here.

[0114] In order to solve the problems existing in the prior art, an embodiment of the present invention provides an apparatus 400 for processing audio and video data, such as Figure 4 As shown, the device 400 includes:

[0115] The acquisition unit 401 is used to respond to the processing instruction of the audio and video call and acquire each terminal and call service type corresponding to the audio and video call;

[0116] A determination unit 402, configured to query a state processing strategy corresponding to the call service type to determine a processing class set for the call state;

[0117] A matching unit 403, configured to monitor the call status of each terminal, match the call status with the processing class set, and obtain a matching result;

[0118] The prompt unit 404 is used to call the successful matching processing class in response to the matching result being a successful match, generate a call prompt message, and send it to each of the terminals.

[0119] It should be understood that the manner of implementing the embodiments of the present invention is different from the Figure 2 The method of the illustrated embodiment is the same and will not be repeated here.

[0120] In one embodiment, the matching unit 403 is specifically configured to:

[0121] Comparing the call status with the historical call status of the audio and video calls;

[0122] In response to the comparison result being that the call state is updated, matching the call state with the processing class set to obtain a matching result;

[0123] In response to the comparison result that the call status is not updated, no operation is performed on the call status.

[0124] In yet another embodiment, the prompting unit 404 is specifically configured to:

[0125] Acquire capability parameters of each of the terminals to determine a corresponding prompt type;

[0126] The matching successful processing class is called to generate a call prompt message matching the prompt type.

[0127] In yet another embodiment, the prompting unit 404 is specifically configured to:

[0128] Based on the call service type, query the prompt message template corresponding to the processing class;

[0129] The attribute parameters of the audio and video call are obtained to be combined with the prompt message template to generate a call prompt message.

[0130] In yet another embodiment, the apparatus 400 further includes:

[0131] The terminating unit is used for sending a call terminating instruction to each of the terminals in response to the call status belonging to the call abnormality type.

[0132] In yet another embodiment, the matching unit 403 is specifically configured to:

[0133] The call status of each terminal is monitored based on a preset period, and the call status and the corresponding monitoring time are stored in a call details table to determine the historical call status of the audio and video call.

[0134] In yet another embodiment, the determining unit 402 is specifically configured to:

[0135] In response to not finding the status processing policy corresponding to the call service type, a preset general status processing policy is determined as the status processing policy corresponding to the call service type.

[0136] It should be understood that the manner of implementing the embodiments of the present invention is different from the Figure 2 The method of the illustrated embodiment is the same and will not be repeated here.

[0137] In an embodiment of the present invention, in response to a processing instruction for an audio or video call, the corresponding terminals and call service types can be obtained to query the state processing strategy corresponding to the call service type to determine the call status processing class set. Therefore, after monitoring the call status of each terminal, the monitoring model can process it through the successfully matched processing class to prompt the terminal of different call statuses. In an embodiment of the present invention, the corresponding state processing strategy can be configured based on the call service type, and then the corresponding processing class set can be determined. Each processing class in the processing class set can be used to process different call statuses of audio or video calls, so that the status prompt requirements of different call service types can be met, and then personalized status prompts can be provided to the corresponding audio or video call users, thereby improving the audio and video call quality of the users.

[0138] According to an embodiment of the present invention, the embodiment of the present invention further provides an electronic device and a readable storage medium.

[0139] The electronic device of an embodiment of the present invention includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the one processor, and the instructions are executed by the at least one processor so that the at least one processor executes the method for processing audio and video data provided by the embodiment of the present invention.

[0140] Figure 5 An exemplary system architecture 500 is shown to which the method or apparatus for processing audio and video data according to the embodiments of the present invention may be applied.

[0141] like Figure 5 As shown, system architecture 500 may include terminal devices 501, 502, 503, a network 504 and a server 505. Network 504 is used to provide a medium for communication links between terminal devices 501, 502, 503 and server 505. Network 504 may include various connection types, such as wired, wireless communication links or optical fiber cables, etc.

[0142] The user can use the terminal devices 501, 502, 503 to interact with the server 505 through the network 504 to receive or send messages, etc. Various client applications can be installed on the terminal devices 501, 502, 503.

[0143] The terminal devices 501 , 502 , and 503 may be, but are not limited to, smart phones, tablet computers, laptop computers, and desktop computers, etc.

[0144] The server 505 may be a server that provides various services. The server may analyze and process the received data such as the product information query request, and feed back the processing result (such as product information - just an example) to the terminal device.

[0145] It should be noted that the method for processing audio and video data provided in the embodiment of the present invention is generally executed by the server 505 , and accordingly, the data processing device is generally arranged in the server 505 .

[0146] It should be understood that Figure 5 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to implementation requirements.

[0147] Reference below Figure 6 , which shows a schematic diagram of the structure of a computer system 600 suitable for implementing an embodiment of the present invention. Figure 6 The computer system shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0148] like Figure 6 As shown, the computer system 600 includes a central processing unit (CPU) 601, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 602 or a program loaded from a storage part 608 into a random access memory (RAM) 603. In the RAM 603, various programs and data required for the operation of the system 600 are also stored. The CPU 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

[0149] The following components are connected to the I / O interface 605: an input section 606 including a keyboard, a mouse, etc.; an output section 607 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 608 including a hard disk, etc.; and a communication section 609 including a network interface card such as a LAN card, a modem, etc. The communication section 609 performs communication processing via a network such as the Internet. A drive 610 is also connected to the I / O interface 605 as needed. A removable medium 611, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 610 as needed, so that a computer program read therefrom is installed into the storage section 608 as needed.

[0150] In particular, according to the embodiments disclosed in the present invention, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present invention include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 609, and / or installed from the removable medium 611. When the computer program is executed by the central processing unit (CPU) 601, the above-mentioned functions defined in the system of the present invention are executed.

[0151] It should be noted that the computer-readable medium shown in the present invention may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present invention, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0152] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present invention. In this regard, each box in the flow chart or block diagram can represent a unit, a program segment, or a part of a code, and the above-mentioned unit, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0153] The units involved in the embodiments of the present invention may be implemented by software or hardware. The units described may also be set in a processor, for example, it may be described as: a processor includes an acquisition unit, a determination unit, a matching unit, and a prompting unit. The names of these units do not constitute a limitation on the units themselves in some cases, for example, the acquisition unit may also be described as a "unit for acquiring a call service type".

[0154] As another aspect, the present invention further provides a computer-readable medium, which may be included in the device described in the above embodiment; or may exist independently without being assembled into the device. The above computer-readable medium carries one or more programs, and when the above one or more programs are executed by a device, the device executes the method for processing audio and video data provided by the present invention.

[0155] As another aspect, the present invention further provides a computer program product, including a computer program, which, when executed by a processor, implements the method for processing audio and video data provided by an embodiment of the present invention.

[0156] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may occur depending on design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A method for processing audio and video data, characterized in that: include: In response to an audio or video call processing instruction, obtaining each terminal and call service type corresponding to the audio or video call, the processing instruction including an identifier of the call service type, wherein the identifier of the call service type is selected by the user when initiating the audio or video call; Querying the state processing strategy corresponding to the call service type to determine a set of processing classes for the call state, wherein processing classes for prompting tasks corresponding to different call states are set, and an association relationship with each processing class is established based on the requirements of the state processing strategy; Monitoring the call status of each of the terminals, matching the call status with the processing class set, and obtaining a matching result; In response to the matching result being a successful match, a successful match processing class is called to generate a call prompt message to be sent to each of the terminals.

2. The method according to claim 1, characterized in that Matching the call status with the processing class set to obtain a matching result, including: Comparing the call status with the historical call status of the audio and video calls; In response to the comparison result being that the call state is updated, matching the call state with the processing class set to obtain a matching result; In response to the comparison result that the call status is not updated, no operation is performed on the call status.

3. The method according to claim 1, characterized in that Call the matching successful processing class to generate a call prompt message, including: Acquire capability parameters of each of the terminals to determine a corresponding prompt type; The matching successful processing class is called to generate a call prompt message matching the prompt type.

4. The method according to claim 1, characterized in that Call the matching successful processing class to generate a call prompt message, including: Based on the call service type, query the prompt message template corresponding to the processing class; The attribute parameters of the audio and video call are obtained to be combined with the prompt message template to generate a call prompt message.

5. The method according to claim 1, characterized in that After sending to each of the terminals, it also includes: In response to the call status belonging to the call abnormality type, sending a call end instruction to each of the terminals.

6. The method according to claim 1, characterized in that Monitoring the call status of each terminal includes: The call status of each terminal is monitored based on a preset period, and the call status and the corresponding monitoring time are stored in a call details table to determine the historical call status of the audio and video call.

7. The method according to claim 1, characterized in that Querying the status processing strategy corresponding to the call service type includes: In response to not finding the status processing policy corresponding to the call service type, a preset general status processing policy is determined as the status processing policy corresponding to the call service type.

8. A device for processing audio and video data, characterized in that: include: an acquisition unit, configured to acquire, in response to a processing instruction for an audio or video call, each terminal and a call service type corresponding to the audio or video call, wherein the processing instruction includes an identifier of the call service type, wherein the identifier of the call service type is selected by the user when initiating the audio or video call; A determination unit, used to query the state processing strategy corresponding to the call service type to determine a set of processing classes for the call state, wherein processing classes corresponding to prompt tasks for different call states are set, and an association relationship with each processing class is established based on the requirements of the state processing strategy; A matching unit, used for monitoring the call status of each terminal, matching the call status with the processing class set, and obtaining a matching result; The prompt unit is used to call the successful matching processing class in response to the matching result being a successful match, generate a call prompt message, and send it to each of the terminals.

9. An electronic device, characterized in that: include: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 7.

10. A computer readable medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Images