An audio and video transcoding method, device, equipment and medium

Abstract

The application discloses an audio and video transcoding method, device and equipment and medium. The method is executed by a SIP server, the SIP server comprises a plug-in media board, at least one plug-in transcoding component is configured on the media board, and the method comprises the following steps: acquiring a source audio and video format of a source SIP terminal initiating an audio and video call and a target audio and video format of a target SIP terminal answering the audio and video call; when the source audio and video format is inconsistent with the target audio and video format, locating a source transcoding component matched with the source audio and video format and a target transcoding component matched with the target audio and video format in each media board; and performing bidirectional transcoding on audio and video content interacted between the source SIP terminal and the target SIP terminal by calling the source transcoding component and the target transcoding component. The technical scheme of the application solves the problem of fixed transcoding capacity of an existing integrated SIP server, and avoids the influence of damage of a single transcoding component on the overall function of the SIP server.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of multimedia communication, and in particular to an audio and video transcoding method, device, equipment and medium. BACKGROUND

[0002] Under the background of rapid development of information technology, the economy and technology level of our country is continuously improved, and people's dependence on computer network in daily life also increases. Multimedia communication technology, which is combined by multimedia technology and communication technology, is the main way of modern information flow and the basis for the continuous development of society.

[0003] With the continuous development of network multimedia conference, more and more users in various industries participate in the use of SIP (Session Initiation Protocol) conference. There are various brands of SIP servers on the market, which support one or more audio and video transcoding formats by integrating one or more transcoding components.

[0004] The inventor found that the prior art has the following defects in the process of implementing the present application: the above-mentioned integrated design makes the audio and video transcoding formats supported by the SIP server fixed after it leaves the factory, and cannot be dynamically updated, which has poor versatility. In addition, even if the transcoding component not used in the SIP server is damaged, it will affect the overall function of the SIP server, reduce the work efficiency and increase the maintenance cost. SUMMARY

[0005] The present application provides an audio and video transcoding method, device, equipment and medium, which realizes the generalization and modularization of audio and video transcoding in SIP conference under the premise of maximizing the audio and video transcoding capability.

[0006] In a first aspect, the present application embodiment provides an audio and video transcoding method, which is executed by a SIP server, and the SIP server includes at least one pluggable media board, each media board is configured with at least one pluggable transcoding component, and each transcoding component is used to realize the bidirectional conversion between the set audio and video format and the reference audio and video format. The method comprises the following steps:

[0007] Obtaining the source audio and video format of the source SIP terminal initiating the audio and video call, and the target audio and video format of the target SIP terminal answering the audio and video call;

[0008] When the source audio and video format and the target audio and video format are inconsistent, locating the source transcoding component matched with the source audio and video format and the target transcoding component matched with the target audio and video format in each media board;

[0009] The audio and video content exchanged between the source SIP terminal and the target SIP terminal is bidirectionally transcoded by calling the source transcoding component and the target transcoding component.

[0010] In a second aspect, the embodiment of the present application further provides an audio and video transcoding device, which is executed by a SIP server, wherein the SIP server comprises at least one pluggable media board, each of the media boards is configured with at least one pluggable transcoding component, and each of the transcoding components is used to realize bidirectional conversion between a set audio and video format and a reference audio and video format, and the device comprises:

[0011] An audio and video format acquisition module, configured to acquire a source audio and video format of a source SIP terminal initiating an audio and video call and a target audio and video format of a target SIP terminal answering the audio and video call;

[0012] A transcoding component positioning module, configured to position a source transcoding component matched with the source audio and video format and a target transcoding component matched with the target audio and video format in the media boards when the source audio and video format is inconsistent with the target audio and video format;

[0013] A transcoding module, configured to bidirectionally transcode the audio and video content exchanged between the source SIP terminal and the target SIP terminal by calling the source transcoding component and the target transcoding component.

[0014] In a third aspect, the embodiment of the present application further provides a SIP server, which comprises:

[0015] At least one pluggable media board, each of the media boards is configured with at least one pluggable transcoding component, and each of the transcoding components is used to realize bidirectional conversion between a set audio and video format and a reference audio and video format;

[0016] At least one processor; and

[0017] A memory in communication connection with the at least one processor; wherein,

[0018] The memory stores a computer program which can be executed by the at least one processor, and the computer program is executed by the at least one processor to enable the at least one processor to execute the audio and video transcoding method provided by any of the embodiments of the present application.

[0019] In a fourth aspect, the embodiment of the present application further provides a computer readable storage medium, which stores a computer instruction, and the computer instruction is used to enable a processor to execute the audio and video transcoding method provided by any of the embodiments of the present application.

[0020] The embodiment of the present application provides an audio and video transcoding method, device, equipment and medium, which are executed by a session initiation protocol (SIP) server, the SIP server comprises at least one pluggable media board, at least one pluggable transcoding component is configured on each media board, the source audio and video format of a source SIP terminal initiating an audio and video call and the target audio and video format of a target SIP terminal answering the audio and video call are acquired; when the source audio and video format is inconsistent with the target audio and video format, a source transcoding component matched with the source audio and video format and a target transcoding component matched with the target audio and video format are located in each media board; the audio and video content interacted between the source SIP terminal and the target SIP terminal is bidirectionally transcoded by calling the source transcoding component and the target transcoding component. By adopting the technical scheme, the SIP server comprises at least one pluggable media board and at least one pluggable transcoding component, when the source audio and video format received by the SIP server is inconsistent with the target audio and video format, the transcoding components matched with the source audio and video format and the target audio and video format can be respectively found in each media board inserted in advance, different transcoding components are called to realize bidirectional transcoding on different audio and video content. The problem that the audio and video transcoding capability cannot be increased by increasing the media board and the media board needs to be repaired to repair the whole equipment when damaged in the prior art is solved, the user can insert and plug the media board and the transcoding component according to own demand on the premise of increasing the audio and video transcoding capability to the maximum, the working efficiency is improved, and the cost of updating and maintaining is reduced.

[0021] It should be understood that the content described in this part is not intended to identify key or important features of the embodiments of the present application, nor is it used to limit the scope of the present application. Other features of the present application will become apparent from the following description. BRIEF DESCRIPTION OF DRAWINGS

[0022] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed in the embodiment description will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative effort.

[0023] Figure 1 is a flowchart of an audio and video transcoding method according to the embodiment one of the present application;

[0024] Figure 2 is a flowchart of a method for acquiring a source audio and video format and a target audio and video format according to the embodiment one of the present application;

[0025] Figure 3 is a flowchart of an audio and video transcoding method according to the embodiment two of the present application;

[0026] Figure 4 is a flow chart of periodically polling the current configured transcode components in each media board currently mounted according to the third embodiment of the present application;

[0027] Figure 5 is a structural schematic diagram of an audio and video transcoding device according to the fourth embodiment of the present application;

[0028] Figure 6 is a structural schematic diagram of a SIP server according to the fifth embodiment of the present application. DETAILED DESCRIPTION

[0029] In order to make the personnel in the art better understand the present application, the technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work should belong to the scope of protection of the present application.

[0030] It should be noted that the terms "first", "second", and the like in the specification and claims of the present application and the above-described drawings are used to distinguish similar objects, and do not necessarily have to describe a specific order or a sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device including a series of steps or units does not have to be limited to those steps or units clearly listed, but can include other steps or units not clearly listed or inherent to these processes, methods, products or devices.

[0031] Embodiment One

[0032] Figure 1 A flow chart of an audio and video transcoding method provided for the first embodiment of the present application, the present embodiment can be applicable to the case of needing to transcode different audio and video formats in a SIP conference. The method can be executed by an audio and video transcoding device, which can be realized in the form of hardware and / or software. The audio and video transcoding device can be configured in a computer device, which can be a tower server, a desktop computer, a notebook computer, etc. with SIP server function.

[0033] The audio and video transcoding method is executed by a SIP server, the SIP server comprises at least one plug-in media board, each media board is configured with at least one plug-in transcoding component, and each transcoding component is used to realize bidirectional conversion between a set audio and video format and a reference audio and video format.

[0034] In the embodiment, the plug-in media board can be understood as a plug-in board card or a circuit board for realizing audio and video transcoding and comprising a plurality of plug-in transcoding components. The plug-in transcoding component can be understood as a plug-in board card or a circuit board for realizing bidirectional conversion between one or more audio and video formats and a reference audio and video format. The set audio and video format can be understood as all audio and video formats that can be recognized and converted by any plug-in transcoding component. The reference audio and video format can be understood as a specific and universal audio and video format that is set in advance in the SIP server and can comprise avi, dat, mkv, flv and vob.

[0035] Specifically, the number of media boards inserted in the SIP server and the number and types of transcoding components inserted on each media board can be configured according to the actual application scene of the SIP server. It can be understood that the purpose of setting the reference audio and video format is to realize bidirectional audio and video format conversion between SIP terminals of different audio and video formats.

[0036] As shown in Figure 1 , the method comprises:

[0037] S110, obtaining a source audio and video format of a source SIP terminal initiating an audio and video call and a target audio and video format of a target SIP terminal answering the audio and video call.

[0038] In the embodiment, the source SIP terminal can be understood as a terminal initiating an audio and video conference call and can comprise terminal devices such as computers, mobile phones and smart tablets. The source audio and video format can be understood as an audio and video format set in advance by the source SIP terminal and can comprise avi, flv, mkv and wmv. The target SIP terminal can be understood as a terminal answering an audio and video conference call and can comprise terminal devices such as computers, mobile phones and smart tablets. The target audio and video format can be understood as an audio and video format set in advance by the target SIP terminal and can comprise avi, flv, mkv and wmv.

[0039] Specifically, when the SIP server receives an audio and video transcoding request, the source audio and video format of the source SIP terminal initiating the audio and video call and the target audio and video format of the target SIP terminal answering the audio and video call need to be obtained, and the next step is determined according to whether the source audio and video format is consistent with the target audio and video format.

[0040] Further, after the SIP server acquires the source audio / video format of the source SIP terminal, the SIP server can first detect whether the source audio / video format is included in all audio / video formats supported by the source SIP terminal, and if not, directly request the source SIP terminal to convert the source audio / video format into an audio / video format supported by the SIP server, and then perform subsequent operations.

[0041] Optionally, Figure 2 A flowchart of a method for acquiring a source audio / video format and a target audio / video format provided for the first embodiment of the application is shown in Figure 2 The method comprises the following steps:

[0042] S1101, when detecting an audio / video call request sent by a source SIP terminal, extracting a source audio / video format included in the audio / video call request, and a target SIP terminal.

[0043] In this embodiment, the audio / video call request can be understood as a SIP audio / video conference request or signal initiated by any terminal on a network. The audio / video call request can include a source SIP terminal, a SIP server, a target SIP terminal, a source audio / video format, and a call request.

[0044] Specifically, when the SIP server receives an audio / video call request or signal initiated by a source SIP terminal, the SIP server decodes or processes the received audio / video call request or signal, and extracts a source audio / video format and a target SIP terminal of the request or signal.

[0045] S1102, polling each transcoding component configured in each media board currently mounted to acquire all audio / video formats currently supported by the SIP server.

[0046] In this embodiment, polling can be understood as searching from head to tail in the SIP server.

[0047] Specifically, when the SIP server extracts a source audio / video format and a target SIP terminal, the SIP server searches from head to tail each transcoding component configured in each media board currently inserted to acquire all audio / video formats currently supported by the SIP server.

[0048] S1103, constructing a transit call request according to all audio / video formats and sending the transit call request to the target SIP terminal.

[0049] In this embodiment, the transit call request can be understood as a request or signal sent to a target SIP terminal after a specific processing of an audio / video call request or signal initiated by a source SIP terminal when the SIP server receives the request or signal. The transit call request can include a source SIP terminal, a SIP server, a target SIP terminal, all audio / video formats currently supported, and a call request.

[0050] The SIP server can also send the source audio and video format of the source SIP terminal as the preferred audio and video format to be used when sending the call request to the target SIP terminal.

[0051] S1104. When the response is received from the target SIP terminal, the target audio and video format included in the response is extracted.

[0052] The target audio and video format is a subset of the complete audio and video format.

[0053] Specifically, when the SIP server receives the audio and video call response or signal from the target SIP terminal, the response can include information such as the target SIP terminal, the SIP server, the source SIP terminal, the target audio and video format, and the response. The received response is decoded and processed to extract the target audio and video format of the response.

[0054] It should be noted that if the response from the target SIP terminal does not include any of the above complete audio and video formats, the SIP server can feed back to the source SIP terminal that the format is not supported and that the SIP conference cannot be established. At the same time, the SIP server can also request the target SIP terminal for the audio and video formats it can support and generate prompt information for inserting the transcoding components of the above audio and video formats into the SIP server.

[0055] S120. When the source audio and video format is inconsistent with the target audio and video format, locate the source transcoding component that matches the source audio and video format in each media board, and locate the target transcoding component that matches the target audio and video format in each media board.

[0056] Specifically, if the source audio and video format obtained by the SIP server is inconsistent with the target audio and video format, the source transcoding component that can transcode the source audio and video format needs to be found in each media board. The source transcoding component can convert the source audio and video format and the reference audio and video format to each other. The target transcoding component that can transcode the target audio and video format needs to be found in each media board. The target transcoding component can convert the target audio and video format and the reference audio and video format to each other. As described above, it can be understood that when the source audio and video format obtained by the SIP server is consistent with the target audio and video format, the transcoding component does not need to be introduced for bidirectional transcoding. The SIP server only needs to realize the audio and video forwarding between the source SIP terminal and the target SIP terminal.

[0057] S130. The source transcoding component and the target transcoding component are called to bidirectionally transcode the audio and video content exchanged between the source SIP terminal and the target SIP terminal.

[0058] Specifically, when the source audio and video format acquired by the SIP server is inconsistent with the target audio and video format, the audio and video content exchanged between the source SIP terminal and the target SIP terminal is bidirectionally transcoded by calling the source transcoding component matched with the source audio and video format and the target transcoding component matched with the target audio and video format.

[0059] For example, an employee A of a company needs to have a conference with a customer B through a SIP server, wherein the reference audio and video format of the SIP server is rmvb, the terminal device used by the employee A is a notebook computer, the audio and video format of the notebook computer is mp4, and the terminal device used by the customer B is a mobile phone, and the audio and video format of the mobile phone is mov. First, the employee A initiates an audio and video call request to the SIP server, and when the SIP server receives the request, the audio and video format mp4 of the employee A and the customer B are extracted. The currently configured transcoding components in each media board are polled to acquire all the audio and video formats currently supported by the SIP server, and a transfer call request is constructed and sent to the mobile phone terminal of the customer B. The customer B responds to the request and makes a response, and the SIP server responds to the response of the customer B, extracts the audio and video format mov of the customer B, locates the transcoding component matched with the mp4 format and the transcoding component matched with the mov format in each media board, and calls the transcoding component of mp4 and the transcoding component of mov to bidirectionally transcode the audio and video content exchanged between the employee A and the customer B by taking rmvb as a conversion bridge.

[0060] The technical scheme of the embodiment acquires the source audio and video format of the source SIP terminal initiating an audio and video call and the target audio and video format of the target SIP terminal responding to the audio and video call, locates the source transcoding component matched with the source audio and video format and the target transcoding component matched with the target audio and video format in each media board when the source audio and video format is inconsistent with the target audio and video format, and bidirectionally transcodes the audio and video content exchanged between the source SIP terminal and the target SIP terminal by calling the source transcoding component and the target transcoding component. Different from the technical scheme of using a single media board to transcode audio and video in a conventional SIP conference, the capacity of audio and video transcoding is increased by adding the pluggable media board, so that the audio and video transcoding is not limited to a certain machine, and the pluggable transcoding component subdivides the function, and the damage of a single transcoding component will not affect the overall function.

[0061] Embodiment Two

[0062] Figure 3 A flowchart of an audio and video transcoding method provided for the embodiment two of the application, the embodiment is further optimized and extended based on the above-mentioned embodiment and can be combined with each optional technical scheme in the above-mentioned embodiments. As shown in the figure, the method comprises the following steps. Figure 3

[0063] ​S210, acquire a source audio / video format of a source SIP terminal initiating an audio / video call and a target audio / video format of a target SIP terminal answering the audio / video call.

[0064] S220, query a pre-constructed board card channel mapping table to acquire a source channel number on a source media board matching the source audio / video format and a target channel number on a target media board matching the target audio / video format.

[0065] In the board card channel mapping table, channel numbers of various audio / video formats supported by each media board on the corresponding media board are stored, and different channel numbers correspond to different transcoding components.

[0066] In the embodiment, the source channel number can be understood as a channel number of a source transcoding component matching the source audio / video format on a source media board. The target channel number can be understood as a channel number of a target transcoding component matching the target audio / video format on a target media board. The source media board and the target media board can be the same or different.

[0067] Specifically, when the source audio / video format and the target audio / video format received by the SIP server are inconsistent, a board card channel mapping table built in the SIP server is queried. The board card channel mapping table can store channel numbers of various audio / video formats supported by each media board currently inserted into the SIP server. Different channel numbers correspond to different transcoding components. According to the one-to-one correspondence between the channel numbers and the transcoding components, a source channel number on a source media board matching the source audio / video format is acquired, a source transcoding component is found, and a target channel number on a target media board matching the target audio / video format is acquired, a target transcoding component is found.

[0068] Specifically, when the SIP server detects a media board plugging event or a transcoding component plugging event, a polling operation for each transcoding component on each media board is triggered to update the board card channel mapping table in real time.

[0069] S230, when the first audio / video content sent by the source SIP terminal is received, the source transcoding component is called using the source channel number to convert the first audio / video content in the source audio / video format into the first audio / video content in the reference audio / video format.

[0070] Specifically, when the SIP server receives the first audio / video content sent by the source SIP terminal, the pre-constructed board card channel mapping table is queried to acquire the source channel number on the source media board matching the source audio / video format. The source transcoding component matching the source audio / video format is located according to the source channel number, and the source transcoding component is called to convert the first audio / video content in the source audio / video format into the first audio / video content in the reference audio / video format.

[0071] S240, calling the target transcoding component using the target channel number, converting the first audio and video content in the reference audio and video format into the first audio and video content in the target audio and video format, and sending to the target SIP terminal.

[0072] Specifically, a board card channel mapping table is queried to obtain a target channel number on a target media board matched with the target audio and video format, the target transcoding component matched with the target audio and video format is located according to the target channel number, the target transcoding component is called to convert the first audio and video content in the reference audio and video format into the first audio and video content in the target audio and video format, and then the first audio and video content in the target audio and video format is sent to the target SIP terminal.

[0073] S250, when the second audio and video content sent by the target SIP terminal is received, the target transcoding component is called using the target channel number, and the second audio and video content in the target audio and video format is converted into the second audio and video content in the reference audio and video format.

[0074] Specifically, when the second audio and video content sent by the target SIP terminal is received by the SIP server, a board card channel mapping table is queried to obtain a target channel number on a target media board matched with the target audio and video format, the target transcoding component matched with the target audio and video format is located according to the target channel number, the target transcoding component is called to convert the second audio and video content in the target audio and video format into the second audio and video content in the reference audio and video format.

[0075] S260, calling the source transcoding component using the source channel number, converting the second audio and video content in the reference audio and video format into the second audio and video content in the source audio and video format, and sending to the source SIP terminal.

[0076] Specifically, a board card channel mapping table is queried to obtain a source channel number on a source media board matched with the source audio and video format, the source transcoding component matched with the source audio and video format is located according to the source channel number, the source transcoding component is called to convert the second audio and video content in the reference audio and video format into the second audio and video content in the source audio and video format, and then the second audio and video content in the source audio and video format is sent to the source SIP terminal.

[0077] In the audio and video transcoding process, the operations S230 and S250 can be selectively executed, that is, the SIP server can select to call the source transcoding component or the target transcoding component according to whether the received audio and video content is sent by the source SIP terminal or the target SIP terminal, and the embodiment does not make specific limitation.

[0078] For example, an employee A of a company needs to have a conference with a client B through a SIP server, the SIP server has a reference audio and video format of rmvb, the audio and video format of the device used by A is mp4, and the audio and video format of the device used by B is mov, at this time, at least one media board needs to be inserted in the SIP server, two transcoding components need to be configured on the media board, and a board card channel mapping table of the two transcoding components is constructed, which are the transcoding component of mp4 corresponding to channel 001 and the transcoding component of mov corresponding to channel 002. When A has a conference with B, the SIP server obtains the audio and video formats corresponding to the terminals of the two parties respectively, then obtains channel 001 and channel 002 in the media board, locates the transcoding component of mp4 and the transcoding component of mov, calls the transcoding component of mp4 to transcode the mp4 format sent by A into the rmvb format, calls the transcoding component of mov to transcode the rmvb format into the mov format and sends it to the device of B. The transcoding component of mov is called to transcode the mov format sent by B into the rmvb format, the transcoding component of mp4 is called to transcode the rmvb format into the mp4 format and send it to the device of A, thus, the bidirectional transcoding of the audio and video content between the device used by A and the device used by B is completed.

[0079] The technical scheme of the embodiment, according to the pre-constructed board card channel mapping table of each media board supporting various audio and video formats on the media board, obtains a source channel number and / or a target channel number, calls the transcoding component using the channel number, converts the source audio and video format or the target audio and video format into the reference audio and video format, and then calls the transcoding component using the channel number to convert the reference audio and video format into the target audio and video format or the source audio and video format and send it to the target SIP terminal or the source SIP terminal. Through the above technical scheme, the media board and the transcoding component are connected through the coding of the channel number, which avoids the problems of slow or incorrect positioning of the transcoding component, and improves the work efficiency and accuracy.

[0080] Embodiment three

[0081] Figure 4 A flowchart for periodically polling the available states of the configured transcoding components in the currently mounted media boards is provided for the third embodiment of the application, the embodiment is further optimized and extended based on the above-mentioned embodiments, and can be combined with the optional technical schemes in the above-mentioned embodiments. As shown in the figure, the method comprises: Figure 4

[0082] S310, periodically polling the available states of the configured transcoding components in the currently mounted media boards.

[0083] In the embodiment, the periodic polling can be understood as periodically or every certain time from beginning to end in the SIP server. ​

[0084] Specifically, in the SIP conference, the SIP server can find that a media board or a transcode component on the media board is out of order or damaged, and therefore the SIP server can be configured to periodically poll the availability status of each transcode component currently configured in each media board currently mounted.

[0085] S320, if it is determined that the first transcode component on the first media board is abnormal, updating the board card channel mapping table according to the first media board and the channel number matched with the first transcode component.

[0086] Specifically, if it is found in the periodic polling process that the first transcode component on the first media board is abnormal, the channel number of the first transcode component in the first media board is located, and the board card channel mapping table is updated according to the channel number. It can be understood that the SIP server finds the abnormal transcode component and ensures that only the channel numbers of available transcode components are stored in the board card channel mapping table by updating the board card channel mapping table.

[0087] S330, lighting the plug-in indication light matched with the first transcode component on the first media board to prompt the plug-in replacement of the first transcode component.

[0088] Specifically, the SIP server needs to prompt the user that the first transcode component is abnormal, and can prompt the user to plug in and replace the first transcode component by lighting the plug-in indication light matched with the first transcode component on the first media board.

[0089] S340, if it is determined that all transcode components on the second media board are abnormal, updating the board card channel mapping table according to the second media board.

[0090] Specifically, if it is found in the periodic polling process that all transcode components on the second media board are abnormal, the board card channel mapping table needs to be updated according to the second media board. It can be understood that the SIP server finds the abnormal media board and ensures that only the channel numbers of the transcode components on the available media board are stored in the board card channel mapping table by updating the board card channel mapping table.

[0091] S350, lighting the plug-in indication light matched with the second media board to prompt the plug-in replacement of the second media board.

[0092] Specifically, the SIP server needs to prompt the user that the second media board is abnormal, and can prompt the user to plug in and replace the second media board by lighting the plug-in indication light matched with the second media board.

[0093] The operations S320 and S340 can be selectively performed, that is, the SIP server can select to update part of the channel numbers or all of the channel numbers of the board card channel mapping table according to whether one or more transcoding components on any media board is abnormal or whether all transcoding components on any media board is abnormal, and the embodiment is not limited in this regard.

[0094] According to the embodiment, the available state of each transcoding component currently configured in each currently mounted media board is periodically polled to determine whether one or more transcoding components on any media board is abnormal or whether all transcoding components on any media board is abnormal, to update the board card channel mapping table and light the corresponding plug-in indicator lamp. Through the above technical solution, the influence of one transcoding component or a single media board on the overall function is avoided, the work efficiency is improved, and the maintenance cost is reduced.

[0095] Embodiment Four

[0096] Figure 5 A structural schematic diagram of an audio and video transcoding device provided by the fourth embodiment of the application. The embodiment can be applied to a scene in which audio and video transcoding is required in a SIP conference, and the embodiment is not limited in this regard. The audio and video transcoding device is executed by a SIP server, the SIP server includes at least one pluggable media board, each media board is configured with at least one pluggable transcoding component, and each transcoding component is used to realize bidirectional conversion between a set audio and video format and a reference audio and video format. As shown in the figure, the audio and video transcoding device includes an audio and video format acquisition module 41, a transcoding component positioning module 42, and a transcoding module 43. Figure 5

[0097] The audio and video format acquisition module 41 is used to acquire a source audio and video format of a source SIP terminal initiating an audio and video call and a target audio and video format of a target SIP terminal answering the audio and video call. The transcoding component positioning module 42 is used to locate a source transcoding component matching the source audio and video format and a target transcoding component matching the target audio and video format in each media board when the source audio and video format is inconsistent with the target audio and video format. The transcoding module 43 performs bidirectional transcoding on audio and video content exchanged between the source SIP terminal and the target SIP terminal by calling the source transcoding component and the target transcoding component.

[0098] ​The technical scheme of the embodiment comprises the following steps: obtaining a source audio / video format of a source SIP terminal initiating an audio / video call and a target audio / video format of a target SIP terminal answering the audio / video call; when the source audio / video format is inconsistent with the target audio / video format, locating a source transcoding component matching the source audio / video format and a target transcoding component matching the target audio / video format in each media board; and calling the source transcoding component and the target transcoding component to bidirectionally transcode audio / video content exchanged between the source SIP terminal and the target SIP terminal. Different from the technical scheme of using a single media board to transcode audio / video in a conventional SIP conference, the technical scheme increases the capacity of audio / video transcoding by adding pluggable media boards, so that the capacity is not limited to a certain machine, and the pluggable transcoding components subdivide functions, so that damage of a single transcoding component does not affect the overall function.

[0099] On the basis of the above embodiments, the audio / video format obtaining module 41 can comprise:

[0100] A call request extracting unit is configured to extract a source audio / video format included in an audio / video call request and a target SIP terminal when detecting that the audio / video call request is sent by the source SIP terminal.

[0101] A total audio / video format obtaining unit is configured to poll each transcoding component currently configured in each media board currently mounted to obtain all audio / video formats currently supported by the SIP server.

[0102] A transit call request sending unit is configured to construct a transit call request according to the total audio / video format and send the transit call request to the target SIP terminal.

[0103] A response extracting unit is configured to extract a target audio / video format included in a response when receiving the response fed back by the target SIP terminal.

[0104] The target audio / video format is a subset of the total audio / video format.

[0105] On the basis of the above embodiments, the transcoding component locating module 42 can comprise:

[0106] A channel number obtaining unit is configured to query a pre-constructed board card channel mapping table to obtain a source channel number on a source media board matching the source audio / video format and a target channel number on a target media board matching the target audio / video format. In the board card channel mapping table, the channel numbers of each audio / video format supported by each media board on the media board are stored, and different channel numbers correspond to different transcoding components.

[0107] On the basis of the above embodiments, the transcoding module 43 can comprise:

[0108] The first audio / video content conversion unit is configured to convert the first audio / video content in the source audio / video format into the first audio / video content in the reference audio / video format by calling the source transcoding component using the source channel number when the first audio / video content sent by the source SIP terminal is received.

[0109] The first audio / video content sending unit is configured to send the first audio / video content in the target audio / video format to the target SIP terminal after converting the first audio / video content in the reference audio / video format into the first audio / video content in the target audio / video format by calling the target transcoding component using the target channel number.

[0110] The second audio / video content conversion unit is configured to convert the second audio / video content in the target audio / video format into the second audio / video content in the reference audio / video format by calling the target transcoding component using the target channel number when the second audio / video content sent by the target SIP terminal is received.

[0111] The second audio / video content sending unit is configured to send the second audio / video content in the source audio / video format to the source SIP terminal after converting the second audio / video content in the reference audio / video format into the second audio / video content in the source audio / video format by calling the source transcoding component using the source channel number.

[0112] On the basis of the above-mentioned embodiments, the following can also be included:

[0113] The periodic polling unit is configured to periodically poll the available states of the transcoding components currently configured in the media boards currently mounted.

[0114] The transcoding component abnormality occurrence unit is configured to update the board card channel mapping table according to the first media board and the channel number matched with the first transcoding component if it is determined that the first transcoding component on the first media board occurs abnormality.

[0115] The transcoding component replacement prompting unit is configured to light the plug-in indication lamp matched with the first transcoding component on the first media board to prompt the plug-in replacement of the first transcoding component.

[0116] The media board abnormality occurrence unit is configured to update the board card channel mapping table according to the second media board if it is determined that all the transcoding components on the second media board occur abnormality.

[0117] The media board replacement prompting unit is configured to light the plug-in indication lamp matched with the second media board to prompt the plug-in replacement of the second media board.

[0118] The audio / video transcoding device provided by the embodiments of the present application can execute the audio / video transcoding method provided by any of the embodiments of the present application, and has the corresponding function modules and beneficial effects of the execution method.

[0119] Embodiment five

[0120] Figure 6A structural diagram of an electronic device 50 that can be used to implement embodiments of the present application is shown. The electronic device is intended to represent various forms of digital computers, such as laptops, desktops, tablets, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device can also represent various forms of mobile devices, such as personal digital assistants, cellular telephones, smartphones, wearable devices (e.g., headsets, glasses, watches, etc.), and other similar computing devices. The components shown here, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the present application described and / or claimed in this document.

[0121] As shown in Figure 6 The electronic device 50 includes at least one processor 51, and a memory, such as a read-only memory (ROM) 52, a random access memory (RAM) 53, etc., connected to the at least one processor 51 in communication, where the memory stores computer programs executable by the at least one processor. The processor 51 can perform various appropriate actions and processes according to the computer programs stored in the read-only memory (ROM) 52 or loaded into the random access memory (RAM) 53 from the storage unit 58. In the RAM 53, various programs and data required for the operation of the electronic device 50 can also be stored. The processor 51, the ROM 52, and the RAM 53 are connected to each other through a bus 54. An input / output (I / O) interface 55 is also connected to the bus 54.

[0122] Various components in the electronic device 50 are connected to the I / O interface 55, including an input unit 56, such as a keyboard, a mouse, etc., an output unit 57, such as various types of displays, speakers, etc., a storage unit 58, such as a magnetic disk, an optical disk, etc., and a communication unit 59, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 59 allows the electronic device 50 to exchange information / data with other devices through a computer network, such as the Internet, and / or various telecommunication networks.

[0123] The processor 51 can be various general and / or special purpose processing components with processing and computing capabilities. Some examples of the processor 51 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 51 performs various methods and processes described above, such as the audio / video transcoding methods described in embodiments of the present application.

[0124] That is, a source audio / video format of a source SIP terminal initiating an audio / video call and a target audio / video format of a target SIP terminal answering the audio / video call are acquired; when the source audio / video format and the target audio / video format are inconsistent, a source transcoding component matching the source audio / video format and a target transcoding component matching the target audio / video format are located in each media board; and the audio / video content exchanged between the source SIP terminal and the target SIP terminal is bidirectionally transcoded by invoking the source transcoding component and the target transcoding component.

[0125] In some embodiments, the audio / video transcoding method can be implemented as a computer program tangibly embodied in a computer readable storage medium, such as the storage unit 58. In some embodiments, part or all of the computer program can be loaded and / or installed onto the electronic device 50 via the ROM 52 and / or the communication unit 59. When the computer program is loaded onto the RAM 53 and executed by the processor 51, one or more steps of the audio / video transcoding method described above can be performed. Alternatively, in other embodiments, the processor 51 can be configured to perform the audio / video transcoding method as described in embodiments of the present application by any other suitable means, such as by means of firmware.

[0126] Various implementations of the systems and techniques described above can be realized in digital electronic circuitry, integrated circuitry, a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on a chip (SOC), a programmable logic device (PLD), a computer hardware, firmware, software, and / or combinations thereof. These various implementations can include implementation in one or more computer programs that are executable and / or interpretable on a programmable system including at least one programmable processor, which can be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.

[0127] Computer programs used to implement the methods of the present application can be written in any combination of one or more programming languages. These computer programs can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the computer program, when executed by the processor of the machine, implements the functions / acts specified in the flowcharts and / or block diagrams. The computer program can be executed entirely on a machine, partially on a machine, partially on a machine and partially on a remote machine or entirely on a remote machine or server.

[0128] In the context of the present application, a computer-readable storage medium can be a tangible medium that can contain or store computer programs for use by or in connection with an instruction execution system, apparatus, or device. Computer-readable storage media can include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium can be a machine-readable signal medium. More specific examples of a machine-readable storage medium will include one or more lines of a program of instructions in a transitory signal, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0129] To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the electronic device. Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.

[0130] The systems and techniques described here can be implemented in a computing system that includes a back end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front end component (e.g., a user computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back end, middleware, or front end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0131] The computing system can include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system, to solve the defects of large management difficulty and weak business scalability in traditional physical host and VPS service.

[0132] It should be understood that the various forms of flow shown above can be reordered, added to, or have steps deleted. For example, the steps described in the present application can be performed in parallel, in series, or in a different order, as long as the desired results of the technical solutions of the present application can be achieved, which are not limited herein.

[0133] The above detailed description does not constitute a limitation on the protection scope of the present application. Those skilled in the art should understand that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. An audio-video transcoding method, characterized in that, The method is executed by a Session Initiation Protocol (SIP) server, the SIP server comprising at least one pluggable media board, each media board being configured with at least one pluggable transcoding component, each transcoding component being configured to implement bidirectional conversion between a set audio / video format and a reference audio / video format, wherein the method comprises: Upon detecting an audio / video call request sent by a source SIP terminal, extracting a source audio / video format included in the audio / video call request, and a target SIP terminal; Polling each transcoding component currently configured in each media board currently mounted to obtain all audio / video formats currently supported by the SIP server; Constructing a transit call request according to all audio / video formats and sending the transit call request to the target SIP terminal; Upon receiving a response sent by the target SIP terminal, extracting a target audio / video format included in the response; wherein the target audio / video format is a subset of all audio / video formats; Upon detecting an audio / video call request sent by a source SIP terminal, extracting a source audio / video format included in the audio / video call request, and a target SIP terminal; Locating a source transcoding component matching the source audio / video format and a target transcoding component matching the target audio / video format in each media board, comprising:

2. The method of claim 1, wherein, Querying a pre-constructed board card channel mapping table to obtain a source channel number on a source media board matching the source audio / video format and a target channel number on a target media board matching the target audio / video format; Wherein, in the board card channel mapping table, the channel numbers of each audio / video format supported by each media board on the media board are stored, and different channel numbers correspond to different transcoding components. Transcoding the audio / video content exchanged between the source SIP terminal and the target SIP terminal by calling the source transcoding component and the target transcoding component, comprising:

3. The method of claim 2, wherein, Upon receiving first audio / video content sent by the source SIP terminal, calling the source transcoding component using the source channel number to convert the first audio / video content in the source audio / video format into first audio / video content in the reference audio / video format; After calling the target transcoding component using the target channel number to convert the first audio / video content in the reference audio / video format into first audio / video content in the target audio / video format, sending the first audio / video content to the target SIP terminal. Transcoding the audio / video content exchanged between the source SIP terminal and the target SIP terminal by calling the source transcoding component and the target transcoding component, comprising:

4. The method of claim 2, wherein, Upon receiving second audio / video content sent by the target SIP terminal, calling the target transcoding component using the target channel number to convert the second audio / video content in the target audio / video format into second audio / video content in the reference audio / video format; After calling the source transcoding component using the source channel number to convert the second audio / video content in the reference audio / video format into second audio / video content in the source audio / video format, sending the second audio / video content to the source SIP terminal. Further comprising:

5. The method according to any one of claims 1 to 4, characterized in that, Periodically polling the availability of each transcoding component currently configured in each media board currently mounted; ​ If it is determined that the first transcoding component on the first media board is abnormal, updating the board card channel mapping table according to the first media board and a channel number matched with the first transcoding component; Lighting a plug-in indication lamp matched with the first transcoding component on the first media board to prompt plug-in replacement of the first transcoding component.

6. The method of claim 5, wherein, After periodically polling available states of the currently configured transcoding components in the currently mounted media boards, further comprising: If it is determined that all transcoding components on the second media board are abnormal, updating the board card channel mapping table according to the second media board; Lighting a plug-in indication lamp matched with the second media board to prompt plug-in replacement of the second media board.

7. An audio-video transcoding apparatus, characterized by comprising: The device is executed by a Session Initiation Protocol (SIP) server, the SIP server comprising at least one pluggable media board, each media board being configured with at least one pluggable transcoding component, each transcoding component being configured to implement bidirectional conversion between a set audio / video format and a reference audio / video format, wherein the device comprises: An audio / video format acquisition module comprising a call request extraction unit, an all audio / video format acquisition unit, a relay call request sending unit and a response extraction unit; The call request extraction unit is configured to extract a source audio / video format included in an audio / video call request sent by a source SIP terminal and a target SIP terminal when detecting the audio / video call request. The all audio / video format acquisition unit is configured to poll currently configured transcoding components in currently mounted media boards to acquire all audio / video formats currently supported by the SIP server. The relay call request sending unit is configured to construct a relay call request according to the all audio / video formats and send the relay call request to the target SIP terminal. The response extraction unit is configured to extract a target audio / video format included in a response feedback by the target SIP terminal when receiving the response. A transcoding component positioning module is configured to locate a source transcoding component matched with the source audio / video format and a target transcoding component matched with the target audio / video format in the media boards when the source audio / video format is inconsistent with the target audio / video format. A transcoding module is configured to perform bidirectional transcoding on audio / video content exchanged between the source SIP terminal and the target SIP terminal by calling the source transcoding component and the target transcoding component.

8. A SIP server, characterized in that The SIP server comprises: At least one pluggable media board, each media board being configured with at least one pluggable transcoding component, each transcoding component being configured to implement bidirectional conversion between a set audio / video format and a reference audio / video format; At least one processor; and A memory in communication connection with the at least one processor; wherein The memory stores a computer program executable by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to execute the audio / video transcoding method in any one of claims 1-6.

9. A computer-readable storage medium, characterized in that, The computer readable storage medium stores computer instructions for enabling the processor to execute the audio / video transcoding method in any one of claims 1-6 when executed by the processor.

Images