Call method, system, electronic device and computer-readable storage medium
By establishing a data channel with a server to manage audio/video data transmission and enabling enhanced multimedia data requests, the method addresses call quality issues in IMS calls, ensuring clear communication and improved user experience.
Patent Information
- Application Number
- JP2024528578
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2021-11-19
- Filing Date
- 2022-11-17
- Publication Date
- 2025-11-26
- Estimated Expiration
- 2042-11-17
AI Technical Summary
Users often experience issues such as low volume, interruptions, silence, and noise during calls due to wireless network instability, interference, and location obstructions, making it difficult to clearly obtain information from the other party's terminal.
Establishing a data channel with a data server during an IMS call to collect and transmit audio/video data, allowing the server to generate multimedia data for transmission between terminals, and enabling terminals to request enhanced multimedia data through a human-machine interface to improve call quality.
Ensures high-quality communication by transmitting multimedia data through a data server, even in poor wireless conditions, improving call experience by providing features like call recordings, text display, and simultaneous interpretation.
Smart Images

Figure 0007776639000004 
Figure 0007776639000005 
Figure 0007776639000006
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to, but is not limited to, the field of communications technology. This application claims priority from Chinese Patent Application No. 202111401823.1, filed on November 19, 2021, the contents of which are incorporated herein by reference. [Background technology]
[0002] Due to factors such as wireless network instability, interference, and location obstruction, users often encounter problems such as low volume, interruptions, silence, and noise during calls, which can make it difficult for users to clearly obtain information from the other party's terminal. Summary of the Invention [Means for solving the problem]
[0003] An embodiment of the present disclosure is a call method applied to a first terminal, When making an IMS call with a second terminal, establishing a data channel with a data server; collecting audio-video data in real time; transmitting the collected audio / video data to the data server via the data channel so that the data server generates first multimedia data from the audio / video data and transmits the first multimedia data to the second terminal; 、 after the step of establishing a data channel with a data server, if a first human-machine interaction interface provided through the first terminal receives a first call enhancement instruction, receiving second multimedia data generated by audio / video data of the second terminal from the data server through the data channel; After the step of receiving a first call enhancement instruction by a first human-machine interaction interface provided through the first terminal, and before the step of receiving the second multimedia data from the data server, requesting second multimedia data that meets the multimedia data type obtained through the first human-machine interaction interface from the data server; A calling method including the following is provided.
[0004] A call method applied to a data server, the method comprising: establishing a data channel with a first terminal that is performing an IMS call with a second terminal; and receiving audio / video data transmitted by the first terminal via the data channel. The first terminal generating first multimedia data from the audio / video data and transmitting the first multimedia data to the second terminal; and when a second multimedia data request satisfying a multimedia data type is received from the first terminal after the data channel with the first terminal is established, generating the second multimedia data based on the audio / video data of the second terminal and transmitting the second multimedia data to the first terminal.It also provides a way to make calls.
[0005] An embodiment of the present disclosure provides a call system including a first terminal, a second terminal, and a data server, wherein the first terminal is communicatively connected to the data server and the data server is communicatively connected to the second terminal, wherein the first terminal, when making an IMS call with the second terminal, is configured to establish a data channel with the data server, collect audio / video data in real time, and transmit the collected audio / video data to the data server via the data channel, the data server is configured to generate first multimedia data from the audio / video data and transmit the first multimedia data to the second terminal, and the second terminal is configured to receive the first multimedia data. wherein the first terminal is configured to, after receiving a first call enhancement instruction through a first human-machine interaction interface provided by the first terminal, request second multimedia data from the data server through the data channel, the second multimedia data satisfying the multimedia data type acquired through the first human-machine interaction interface, before receiving the second multimedia data from the data server; and to receive second multimedia data generated based on audio / video data from the second terminal from the data server through the data channel; and the data server is configured to generate the second multimedia data based on the audio / video data from the second terminal in response to the request for the second multimedia data from the first terminal, and transmit the second multimedia data to the first terminal. A call system is also provided.
[0006] An embodiment of the present disclosure further provides an electronic device including at least one processor and a memory communicatively connected to the at least one processor, the memory storing instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the above-described calling method. An embodiment of the present disclosure further provides a computer-readable storage medium storing a computer program, the computer program implementing the above-described calling method when executed by a processor. [Effects of the Invention]
[0007] In the embodiment of the present disclosure, during the process of a first terminal making an IMS call with a second terminal, the first terminal establishes a data channel with a data server and transmits audio and video data for interacting with the second terminal to the server through the data channel. The data server obtains multimedia data to be transmitted to the second terminal through the audio and video data. However, since the data server often belongs to the data server connected to the near end of the first terminal, when encountering a situation where the call quality is poor during the call, the first terminal can also transmit multimedia data with the second terminal through the data server, thereby ensuring the transmission quality of the call data for both parties. Even if the terminals are in a poor wireless network situation, they can still communicate normally. [Brief explanation of the drawings]
[0008] [Figure 1] 1 is a flowchart 1 of a calling method in one embodiment of the present invention. [Figure 2] FIG. 1 is a conceptual diagram illustrating devices connected via a data channel in an embodiment according to the present invention. [Figure 3] 1 is a conceptual diagram of a human-machine interaction interface provided in one embodiment of the present invention. [Figure 4] 2 is a flowchart 2 of a calling method in another embodiment of the present invention. [Figure 5] 3 is a flowchart 3 of a calling method in another embodiment of the present invention. [Figure 6] FIG. 1 is a conceptual diagram 1 of a communication device provided in another embodiment of the present invention. [Figure 7] FIG. 2 is a conceptual diagram 2 of a communication device provided in another embodiment of the present invention. [Figure 8] FIG. 10 is a conceptual structural diagram of an electronic device according to another embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION
[0009] To clarify the objectives, technical solutions, and advantages of the embodiments of the present disclosure, the following detailed description of each embodiment of the present disclosure will be provided in conjunction with the accompanying drawings. However, those skilled in the art will understand that many technical details are provided in each embodiment of the present disclosure to help readers better understand the present application. However, the technical solutions claimed for protection by the present disclosure can be realized without these technical details or various changes or modifications based on the following embodiments. The division of the following embodiments is for the convenience of explanation and should not be construed as imposing any limitations on the specific implementation of the present disclosure. The embodiments can be combined and referenced together on the premise that there is no contradiction.
[0010] One embodiment of the present invention relates to a calling method applied to a first terminal, which may be an electronic device such as a mobile phone, a tablet, etc. When a first terminal makes an IMS call with a second terminal, the calling method of this embodiment includes the steps of establishing a data channel with a data server, collecting audio and video data in real time, and transmitting the collected audio and video data to the data server via the data channel, so that the data server obtains and transmits first multimedia data to be transmitted to the second terminal using the audio and video data.
[0011] In the embodiment of the present disclosure, during the process of a first terminal making an IMS call with a second terminal, the first terminal establishes a data channel with a data server and transmits audio and video data for interacting with the second terminal to the server through the data channel. The data server obtains multimedia data to be transmitted to the second terminal through the audio and video data. However, since the data server often belongs to the data server connected to the near end of the first terminal, when encountering a situation where the call quality is poor during the call, the first terminal can also transmit multimedia data with the second terminal through the data server, thereby ensuring the transmission quality of the call data for both parties. Even if the terminals are in poor wireless network conditions, they can still communicate normally and the call quality can be guaranteed.
[0012] The following provides a detailed description of the implementation of the call method of this embodiment. However, the following details are provided only for ease of understanding and are not essential for implementing this technical solution.
[0013] The specific flow of the calling method of this embodiment is as shown in FIG. In step 101, when an IMS call is made with a second terminal, a data channel is established with a data server.
[0014] The IMS call in this embodiment includes, but is not limited to, Voice over New Radio (VoNR), Voice over Long-Term Evolution (VoLTE), WiFi voice bearer (VoWiFi), etc. In this embodiment, when the first terminal and the second terminal are in an IMS call, a data channel is further established with a data server to transmit data and ensure the call quality between the first terminal and the second terminal.
[0015] In some embodiments, before the first terminal establishes a data channel with the data server, it intercepts a command sent by the second terminal, and detects whether it is necessary to establish a data channel according to the command, and if the command is a command to establish a data channel, it proceeds to the step of establishing a data channel with the data server. In this embodiment, the first terminal uploads the voice information of the first terminal to the data server in response to the command of the second terminal, ensuring that the second terminal can accurately receive the call information from the first terminal, and the first terminal can also respond to the other terminal, i.e., the second terminal, in a timely manner to meet the call needs of the other terminal.
[0016] In some embodiments, intercepting a command sent by a second terminal includes intercepting Session Initialization Protocol (SIP) signaling sent by the second terminal, and detecting whether a data channel needs to be established according to the command includes determining whether the data channel needs to be established according to a dcmap field included in the SIP signaling.
[0017] For example, the second terminal can be understood as a call destination terminal, and the first terminal intercepts SIP signaling sent by the call destination terminal, analyzes a dcmap field in a Session Description Protocol (SDP) offer message therein, and determines whether a data channel needs to be established. According to the 3GPP TS 26.114 specification, the characterization of the dcmap field is required to establish a data channel. The 3GPP TS 26.114 specification specifies that multiple data channels can be mapped to a single data channel SDP media description, each with a corresponding "a=dcmap" SDP attribute and a unique stream ID for that media description. Table 1 below is an example of how SDP in the specification provides data channel capability signaling.
[0018] [Table 1] Here, the established data channel specified in the specification may be a Bootstrap data channel, and the Bootstrap data channel can be understood as a data channel established between a terminal and a network-side data server. Table 2 below lists the content sources for Bootstrap data channels in the specification.
[0019] [Table 2] The established data channel specified in the specification may be a non-Bootstrap data channel, a data channel established directly between non-Bootstrap data channel terminals, and an example of a data channel application flow provided by SDP in the specification is shown in Table 3 below.
[0020] [Table 3] According to the 3GPP TS 26.114 specification, a terminal can establish a data channel with a data server on the network side, as shown by arrows 4 and 5 in Figure 2. Terminal A and terminal B can respectively establish a connection with a data server, and can also establish a data channel directly with the other terminal (as shown by arrow 6 in Figure 2).
[0021] It is noteworthy that a first terminal is connected to a first data server at its near end, and a second terminal can also be connected to a second data server at its near end, and the first data server and the second data server can be connected via a physical link, for example, an optical fiber connection, without using a wireless connection, thereby ensuring the quality of communication between the first terminal and the second terminal. In step 102, audio-video data is collected in real time.
[0022] For example, the collected audio / video data may include, but is not limited to, microphone audio data, camera video data, and audio text data. The first terminal may provide a human-machine interaction (UI) interface. The collected content may be specified by a user through the UI.
[0023] In step 103, the collected audio / video data is transmitted to the data server via the data channel. The data server generates first multimedia data to be transmitted to the second terminal from the audio / video data. When the data server receives a data request from the second terminal, it can transmit the first multimedia data to the second terminal.
[0024] In some embodiments, the first multimedia data can be generated through collected audio-video data, including, but not limited to, call recordings, call text, simultaneous interpretation data, call recording playback, facial expression packs, etc.
[0025] In some embodiments, during the call, the first terminal may also receive second multimedia execution data generated by the audio / video data of the second terminal via the data server. The first terminal may provide a user interface, and as shown in FIG. 3, the user may select based on the user interface provided. When the first terminal receives a first call enhancement instruction via the user interface (first human-machine interaction interface), the process may proceed to step 104. The first call enhancement instruction is an instruction instructing the terminal to transmit data via the data server.
[0026] In step 104, the second multimedia data is received from the data server through the data channel. Step 104 may be performed in parallel with steps 102 and 103, or may be performed before steps 102 and 103, and this embodiment is not limited thereto.
[0027] In some embodiments, the first terminal can obtain a multimedia data type through a first human-machine interaction interface, and the first terminal can request second multimedia data that satisfies the multimedia data type from the data server before receiving the second multimedia data from the data server.
[0028] In some embodiments, the type of the second multimedia data includes, but is not limited to, the original voice data collected by the other party terminal, i.e., the second terminal, the call text uploaded by the other party terminal, the text converted from the original voice data of the other party terminal via a server, the text translated by simultaneous interpretation, the original voice and video data collected by the other party terminal, etc.
[0029] The first terminal can display data pushed by the data server on the network side on the call interface. Taking the "Call Enhancement" service as an example, when the user clicks the "Call Enhancement" button on the call interface, the call recording interface, call text pop-up information, etc. can be played on the call interface.
[0030] For example, the first terminal collects microphone audio data in real time and uploads the collected audio data to a network-side data server in real time via a data channel. The network-side data server can push the original audio data collected by the first terminal or enhanced multimedia data (e.g., audio data converted into text, sign language video, audio data translated into other languages, etc.) to the second terminal in real time. For example, the enhanced multimedia data can be text, video, etc., and can be displayed on a call interface.
[0031] In this embodiment, the first terminal can respond to the second terminal and push audio / video data to the data server so that the second terminal can obtain the original audio / video data or the enhanced audio / video data through the data server. If poor call quality is encountered during a call, multimedia data can be transmitted through the data server, thereby ensuring the quality of the call audio / video data. The second terminal can also obtain second multimedia data from the data server during the call, thereby improving the data call quality when the voice call quality of both parties is poor. In addition, the user can select a multimedia data type to obtain multimedia data such as simultaneous interpretation, facial expression packs, sign language videos, and text to improve the call experience for both parties.
[0032] Another embodiment of the present invention relates to a call method that can be applied to a terminal, and the communication terminal of this embodiment can obtain historical multimedia data from a data server even after the call is disconnected.
[0033] The implementation details of the calling method of this embodiment will be described in detail below. The following content is provided only for ease of understanding and is not essential for implementing this solution. Figure 4 is a flowchart of the calling method of this embodiment, which is implemented by the first terminal and includes the following steps 401 to 406.
[0034] In step 401, when an IMS call is made with a second terminal, a data channel is established with a data server. In step 402, audio-video data is collected in real time.
[0035] In step 403, the collected audio / video data is transmitted to a data server via a data channel. The data server generates first multimedia data to be transmitted to the second terminal from the audio / video data. After the data server receives the first multimedia data of the second terminal, the data server can transmit the first multimedia data to the second terminal.
[0036] Steps 401 to 403 are almost the same as steps 101 to 103 in the main text, and will not be further described in this embodiment.
[0037] In step 404, if the IMS call is disconnected, the data channel established with the data server is released.
[0038] In some embodiments, after the IMS call is disconnected, the first terminal stops collecting audio. In step 405, upon receiving a second call enhancement instruction via the second human-machine interaction interface, a data channel is re-established with the data server.
[0039] In some embodiments, the user can also select a call enhancement instruction control via a second human-machine interaction interface (provided by the first terminal) and select the required multimedia data type, for example, call text type multimedia data.
[0040] In step 406, third multimedia data is received from the data server through the re-established data channel, where the third multimedia data is generated by audio / video data in the course of an IMS call.
[0041] In some embodiments, the first terminal may send a request for third multimedia data to a data server, and then receive the third multimedia data pushed by the data server on the network side, where the third multimedia data is generated by audio / video data in the IMS call process.
[0042] The type of the third multimedia data to be pushed may be a call recording, a complete call recording, a call text, a translated audio, a call recording of the second terminal, or multimedia data obtained from the audio of one side of the call, for example, the first multimedia data or the second multimedia data.
[0043] Compared with the conventional technical solutions, this embodiment has the following advantages. First, the terminal of this embodiment uploads collected voice data to a data server. Carriers generally specify that the terminal use the nearest data server, thereby guaranteeing the quality of the call voice data, such as low packet loss and low distortion. Second, when establishing a data channel, the terminal of this embodiment specifies QoS as low packet loss and low latency, thereby guaranteeing the transmission quality of the data channel. The terminal of this embodiment can display the call text of the other terminal in real time during a call, and after the call ends, can play or play back the call recording of the other terminal in real time, or display or view the call text of the other terminal in real time, or even perform simultaneous interpretation. That is, this embodiment can solve problems such as low call volume, interruptions, silence, and noise, and improve the user's call experience.
[0044] Another embodiment of the present disclosure relates to a calling method, which is applied to a data server. The implementation details of the calling method of this embodiment will be described in detail below. However, the following implementation details are provided for ease of understanding only and are not essential for implementing this solution. Figure 5 is a flowchart of the calling method of this embodiment, which includes the following steps 501 to 503.
[0045] In step 501, a data channel is established with a first terminal, where the first terminal is conducting an IMS call with a second terminal.
[0046] In step 502, audio / video data transmitted by the first terminal is received via a data channel.
[0047] In some embodiments, the server may store the audio / video data after receiving the audio / video data of the first terminal.
[0048] In step 503, first multimedia data to be transmitted to the second terminal is obtained by audio / video data.
[0049] In some embodiments, the first multimedia data to be transmitted to the second terminal may be original audio data or audio data after undergoing enhancement processing. When the server receives the data request from the second terminal, it can transmit the first multimedia data to the second terminal.
[0050] In some embodiments, the first multimedia data type may be determined by a user selection, for example, the terminal may provide a human-machine interaction interface to the user, and the user may select the multimedia data type based on the human-machine interaction interface.
[0051] In some embodiments, after the IMS call is disconnected, the established data channel can be released, and after the first terminal receives the second call enhancement instruction, the data channel can be re-established with the first terminal, and third multimedia data is transmitted to the first terminal via the newly established data channel, where the third multimedia data is generated by audio / video data in the IMS call process.
[0052] The third type of multimedia data can also be obtained by a request sent by the first terminal.
[0053] In this embodiment, when the call quality is poor, the server can improve the call quality by transmitting audio / video data between the first terminal and the second terminal, or audio / video data after enhancement processing, and after the call is completed, it can further improve the customer experience by transmitting data from the call history.
[0054] Another embodiment of the present invention relates to a communication device, and the communication device of this embodiment is applied to (or included in) a terminal. The following describes in detail the communication device of this embodiment, but the following content is implementation details provided only for ease of understanding and is not essential for implementing this embodiment. Figure 6 is a conceptual diagram of the communication device described in this embodiment, which includes: a data channel management module 601 configured to establish a data channel with a data server when making an IMS call with a second terminal; a collection module 602 configured to collect audio / video data in real time; and a transmission module 603 configured to transmit the collected audio / video data to the data server via the data channel, so that the data server can obtain first multimedia data from the audio / video data and transmit it to the second terminal.
[0055] In some embodiments, the call device further includes a receiving module, which provides a human-machine interaction interface and is configured to receive the second multimedia data from the data server via the data channel upon receiving a first call enhancement instruction via the first human-machine interaction interface, wherein the second multimedia data is generated by audio / video data of the second terminal.
[0056] In some embodiments, the data channel management module 601 of the call device is further configured to release the data channel established with the data server to provide a human-machine interaction interface when the IMS call is disconnected, and to re-establish the data channel with the data server upon receiving a second call enhancement instruction via a second human-machine interaction interface, and the receiving module is further configured to receive the third multimedia data from the data server via the re-established data channel, where the third multimedia data is generated by audio / video data in the IMS call process.
[0057] In some embodiments, the transmission module 603 is further configured to obtain a multimedia data type via a human-machine interaction interface and request second multimedia data that satisfies the multimedia data type from the data server.
[0058] In some embodiments, the data channel management module 601 is further configured to intercept an instruction sent by the second terminal, detect whether a data channel needs to be established according to the instruction, and if the instruction is an instruction to establish a data channel, proceed to the step of establishing a data channel with the data server.
[0059] In some embodiments, the data channel management module 601 is further configured to intercept a Session Initiation Protocol (SIP) signaling sent by the second terminal, and determine whether the data channel needs to be established according to a dcmap field included in the SIP signaling.
[0060] Another embodiment of the present invention relates to a communication device, and the communication device of this embodiment is applied to (or included in) a server. The following describes the details of the communication device of this embodiment in detail. However, the following content is only provided for ease of understanding and is not essential for implementing this embodiment. Figure 7 is a conceptual diagram of the communication device described in this embodiment. The communication device includes: a data channel management module 701 configured to establish a data channel with a first terminal that performs an IMS call with a second terminal; a receiving module 702 configured to receive audio / video data transmitted by the first terminal via the data channel; and a transmitting module 703 configured to obtain and transmit first multimedia data to be transmitted to the second terminal from the audio / video data.
[0061] In some embodiments, the transmission module 703 is further configured to, upon receiving a second multimedia data request from the first terminal, transmit second multimedia data to the first terminal via the data channel, where the second multimedia data is generated by audio / video data of the second terminal.
[0062] In some embodiments, the data channel management module 701 is further configured to: release the data channel established with the first terminal when the IMS call is disconnected; re-establish the data channel with the first terminal in response to a data request from the first terminal; and transmit the third multimedia data to the first terminal via the re-established data channel, wherein the third multimedia data is generated by audio / video data in the course of the IMS call.
[0063] In some embodiments, the receiving module 702 is further configured to transmit, in response to a request of the first terminal, second multimedia data satisfying the second multimedia data type to the first terminal.
[0064] It is easy to understand that this embodiment is a system embodiment corresponding to the above method embodiment, and this embodiment can be implemented in cooperation with the above method embodiment. The details and technical effects of the related technologies mentioned in the above embodiment are still valid in this embodiment, and will not be further described here to reduce redundancy. Accordingly, the details of the related technologies mentioned in this embodiment can also be applied to the above embodiment.
[0065] It is worth noting that each module in this embodiment is a logical module, and in actual application, one logical unit may be one physical unit, may be part of one physical unit, or may be realized by a combination of multiple physical units. In addition, in order to highlight the innovative aspects of the present invention, this embodiment does not introduce units that are not closely related to solving the technical problems proposed by the present invention, but this does not mean that other units do not exist in this embodiment.
[0066] Another embodiment of the present invention relates to a call system. As shown in Fig. 2, the call system includes a first terminal (i.e., terminal A in Fig. 2), a second terminal (i.e., terminal B in Fig. 2), and a data server, the first terminal is communicatively connected to the data server, and the data server is communicatively connected to the second terminal, the first terminal is configured to establish a data channel with the data server to collect audio / video data in real time and transmit the collected audio / video data to the data server via the data channel when making an IMS call with the second terminal, the data server is configured to generate first multimedia data from the audio / video data and transmit the first multimedia data to the second terminal, and the second terminal is configured to receive the first multimedia data.
[0067] Another embodiment of the present invention relates to an electronic device, and as shown in FIG. 8, the electronic device includes at least one processor 801 and a memory 802 communicatively connected to the at least one processor 801, the memory 802 storing instructions executable by the at least one processor 801, and the instructions being executed by the at least one processor 801 so that the at least one processor 801 can perform the call method in each of the above embodiments.
[0068] Here, the memory and processor are connected via a bus system, which may include any number of interconnected buses and bridges, and the bus may connect various circuits of one or more processors and memories. The bus may also connect various other circuits together, such as peripherals, regulators, and power management circuits, all of which are well known in the art and will not be further described herein. A bus interface provides an interface between the bus and a transceiver. The transceiver may be a single element or multiple elements, such as multiple receivers and transmitters, providing a unit for communicating with various other devices over a transmission medium. Data processed by the processor is transmitted over a wireless medium via an antenna, which further receives and transmits data to the processor.
[0069] The processor is responsible for managing the bus and general processing and may provide a variety of functions including timing, peripheral interfacing, voltage regulation, power management, and other control functions, while memory may be used to store data used by the processor in performing operations.
[0070] Another embodiment of the invention relates to a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the above method embodiments.
[0071] That is, all or part of the steps for realizing the methods of the above-mentioned embodiments can be completed by instructing related hardware through a program, and those skilled in the art will understand that the program is stored in a storage medium and includes instructions for a device (which may be a single-chip microcomputer, chip, etc.) or a processor to execute all or part of the steps of the methods described in each embodiment of the present application. Meanwhile, the storage medium includes various media capable of storing program code, such as a U disk, a removable hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk. Those skilled in the art can understand that the above-described embodiments are specific examples for realizing the present invention, and in actual applications, various changes in form and details can be made without departing from the spirit and scope of the present application.
Claims
1. A call method applied to a first terminal, When making an IMS call with a second terminal, establishing a data channel with a data server; collecting audio-video data in real time; transmitting the collected audio / video data to the data server via the data channel so that the data server generates first multimedia data from the audio / video data and transmits the first multimedia data to the second terminal; after the step of establishing a data channel with a data server, if a first human-machine interaction interface provided through the first terminal receives a first call enhancement instruction, receiving second multimedia data generated by audio / video data of the second terminal from the data server through the data channel; After the step of receiving a first call enhancement instruction by a first human-machine interaction interface provided via the first terminal, and before the step of receiving the second multimedia data from the data server, requesting second multimedia data that meets the multimedia data type obtained via the first human-machine interaction interface from the data server; Including, How to call.
2. After the step of establishing a data channel with the data server, if the IMS call is disconnected, releasing the data channel established with the data server; re-establishing a data channel with the data server when a second human-machine interaction interface provided via the first terminal receives a second call enhancement instruction; and receiving third multimedia data generated by audio and video data during the IMS call from the data server via the re-established data channel. The calling method according to claim 1.
3. The first multimedia data includes any of a call record, a call text, simultaneous interpretation data, a call video playback, or a meme image. The calling method according to claim 1.
4. The second multimedia data includes any of original voice data collected by the second terminal, call text uploaded by the second terminal, text converted from the original voice data of the second terminal by the data server, text translated from simultaneous interpretation, or original audio / video data collected by the second terminal. The calling method according to claim 1.
5. before the step of establishing a data channel with a data server, Intercepting a command sent by the second terminal; determining whether a data channel needs to be established according to the instruction; If the command is a command to establish a data channel, proceeding to the step of establishing a data channel with a data server. The communication method according to any one of claims 1 to 4.
6. The step of intercepting a command sent by the second terminal includes: intercepting Session Initiation Protocol (SIP) signaling sent by the second terminal; The step of determining whether a data channel needs to be established according to the command includes: determining whether the data channel needs to be established based on a dcmap field included in the SIP signaling; The calling method according to claim 5.
7. A call method applied to a data server, establishing a data channel with a first terminal that is engaged in an IMS call with a second terminal; receiving audio / video data transmitted by the first terminal via the data channel; generating first multimedia data from the audio / video data of the first terminal and transmitting the first multimedia data to the second terminal; and when a second multimedia data request satisfying a multimedia data type is received from the first terminal after the data channel with the first terminal is established, generating second multimedia data based on the audio / video data of the second terminal and transmitting the second multimedia data to the first terminal. How to call.
8. A call system including a first terminal, a second terminal, and a data server, wherein the first terminal is communicatively connected to the data server, and the data server is communicatively connected to the second terminal, the first terminal is configured to establish a data channel with the data server to collect voice and video data in real time when making an IMS call with the second terminal, and to transmit the collected voice and video data to the data server via the data channel; the data server is configured to generate first multimedia data from the audio / video data and transmit the first multimedia data to the second terminal; the second terminal is configured to receive the first multimedia data; wherein the first terminal is configured to, after receiving a first call enhancement instruction through a first human-machine interaction interface provided by the first terminal, request second multimedia data from the data server through the data channel, the second multimedia data satisfying the multimedia data type acquired through the first human-machine interaction interface, before receiving second multimedia data from the data server; configured to receive second multimedia data generated based on the audio / video data from the second terminal from the data server via the data channel; the data server is configured to generate the second multimedia data based on the audio / video data from the second terminal in response to a request for the second multimedia data from the first terminal, and transmit the second multimedia data to the first terminal. Call system.
9. at least one processor; a memory communicatively coupled to the at least one processor; The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can perform the calling method according to any one of claims 1 to 4 or claim 7. electronic equipment.
10. A computer-readable storage medium storing a computer program, which, when executed by a processor, realizes the calling method according to any one of claims 1 to 4 or the calling method according to claim 7. A computer-readable storage medium.
Citation Information
Patent Citations
Data channel establishment method and communication device
CN105227418A
Video call system, device and method
CN105227892A
Method for recording a PTT call and an VoLTE call
KR1020180109818A