Message transmission method and device and electronic equipment

Abstract

The invention relates to a message transmission method and device and electronic equipment, and belongs to the technical field of wireless communication, and the method comprises the steps: obtaining a to-be-transmitted streaming message, splitting the to-be-transmitted streaming message, and obtaining metadata and multi-mode streaming content of the to-be-transmitted streaming message; generating a first streaming message according to the metadata of the streaming message to be transmitted; sending the first streaming message to a message platform based on a session initiation protocol (SIP); and sending the multi-modal streaming content to a message platform based on the first streaming message and a hypertext transfer protocol HTTP, the multi-modal streaming content being sent to the message receiving end through the message platform. Therefore, physical separation transmission is carried out on the metadata of the to-be-transmitted streaming message and the multi-mode content, real-time transmission of the multi-mode streaming content is achieved through SIP and HTTP dual-protocol cooperation, the transmission efficiency of the multi-mode streaming content is improved, and end-to-end interaction delay is reduced.

Description

Technical Field

[0001] This disclosure relates to the field of wireless communication technology, and in particular to a message transmission method, apparatus and electronic device. Background Technology

[0002] The current 5G mobile communication technology uses the Session Initiation Protocol (SIP) to achieve end-to-end communication. The message content is transmitted in the form of complete data packets. The message receiving end needs to receive the complete data packets, parse them, and display them, which cannot meet the real-time interactive needs of large files. Summary of the Invention

[0003] This disclosure provides a message transmission method, apparatus, electronic device, medium, and computer program product.

[0004] The technical solution disclosed herein is as follows: According to a first aspect of the present disclosure, a message transmission method is provided, executed by a message sender, comprising: acquiring a streaming message to be transmitted; splitting the streaming message to be transmitted to acquire metadata and multimodal streaming content of the streaming message to be transmitted; generating a first streaming message based on the metadata of the streaming message to be transmitted; sending the first streaming message to a messaging platform based on the Session Initiation Protocol (SIP); and sending the multimodal streaming content to the messaging platform based on the first streaming message and the Hypertext Transfer Protocol (HTTP), wherein the multimodal streaming content is sent to the message receiver through the messaging platform.

[0005] According to a second aspect of the present disclosure, a message transmission method is provided, executed by a message platform, comprising: receiving a first streaming message sent by a message sender, wherein the first streaming message is related to metadata of a streaming message to be transmitted by the message sender; obtaining multimodal streaming content of the streaming message to be transmitted based on an HTTP endpoint corresponding to the message platform and the first streaming message; and sending the multimodal streaming content to a message receiver.

[0006] According to a third aspect of the present disclosure, a message transmission method is provided, executed by a message receiving end, comprising: receiving a second streaming message sent by a message platform, wherein the second streaming message is related to a first streaming message, and the first streaming message is related to metadata of a streaming message to be transmitted at a message sending end; and receiving, based on the second streaming message, the multimodal streaming content of the streaming message to be transmitted sent by the message platform.

[0007] According to a fourth aspect of the present disclosure, a message transmission apparatus is provided, applied to a message sending end, comprising: an acquisition module, configured to acquire a streaming message to be transmitted, split the streaming message to be transmitted, and acquire metadata and multimodal streaming content of the streaming message to be transmitted; a generation module, configured to generate a first streaming message based on the metadata of the streaming message to be transmitted; a first sending module, configured to send the first streaming message to a messaging platform based on the Session Initiation Protocol (SIP); and a second sending module, configured to send the multimodal streaming content to the messaging platform based on the first streaming message and the Hypertext Transfer Protocol (HTTP), wherein the multimodal streaming content is sent to the message receiving end through the messaging platform.

[0008] According to a fifth aspect of the present disclosure, a message transmission apparatus is provided, applied to a message platform, comprising: a first receiving module, configured to receive a first streaming message sent by a message sending end, wherein the first streaming message is related to metadata of a streaming message to be transmitted by the message sending end; a first obtaining module, configured to obtain multimodal streaming content of the streaming message to be transmitted based on an HTTP endpoint corresponding to the message platform and the first streaming message; and a third sending module, configured to send the multimodal streaming content to a message receiving end.

[0009] According to a sixth aspect of the present disclosure, a message transmission apparatus is provided, applied to a message receiving end, comprising: a second receiving module, configured to receive a second streaming message sent by a message platform, wherein the second streaming message is related to a first streaming message, and the first streaming message is related to metadata of a streaming message to be transmitted at the message sending end; and a third receiving module, configured to receive multimodal streaming content of the streaming message to be transmitted sent by the message platform based on the second streaming message.

[0010] According to a seventh aspect of the present disclosure, an electronic device is provided, comprising: a processor; a memory for storing executable instructions of the processor; wherein the processor is configured to execute the instructions to implement the message transmission method as described in the first, second, or third aspect of the present disclosure.

[0011] According to an eighth aspect of the present disclosure, a computer-readable storage medium is provided that, when instructions in the computer-readable storage medium are executed by a processor of an electronic device, enables the electronic device to perform the message transmission method as described in the first, second, or third aspect of the present disclosure.

[0012] According to a ninth aspect of the present disclosure, a computer program product is provided, including a computer program that, when executed by a processor, implements the message transmission method according to the first, second, or third aspect of the present disclosure.

[0013] The technical solutions provided by the embodiments of this disclosure have at least the following beneficial effects: In this embodiment, by acquiring a streaming message to be transmitted, splitting the streaming message to be transmitted, obtaining the metadata and multimodal streaming content of the streaming message to be transmitted, generating a first streaming message based on the metadata of the streaming message to be transmitted, sending the first streaming message to the messaging platform based on the Session Initiation Protocol (SIP), and sending the multimodal streaming content to the messaging platform based on the first streaming message and the Hypertext Transfer Protocol (HTTP), wherein the multimodal streaming content is sent to the message receiving end through the messaging platform. Thus, this disclosure improves the transmission efficiency of multimodal streaming content, reduces end-to-end interaction latency, and meets the real-time interaction requirements by physically separating the transmission of the metadata and multimodal content of the streaming message to be transmitted, and by achieving real-time transmission of multimodal streaming content through the collaboration of SIP and HTTP dual protocols.

[0014] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0015] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure, and are not intended to unduly limit this disclosure.

[0016] Figure 1 This is a flowchart illustrating a message transmission method according to an exemplary embodiment.

[0017] Figure 2 This is a flowchart illustrating a message transmission method according to an exemplary embodiment.

[0018] Figure 3 This is a flowchart illustrating a message transmission method according to an exemplary embodiment.

[0019] Figure 4 This is a flowchart illustrating a message transmission method according to an exemplary embodiment.

[0020] Figure 5 This is a flowchart illustrating a message transmission method according to an exemplary embodiment.

[0021] Figure 6 This is an interactive flowchart illustrating a message transmission according to an exemplary embodiment.

[0022] Figure 7 This is an interactive flowchart illustrating a message transmission according to an exemplary embodiment.

[0023] Figure 8 This is a schematic diagram illustrating the streaming interface effect of 5G messaging according to an exemplary embodiment.

[0024] Figure 9 This is a schematic diagram illustrating the streaming interface effect of 5G messaging according to an exemplary embodiment.

[0025] Figure 10 This is a schematic diagram illustrating a dual-channel layered architecture for message transmission according to an exemplary embodiment.

[0026] Figure 11 This is a block diagram illustrating a message transmission device according to an exemplary embodiment.

[0027] Figure 12 This is a block diagram illustrating a message transmission device according to another exemplary embodiment.

[0028] Figure 13 This is a block diagram illustrating a message transmission device according to another exemplary embodiment.

[0029] Figure 14 This is a block diagram illustrating an electronic device according to an exemplary embodiment. Detailed Implementation

[0030] To enable those skilled in the art to better understand the technical solutions of this disclosure, the technical solutions in the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings.

[0031] It should be noted that the terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this disclosure described herein can be implemented in orders other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0032] The following embodiments will be used to provide a detailed description of the message transmission method, apparatus, and electronic device proposed in this disclosure.

[0033] Figure 1 This is a flowchart illustrating a message transmission method provided in an embodiment of this application.

[0034] like Figure 1 As shown, the message transmission method proposed in this embodiment is executed by the message sender and includes the following steps: S101, obtain the streaming message to be transmitted, split the streaming message to be transmitted, and obtain the metadata and multimodal streaming content of the streaming message to be transmitted.

[0035] Among them, the streaming message to be transmitted can be a 5G message.

[0036] It should be noted that by splitting the streaming message to be transmitted, we can obtain the metadata and multimodal streaming content of the streaming message to be transmitted. The metadata of the streaming message to be transmitted can be understood as the control parameters of the streaming message to be transmitted, and the multimodal streaming content of the streaming message to be transmitted can be understood as the content data (media payload) of the streaming message to be transmitted.

[0037] It should be noted that the metadata of the streaming message to be transmitted includes at least the message identifier of the streaming message to be transmitted, the Hypertext Transfer Protocol (HTTP) endpoint corresponding to the message sender, the message type of the streaming message to be transmitted, and the encrypted metadata of the streaming message to be transmitted.

[0038] The message identifier for transmitting streaming messages is represented by the stream_mode field. Realtime indicates that the streaming message to be transmitted is a first-type streaming message (real-time streaming), and interactive indicates that the streaming message to be transmitted is a second-type streaming message (interactive progressive streaming).

[0039] The HTTP endpoint corresponding to the message sender is represented by the http_endpoint field, which is the HTTP address that initiates the streaming request.

[0040] The message type of the streaming message to be transmitted is indicated by the content_type field, which supports different formats such as text, audio, and video.

[0041] The encryption metadata of the streaming message to be transmitted is represented by the encryption field. The encryption metadata includes the encryption method of the streaming message to be transmitted (such as the SM4 encryption algorithm), the encryption key, and the initialization vector (IV).

[0042] It should be noted that multimodal streaming content includes, but is not limited to, content data in multiple modalities such as text, audio, and video.

[0043] S102, Generate the first streaming message based on the metadata of the streaming message to be transmitted.

[0044] In this embodiment of the disclosure, after obtaining the metadata of the streaming message to be transmitted, the basic information and metadata of the message to be transmitted can be assembled to generate a first streaming message.

[0045] It should be noted that the basic information of the message to be transmitted includes, but is not limited to, the protocol type, the address information of the message receiver, the message type, the content format, and the identification document (id) information.

[0046] For example, a first-stream message can be represented as: MESSAGE sip:userB@operator.com SIP / 2.0 Content-Type: application / json { "msg_id": "5GMSG-2023-123456", "stream_mode": "interactive ", "content_type": "video / mp4; codec=hevc", "encryption": { "algorithm": "SM4", "key": "base64_encoded_key", "iv": "base64_encoded_iv" }, "http_endpoint": "https: / / cdn.5gmsg.com / stream / 5GMSG-2023-123456" } In this embodiment of the disclosure, in order to improve the security of message transmission, in response to the fact that the size of the multimodal streaming content to be transmitted meets a preset condition, the encrypted metadata of the streaming message to be transmitted is updated synchronously.

[0047] Optionally, in response to the size of the transmitted multimodal streaming content reaching 512MB, which meets the preset condition, the encryption key of the message to be transmitted is synchronously updated to achieve dynamic key rotation.

[0048] For example, encryption keys can be synchronously updated based on SIP INFO messages in the following way: INFO sip:userB@operator.com SIP / 2.0 Content-Type: application / crypto-update { "msg_id": "5GMSG-2023-123456", "new_key": "base64_encoded_key_v2" } S103, Send the first streaming message to the messaging platform based on the Session Initiation Protocol (SIP).

[0049] S104, based on the first streaming message and the Hypertext Transfer Protocol (HTTP), sends multimodal streaming content to the messaging platform, wherein the multimodal streaming content is sent to the message receiving end through the messaging platform.

[0050] In this embodiment of the disclosure, in response to a message identifier indicating that the streaming message to be transmitted is a first type of streaming message (i.e., real-time streaming), the multimodal streaming content is distributed to a Content Delivery Network (CDN) server to send the multimodal streaming content to the messaging platform through the CDN server and the HTTP endpoint of the messaging platform.

[0051] In this embodiment of the disclosure, in response to the message identifier indicating that the streaming message to be transmitted is a second type of streaming message (i.e., interactive progressive streaming), a first HTTP request sent by the message platform is received based on the HTTP endpoint corresponding to the message sender. The first HTTP request is used to request multimodal streaming content. In response to the first HTTP request, the message sender sends multimodal streaming content to the message platform.

[0052] In this embodiment of the disclosure, after the messaging platform receives the multimodal streaming content, it sends the multimodal streaming content to the message receiving end through the messaging platform. Correspondingly, the message receiving end can receive the multimodal streaming content of the streaming message to be transmitted sent by the messaging platform.

[0053] In summary, the message transmission method provided in this disclosure obtains a streaming message to be transmitted, splits the streaming message to be transmitted, obtains the metadata and multimodal streaming content of the streaming message to be transmitted, generates a first streaming message based on the metadata of the streaming message to be transmitted, sends the first streaming message to the messaging platform based on the Session Initiation Protocol (SIP), and sends multimodal streaming content to the messaging platform based on the first streaming message and the Hypertext Transfer Protocol (HTTP). The multimodal streaming content is sent to the message receiving end through the messaging platform. Thus, this disclosure improves the transmission efficiency of multimodal streaming content, reduces end-to-end interaction latency, and meets the real-time interaction requirements by physically separating the transmission of the metadata and multimodal content of the streaming message to be transmitted and achieving real-time transmission of multimodal streaming content through the collaboration of SIP and HTTP dual protocols.

[0054] Figure 2This is a flowchart illustrating a message transmission method provided in an embodiment of this application.

[0055] like Figure 2 As shown, the message transmission method proposed in this embodiment is executed by the message platform and includes the following steps: S201, Receive a first streaming message sent by the message sender, wherein the first streaming message is related to the metadata of the streaming message to be transmitted by the message sender.

[0056] In this embodiment of the disclosure, the message sender obtains the streaming message to be transmitted, splits the streaming message to be transmitted to obtain the metadata of the streaming message to be transmitted, generates a first streaming message based on the metadata of the streaming message to be transmitted, and sends the first streaming message to the message platform based on SIP. Correspondingly, the message platform receives the first streaming message sent by the message sender.

[0057] S202, based on the HTTP endpoint corresponding to the messaging platform and the first streaming message, obtain the multimodal streaming content of the streaming message to be transmitted.

[0058] In this embodiment of the disclosure, the first streaming message can be updated according to the HTTP endpoint corresponding to the messaging platform to obtain the second streaming message, and the second streaming message can be sent to the message receiving end to obtain the multimodal streaming content of the streaming message to be transmitted based on the second streaming message.

[0059] Optionally, in response to the second streaming message being a first type of streaming message, a second HTTP request is waited for from the message receiver, wherein the second HTTP request is used to request multimodal streaming content, so as to obtain multimodal streaming content according to the second HTTP request.

[0060] Optionally, in response to the second streaming message being a second type of streaming message, a first HTTP request can be sent to the message sender based on the HTTP endpoint corresponding to the message sender to request the multimodal streaming content, and then preload and save the multimodal streaming content after it is obtained.

[0061] S203, send multimodal streaming content to the message receiver.

[0062] In summary, the message transmission method provided in this disclosure receives a first streaming message sent by a message sender, wherein the first streaming message is related to the metadata of the streaming message to be transmitted at the message sender. Based on the HTTP endpoint corresponding to the message platform and the first streaming message, the multimodal streaming content of the streaming message to be transmitted is obtained and sent to the message receiver. Thus, this disclosure obtains the multimodal streaming content of the streaming message to be transmitted based on the HTTP endpoint corresponding to the message platform and the first streaming message, thereby reducing the transmission latency of the multimodal streaming content and improving the transmission efficiency of the multimodal streaming content.

[0063] Figure 3 This is a flowchart illustrating a message transmission method provided in an embodiment of this application.

[0064] like Figure 3 As shown, the message transmission method proposed in this embodiment is executed by the message platform and includes the following steps: S301, Receive the first streaming message sent by the message sender.

[0065] S302, based on the HTTP endpoint corresponding to the messaging platform, update the first streaming message to obtain the second streaming message.

[0066] Optionally, the HTTP endpoint corresponding to the message sender in the first streaming message can be replaced with the HTTP endpoint corresponding to the message platform to update the first streaming message and obtain the second streaming message.

[0067] S303, send a second streaming message to the message receiver.

[0068] S304, Receive a second HTTP request sent by the message receiver, wherein the second HTTP request is used to request multimodal streaming content, and the second HTTP request is related to the HTTP endpoint corresponding to the message platform in the second streaming message.

[0069] In this embodiment of the disclosure, the message receiver sends a second HTTP request to the message platform based on the HTTP endpoint corresponding to the message platform in the second streaming message, and the message platform receives the second HTTP request sent by the message receiver.

[0070] S305, in response to the message identifier indicating that the streaming message to be transmitted is a first-type streaming message, authenticate and perform key negotiation AKA authentication on the second HTTP request.

[0071] In this embodiment of the disclosure, the reliability of the second HTTP request is verified by performing authentication and key agreement (AKA) authentication on the second HTTP request.

[0072] Optionally, the second HTTP request may carry authentication information, and the authentication result of the second HTTP request can be obtained by performing AKA authentication on the authentication information in the second HTTP request.

[0073] Optionally, in response to receiving the second HTTP request, the message platform sends an authentication instruction to the message sender. Upon receiving the authentication instruction, the message sender sends authentication information to the message platform via HTTP and authenticates the authentication information to obtain the authentication result of the second HTTP request.

[0074] S306, in response to the successful authentication of the second HTTP request, a third HTTP request is sent to the CDN server, wherein the third HTTP request is used to request multimodal streaming content.

[0075] In this embodiment of the disclosure, in response to the authentication result of the second HTTP request indicating that the second HTTP request authentication is successful, a third HTTP request is sent to the CDN server based on HTTP to request the acquisition of multimodal streaming content distributed to the CDN server.

[0076] S307 receives multimodal streaming content sent by the CDN server.

[0077] In this embodiment of the disclosure, after receiving multimodal streaming content sent by the CDN server, the multimodal streaming content can be dynamically audited for security, and the multimodal streaming content can be sent to the message receiving end based on the dynamic security audit results of the multimodal streaming content.

[0078] S308 sends multimodal streaming content to the message receiver.

[0079] In this embodiment of the disclosure, in order to improve the speed of sending multimodal streaming content to the message receiver, the multimodal streaming content can be fragmented according to a preset fragmentation strategy, the fragmented streaming sub-content can be obtained, the streaming sub-content can be sent to the message receiver, and in response to the detection that the target streaming sub-content of the multimodal streaming content has been interrupted, the target streaming sub-content can be resumed from the breakpoint.

[0080] Optionally, the multimodal streaming content can be segmented according to its type to obtain segmented streaming sub-content.

[0081] For example, if the type of multimodal streaming content is text, the text can be segmented line by line or word by word; if the type of multimodal streaming content is audio, the audio can be segmented according to 20ms audio frames; if the type of multimodal streaming content is video, the video can be segmented according to a Group of Pictures (GOP) every 2 seconds; if the type of multimodal streaming content is images, the images can be encoded into a format that can be loaded in stages according to the Joint Photographic Experts Group (JPEG).

[0082] Optionally, to ensure that the first screen loading time is less than 500ms, the initial chunk size can be set to 256KB, and the chunk size can be automatically switched to 512KB, 1024KB, etc. based on network quality. The network quality can be determined based on parameters such as round-trip time and bandwidth.

[0083] For example, multimodal streaming content can be fragmented in the following ways: { "segmentation": { "chunk_size": 1024, / / Chunk size (KB) "total_length": 5120 / / Total size (KB) } } For example, for multimodal streaming content that is video data, the video data is segmented to obtain encrypted video data segments (streaming sub-content). The messaging platform sends the encrypted video data segments to the message receiver in the following way.

[0084] GET / stream / 5GMSG-2023-123456 HTTP / 1.1 Accept: video / mp4 Range: bytes=0- HTTP / 1.1 206 Partial Content Content-Type: video / mp4 Transfer-Encoding: chunked Encryption-Info: SM4; key_id="k1" Optionally, for each fragmented streaming sub-content, an HMAC-SHA256 signature is appended when sending the fragmented streaming sub-content to the message receiver, for example: X-Content-Signature: sha256=9f86d081...b64cf, so that the message receiver can verify the integrity of the fragmented streaming sub-content.

[0085] For example, in response to the detection of a transmission interruption in the target streaming sub-content of multimodal streaming content, the target streaming sub-content can be resumed from its interruption point in the following ways: GET / stream / msg123 HTTP / 1.1 Range: bytes=1048576- / / Recover from 1MB position In summary, the message transmission method provided in this disclosure receives a first streaming message sent by a message sender, updates the first streaming message according to the HTTP endpoint corresponding to the message platform to obtain a second streaming message, sends the second streaming message to a message receiver, and receives a second HTTP request sent by the message receiver. The second HTTP request is used to request multimodal streaming content and is related to the HTTP endpoint corresponding to the message platform in the second streaming message. In response to a message identifier indicating that the streaming message to be transmitted is a first-type streaming message, authentication and key negotiation (AKA) authentication are performed on the second HTTP request. In response to the successful authentication of the second HTTP request, a third HTTP request is sent to the CDN server, whereby the third HTTP request is used to request multimodal streaming content. The method receives the multimodal streaming content sent by the CDN server and sends the multimodal streaming content to the message receiver. Therefore, this disclosure improves the security and reliability of message transmission by performing AKA authentication on the second HTTP request, and improves the efficiency of message transmission by performing fragmented transmission and breakpoint resumption on the multimodal streaming content, reducing end-to-end interaction latency and greatly enhancing the user experience.

[0086] Figure 4 This is a flowchart illustrating a message transmission method provided in an embodiment of this application.

[0087] like Figure 4 As shown, the message transmission method proposed in this embodiment is executed by the message platform and includes the following steps: S401, Receive the first streaming message sent by the message sender.

[0088] S402, based on the HTTP endpoint corresponding to the messaging platform, update the first streaming message to obtain the second streaming message.

[0089] Optionally, the HTTP endpoint corresponding to the message sender in the first streaming message can be replaced with the HTTP endpoint corresponding to the message platform to update the first streaming message and obtain the second streaming message.

[0090] S403, send a second streaming message to the message receiver.

[0091] S404, in response to the message identifier indicating that the streaming message to be transmitted is a second type of streaming message, a first HTTP request is sent to the message sender based on the HTTP endpoint corresponding to the message sender, wherein the first HTTP request is used to request multimodal streaming content.

[0092] In this embodiment of the disclosure, in response to the fact that the streaming message to be transmitted is a second type of streaming message, a first HTTP request is sent to the message sender based on the HTTP endpoint and HTTP corresponding to the message sender. In response to the first HTTP request, the message sender sends the multimodal streaming content of the message to be transmitted to the message platform.

[0093] S405, Receive multimodal streaming content sent by the message sender.

[0094] In this embodiment of the disclosure, after receiving the multimodal streaming content sent by the message sender, the multimodal streaming content is preloaded and saved, and the multimodal streaming content is subject to dynamic security review. Based on the dynamic security review results of the multimodal streaming content, the multimodal streaming content is sent to the message receiver.

[0095] S406, Receive a second HTTP request sent by the message receiver, wherein the second HTTP request is used to request multimodal streaming content, and the second HTTP request is related to the HTTP endpoint corresponding to the message platform in the second streaming message.

[0096] In this embodiment of the disclosure, the message receiving end sends a second HTTP request to the message platform based on the HTTP endpoint corresponding to the message platform in the second streaming message, and correspondingly, the message platform receives the second HTTP request sent by the message receiving end.

[0097] S407 performs AKA authentication on the second HTTP request.

[0098] In this embodiment of the disclosure, the reliability of the second HTTP request is verified by performing AKA authentication on the second HTTP request.

[0099] Optionally, the second HTTP request may carry authentication information, and the authentication result of the second HTTP request can be obtained by performing AKA authentication on the authentication information in the second HTTP request.

[0100] Optionally, in response to receiving the second HTTP request, the message platform sends an authentication instruction to the message sender. Upon receiving the authentication instruction, the message sender sends authentication information to the message platform via HTTP and authenticates the authentication information to obtain the authentication result of the second HTTP request.

[0101] S408, in response to the successful authentication of the second HTTP request, sends multimodal streaming content to the message receiver.

[0102] In this embodiment of the disclosure, in response to the authentication result of the second HTTP request indicating that the second HTTP request has been authenticated, multimodal streaming content is sent to the message receiver.

[0103] In this embodiment of the disclosure, multimodal streaming content can be segmented according to a preset segmentation strategy, segmented streaming sub-content can be obtained, and streaming sub-content can be sent to the message receiving end. In response to the detection that the target streaming sub-content of the multimodal streaming content has been interrupted, the target streaming sub-content can be resumed from the breakpoint.

[0104] It should be noted that the specific process of segmentation and breakpoint resumption can be found in the above embodiments, and will not be repeated here.

[0105] In summary, the message transmission method provided in this disclosure receives a first streaming message sent by a message sender, updates the first streaming message according to the HTTP endpoint corresponding to the message platform to obtain a second streaming message, sends the second streaming message to a message receiver, and in response to a message identifier indicating that the streaming message to be transmitted is a second type of streaming message, sends a first HTTP request to the message sender based on the HTTP endpoint corresponding to the message sender, wherein the first HTTP request is used to request multimodal streaming content, receives the multimodal streaming content sent by the message sender, receives a second HTTP request sent by the message receiver, wherein the second HTTP request is used to request multimodal streaming content, the second HTTP request is related to the HTTP endpoint corresponding to the message platform in the second streaming message, performs AKA authentication on the second HTTP request, and in response to the second HTTP request being authenticated, sends the multimodal streaming content to the message receiver. Therefore, this disclosure improves the security and reliability of message transmission by performing AKA authentication on the second HTTP request, improves the efficiency of message transmission by performing fragmented transmission and breakpoint resumption on the multimodal streaming content, reduces end-to-end interaction latency, and greatly enhances the user experience.

[0106] Figure 5 This is a flowchart illustrating a message transmission method provided in an embodiment of this application.

[0107] like Figure 5As shown, the message transmission method proposed in this embodiment is executed by the message receiving end and includes the following steps: S501, Receive a second streaming message sent by the messaging platform, wherein the second streaming message is related to the first streaming message, and the first streaming message is related to the metadata of the streaming message to be transmitted at the message sender.

[0108] S502, according to the second streaming message, receive the multimodal streaming content of the streaming message to be transmitted sent by the messaging platform.

[0109] In this embodiment of the disclosure, a second HTTP request is sent to the message platform according to the HTTP endpoint corresponding to the message platform in the second streaming message, wherein the second HTTP request is used to request multimodal streaming content.

[0110] In this embodiment of the disclosure, the multimodal streaming content is decrypted based on the encrypted metadata in the second streaming message, and the decrypted multimodal streaming content is then stream-rendered.

[0111] For example, to achieve resumeable streaming, the transmission progress of multimodal streaming content can be synchronized every 30 seconds based on SIP INFO messages: INFO sip:userA@operator.com SIP / 2.0 Content-Type: application / stream-status { "msg_id": "5GMSG-2023-123456", "received_bytes": 3145728 / / 3MB has been received so far. } Optionally, the multimodal streaming content can be decrypted based on the encryption key in the encryption metadata, and the rendering engine can be invoked to perform real-time rendering based on the type of the multimodal streaming content.

[0112] For example, if the type of multimodal streaming content is text, it is rendered in real time through incremental updates of the Document Object Model (DOM); if the type of multimodal streaming content is audio, it is rendered in real time through streaming playback via the Web Audio Application Programming Interface (API); if the type of multimodal streaming content is video, it is rendered in real time through the Media Source Extension; and if the type of multimodal streaming content is image, it is rendered in real time through canvas-by-canvas drawing.

[0113] For example, for multimodal streaming content of type text, real-time rendering can be achieved using the following interpreted scripting language (javascript): const decoder = new TextDecoder(); let buffer = ""; httpStream.on('data', (chunk) =>{ buffer += decoder.decode(chunk, {stream: true}); / / Line-by-line rendering (supports typewriter effect) displayEngine.renderIncremental(buffer); }); For example, for multimodal streaming content of the video type, real-time rendering can be achieved by dynamically splicing the content using the Web Audio API through the following interpreted scripting language (javascript): const mediaSource = new MediaSource(); videoElement.src = URL.createObjectURL(mediaSource); mediaSource.addEventListener('sourceopen', () =>{ const sourceBuffer = mediaSource.addSourceBuffer('video / mp4; codecs="hev1.1.6.L123"'); httpStream.on('data', (chunk) =>{ sourceBuffer.appendBuffer(decrypt(chunk)); }); }); In summary, the message transmission method provided in this disclosure receives a second streaming message sent by a message platform, wherein the second streaming message is related to a first streaming message, and the first streaming message is related to the metadata of the streaming message to be transmitted at the message sender. Based on the second streaming message, the multimodal streaming content of the streaming message to be transmitted sent by the message platform is received. Based on the encrypted metadata in the second streaming message, the multimodal streaming content is decrypted, and the decrypted multimodal streaming content is stream-rendered. Thus, this disclosure achieves efficient end-to-end transmission and real-time presentation of streaming content, realizes real-time display of content, improves resource utilization, reduces end-to-end latency, and enhances user experience.

[0114] The specific process of the message transmission method provided in the embodiments of this disclosure will be explained below.

[0115] It should be noted that in the relevant technologies, large files are transmitted in chunks to reduce transmission delay, but this solution has the following problems: (1) Transmission delay, that is, large files need to be received completely before processing, and the first screen wait time is long; (2) Resource waste, that is, the message receiving end needs to cache the complete file, occupying memory and storage space; (3) Limited interaction: it is impossible to realize real-time scenarios such as video frame-by-frame playback and long text progressive loading.

[0116] For example, such as Figure 6 As shown, for the application scenario of real-time live streaming, the message to be transmitted is a type I streaming message. The specific process of the message transmission method may include the following steps: The message sender obtains the metadata and multimodal streaming content of the streaming message to be transmitted; the message sender distributes the multimodal streaming content to the CDN server; the message sender generates a first streaming message based on the metadata of the streaming message to be transmitted, and sends the first streaming message to the 5G messaging platform based on SIP; the 5G messaging platform receives the first streaming message, parses it, and performs secondary encapsulation to obtain a second streaming message; the 5G messaging platform sends the second streaming message to the message receiver; the message receiver receives the second streaming message sent by the 5G messaging platform and sends a second HTTP request to the 5G messaging platform, wherein the second request uses... The 5G messaging platform requests multimodal streaming content; it sends an HTTP request to the message receiver requiring AKA authentication for the second HTTP request; the message receiver sends authentication information for the second HTTP request; in response to successful authentication of the second HTTP request, it sends a third HTTP request to the CDN server, whereby the third HTTP request is used to request multimodal streaming content; the CDN server responds to the third HTTP request and sends the multimodal streaming content to the 5G messaging platform; the 5G messaging platform sends the multimodal streaming content to the message receiver; and the message receiver performs streaming rendering of the multimodal streaming content.

[0117] For example, such as Figure 7 As shown, for interactive application scenarios, the message to be transmitted is a second type of streaming message. The specific process of the message transmission method may include the following steps: The message sender obtains the metadata and multimodal streaming content of the streaming message to be transmitted; based on the metadata, the message sender generates a first streaming message and sends it to the 5G messaging platform via SIP; the 5G messaging platform receives the first streaming message, parses it, and performs secondary encapsulation to obtain a second streaming message; the 5G messaging platform sends the second streaming message to the message receiver; the 5G messaging platform sends a first HTTP request to the message sender, wherein the first HTTP request is used to request multimodal streaming content; the message sender responds to the first HTTP request and sends multiple streaming content to the 5G messaging platform. The 5G messaging platform preloads multimodal streaming content. The message receiver receives a second streaming message from the 5G messaging platform and sends a second HTTP request to the platform, whereby the second request is used to request multimodal streaming content. The 5G messaging platform sends an HTTP request to the message receiver requiring AKA authentication for the second HTTP request. The message receiver sends authentication information for the second HTTP request based on HTTP. In response to successful authentication of the second HTTP request, the 5G messaging platform sends multimodal streaming content to the message receiver based on HTTP. The message receiver then performs streaming rendering of the multimodal streaming content.

[0118] For example, if the application scenario is intelligent customer service, the message receiving end performs streaming rendering of multimodal streaming content. The streaming interface effect of 5G messages is as follows: Figure 8 As shown, the message receiving end performs streaming rendering of multimodal streaming content. The streaming interface effect of 5G messages is as follows: Figure 9 As shown.

[0119] It should be noted that the message transmission method provided in this disclosure can deeply empower real-time and interactive application scenarios in multiple vertical fields, such as: (1) In the scenario of intelligent customer service: the progressive response technology can realize the dialogue flow display of "typewriter effect", and with the synchronous output of voice stream, the user's perceived waiting time is reduced. At the same time, it supports the instant insertion of multimodal content (such as operation guidance video clips), which significantly improves the first problem resolution rate. (2) In the application scenario of the cultural and entertainment industry: real-time live streaming output can effectively cover various vertical fields such as video live streaming and audio live streaming. Based on the characteristics of 5G message without installation and stable communication, it can greatly expand the business service scope of 5G message and fully broaden the user group. (3) In the application scenario of the advertising industry: interactive video advertisements can dynamically load different content branches based on the user's real-time behavior. For example, in car advertisements, users can click the "interior" button to stream relevant 4K video clips, which improves the advertising conversion rate based on the "instant display" experience. (4) In the application scenarios of the financial field: it can realize the streaming push of financial resources with millisecond-level latency and support the progressive rendering of complex data such as K-line charts, enabling users to capture financial market fluctuations in real time. Compared with the traditional SMS notification method, it increases the information carrying capacity.

[0120] In summary, the message transmission method provided in this disclosure physically separates the metadata and multimodal content of the streaming message to be transmitted. By constructing a 5G message security transmission architecture that coordinates SIP and HTTP protocols, the SIP protocol is used to transmit control signaling and security parameters, while the HTTP protocol with AKA authentication completes the segmented transmission of encrypted multimodal streaming content. This constructs a standardized streaming transmission framework supporting multimodal content and implements a terminal-oriented content segmentation and real-time rendering mechanism, supporting simultaneous transmission and display of streaming content. Thus, by deeply modifying the 5G message transmission layer architecture, while maintaining compatibility with existing SIP standards, it achieves efficient end-to-end streaming content transmission and real-time presentation. It shortens the first packet arrival time of long files, enabling real-time display, reduces end-to-end latency, supports CDN distribution via the HTTP channel, and is compatible with multiple encoding and decoding standards, enhancing message transmission compatibility, reducing core network load, and using HTTP instead of SIP to transmit data, reducing redundant signaling overhead, saving network resources, and greatly improving user experience. It can be applied to high-bandwidth, low-latency 5G messaging scenarios.

[0121] The dual-channel layered architecture of the message transmission method provided in the embodiments of this disclosure will be explained below.

[0122] For example, such as Figure 10As shown, for the control channel: based on the SIP protocol (RFC 3261), it is responsible for transmitting control signaling, including: session establishment / termination (INVITE / BYE), streaming metadata transmission of streaming messages to be transmitted (MESSAGE method extension), transmission status synchronization (INFO method), etc.; for the data channel: based on HTTP / 2 (RFC 7540) or WebSocket (RFC 6455), it is responsible for multimodal streaming content fragmentation transmission, dynamic bitrate adaptation, CDN content distribution, etc.

[0123] In summary, real-time transmission of multimodal content is achieved through the collaborative operation of SIP and HTTP protocols. At the control channel level, the SIP protocol is extended to carry streaming metadata of messages to be transmitted, completing session establishment and authentication. At the data channel level, the HTTP / 2 chunked transmission mechanism is adopted to achieve progressive transmission and real-time rendering of multimodal streaming content such as text, voice, and video. Furthermore, an HTTP channel with AKA is newly introduced, using request-level token verification of user authentication information and time window protection to achieve fine-grained security control. It also supports dynamic bitrate adaptation and breakpoint resumption. Combined with hardware acceleration optimization, the start time of long videos / long audios / long texts is significantly reduced to within 1 second. The dual-protocol architecture can effectively reduce the redundant signaling overhead of the SIP protocol and improve bandwidth utilization. By expanding protocol fields and broadening the two streaming models, it supports interactive dialogue streaming scenarios and real-time live streaming content transmission scenarios. Moreover, through key rotation strategy and two-way authentication mechanism, the illegal access interception rate is improved. It is compatible with the existing 5G messaging architecture and significantly improves the efficiency and security of large-capacity message transmission.

[0124] Figure 11 This is a block diagram illustrating a message transmission device according to an exemplary embodiment.

[0125] like Figure 11 As shown, the message transmission device 1100 of this embodiment is applied to a message sending end and may specifically include: an acquisition module 1101, a generation module 1102, a first sending module 1103, and a second sending module 1104.

[0126] The acquisition module 1101 is used to acquire the streaming message to be transmitted, split the streaming message to be transmitted, and acquire the metadata and multimodal streaming content of the streaming message to be transmitted. The generation module 1102 is used to generate a first streaming message based on the metadata of the streaming message to be transmitted; The first sending module 1103 is used to send a first streaming message to the messaging platform based on the Session Initiation Protocol (SIP). The second sending module 1104 is used to send the multimodal streaming content to the messaging platform based on the first streaming message and the Hypertext Transfer Protocol (HTTP), wherein the multimodal streaming content is sent to the message receiving end through the messaging platform.

[0127] In one embodiment of this disclosure, the metadata of the streaming message to be transmitted includes at least: the message identifier of the streaming message to be transmitted; the HTTP endpoint corresponding to the message sender; the message type of the streaming message to be transmitted; and the encryption metadata of the streaming message to be transmitted.

[0128] In one embodiment of this disclosure, the device 1100 is further configured to: synchronously update the encrypted metadata of the streaming message to be transmitted in response to the size of the transmitted multimodal streaming content meeting a preset condition.

[0129] In one embodiment of this disclosure, the second sending module 1104 is further configured to: in response to the message identifier indicating that the streaming message to be transmitted is a first type of streaming message, distribute the multimodal streaming content to a content delivery network (CDN) server, so as to send the multimodal streaming content to the message platform through the CDN server and the HTTP endpoint of the message platform.

[0130] In one embodiment of this disclosure, the second sending module 1104 is further configured to: in response to the message identifier indicating that the streaming message to be transmitted is a second type of streaming message, receive a first HTTP request sent by the message platform based on the HTTP endpoint corresponding to the message sending end, wherein the first HTTP request is used to request the multimodal streaming content; and send the multimodal streaming content to the message platform.

[0131] In the embodiments of this disclosure, the specific manner in which each structure in the message transmission device of the above embodiments performs operations has been described in detail in the embodiments related to the message transmission method, and will not be repeated here.

[0132] The message transmission apparatus provided in this disclosure acquires a streaming message to be transmitted, splits the streaming message to be transmitted, acquires the metadata and multimodal streaming content of the streaming message to be transmitted, generates a first streaming message based on the metadata of the streaming message to be transmitted, sends the first streaming message to a message platform based on the Session Initiation Protocol (SIP), and sends multimodal streaming content to the message platform based on the first streaming message and the Hypertext Transfer Protocol (HTTP). The multimodal streaming content is sent to the message receiving end through the message platform. Thus, this disclosure improves the transmission efficiency of multimodal streaming content, reduces end-to-end interaction latency, and meets real-time interaction requirements by physically separating the transmission of the metadata and multimodal content of the streaming message to be transmitted and achieving real-time transmission of multimodal streaming content through the collaboration of SIP and HTTP dual protocols.

[0133] Figure 12 This is a block diagram illustrating a message transmission device according to an exemplary embodiment.

[0134] like Figure 12 As shown, the message transmission device 1200 of this embodiment is applied to a message platform and may specifically include: a first receiving module 1201, a first acquiring module 1202 and a third sending module 1203.

[0135] The first receiving module 1201 is used to receive a first streaming message sent by the message sending end, wherein the first streaming message is related to the metadata of the streaming message to be transmitted by the message sending end; The first acquisition module 1202 is used to acquire the multimodal streaming content of the streaming message to be transmitted based on the HTTP endpoint corresponding to the message platform and the first streaming message; The third sending module 1203 is used to send the multimodal streaming content to the message receiving end.

[0136] In one embodiment of this disclosure, the first acquisition module 1202 is further configured to: update the first streaming message according to the HTTP endpoint corresponding to the message platform to obtain a second streaming message; send the second streaming message to the message receiving end; and acquire the multimodal streaming content according to the second streaming message.

[0137] In one embodiment of this disclosure, the first acquisition module 1202 is further configured to: receive a second HTTP request sent by the message receiving end, wherein the second HTTP request is used to request the multimodal streaming content, and the second HTTP request is related to the HTTP endpoint corresponding to the message platform in the second streaming message; and acquire the multimodal streaming content according to the second HTTP request.

[0138] In one embodiment of this disclosure, the first acquisition module 1202 is further configured to: in response to the message identifier indicating that the streaming message to be transmitted is a first type of streaming message, perform authentication and key negotiation AKA authentication on the second HTTP request; in response to the second HTTP request being authenticated, send a third HTTP request to the CDN server, wherein the third HTTP request is used to request the multimodal streaming content; and receive the multimodal streaming content sent by the CDN server.

[0139] In one embodiment of this disclosure, the first acquisition module 1202 is further configured to: respond to the message identifier indicating that the streaming message to be transmitted is a second type of streaming message; send a first HTTP request to the message sending end based on the HTTP endpoint corresponding to the message sending end, wherein the first HTTP request is used to request the multimodal streaming content; and receive the multimodal streaming content sent by the message sending end.

[0140] In one embodiment of this disclosure, the third sending module 1203 is further configured to: perform AKA authentication on the second HTTP request; and, in response to the successful authentication of the second HTTP request, send the multimodal streaming content to the message receiving end.

[0141] In one embodiment of this disclosure, the third sending module 1203 is further configured to: segment the multimodal streaming content according to a preset segmentation strategy, and obtain segmented streaming sub-content; send the streaming sub-content to the message receiving end; and resume transmission of the target streaming sub-content in response to the detection that the target streaming sub-content of the multimodal streaming content has been interrupted.

[0142] In the embodiments of this disclosure, the specific manner in which each structure in the message transmission device of the above embodiments performs operations has been described in detail in the embodiments related to the message transmission method, and will not be repeated here.

[0143] The message transmission apparatus provided in this disclosure receives a first streaming message sent by a message sender, wherein the first streaming message is related to the metadata of the streaming message to be transmitted at the message sender. Based on the HTTP endpoint corresponding to the message platform and the first streaming message, the apparatus obtains the multimodal streaming content of the streaming message to be transmitted and sends the multimodal streaming content to the message receiver. Thus, this disclosure obtains the multimodal streaming content of the streaming message to be transmitted based on the HTTP endpoint corresponding to the message platform and the first streaming message, thereby reducing the transmission latency of the multimodal streaming content and improving the transmission efficiency of the multimodal streaming content.

[0144] Figure 13 This is a block diagram illustrating a message transmission device according to an exemplary embodiment.

[0145] like Figure 13 As shown, the message transmission device 1300 of this embodiment is applied to a message receiving end and may specifically include a second receiving module 1301 and a third receiving module 1302.

[0146] The second receiving module 1301 is used to receive a second streaming message sent by the message platform, wherein the second streaming message is related to the first streaming message, and the first streaming message is related to the metadata of the streaming message to be transmitted at the message sending end; The third receiving module 1302 is used to receive the multimodal streaming content of the streaming message to be transmitted sent by the message platform according to the second streaming message.

[0147] In one embodiment of this disclosure, the third receiving module 1302 is further configured to: send a second HTTP request to the message platform according to the HTTP endpoint corresponding to the message platform in the second streaming message, wherein the second HTTP request is used to request the multimodal streaming content.

[0148] In one embodiment of this disclosure, after receiving the multimodal streaming content of the streaming message to be transmitted sent by the message platform, the device 1300 is further configured to: decrypt the multimodal streaming content according to the encryption metadata in the second streaming message; and perform streaming rendering on the decrypted multimodal streaming content.

[0149] In the embodiments of this disclosure, the specific manner in which each structure in the message transmission device of the above embodiments performs operations has been described in detail in the embodiments related to the message transmission method, and will not be repeated here.

[0150] The message transmission apparatus provided in this disclosure receives a second streaming message sent by a message platform. The second streaming message is related to a first streaming message, and the first streaming message is related to the metadata of the streaming message to be transmitted at the message sender. Based on the second streaming message, the apparatus receives the multimodal streaming content of the streaming message to be transmitted sent by the message platform. Based on the encrypted metadata in the second streaming message, the apparatus decrypts the multimodal streaming content and performs streaming rendering on the decrypted multimodal streaming content. Thus, this disclosure achieves efficient end-to-end streaming content transmission and real-time presentation, realizes real-time content display, improves resource utilization, reduces end-to-end latency, and enhances user experience.

[0151] Figure 14 This is a block diagram illustrating an electronic device 1400 according to an exemplary embodiment.

[0152] like Figure 14 As shown, the aforementioned electronic device 1400 includes: The memory 1401 and the processor 1402 are connected by a bus 1403, which connects the different components (including the memory 1401 and the processor 1402). The memory 1401 stores a computer program, and when the processor 1402 executes the program, it implements the message transmission method of the present disclosure embodiment.

[0153] Bus 1403 represents one or more of several bus architectures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local bus using any of the various bus architectures. For example, these architectures include, but are not limited to, the Industry Standard Architecture (ISA) bus, the Micro Channel Architecture (MAC) bus, the Enhanced ISA bus, the Video Electronics Standards Association (VESA) local bus, and the Peripheral Component Interconnect (PCI) bus.

[0154] Electronic device 1400 typically includes a variety of electronic device readable media. These media can be any available media that can be accessed by electronic device 1400, including volatile and non-volatile media, removable and non-removable media.

[0155] Memory 1401 may also include computer system readable media in the form of volatile memory, such as random access memory (RAM) 1404 and / or cache memory 1405. Electronic device 1400 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, storage system 1406 may be used to read and write non-removable, non-volatile magnetic media (… Figure 14 Not shown; usually referred to as a "hard drive"). Although Figure 14 As not shown, a disk drive for reading and writing to a removable non-volatile disk (e.g., a "floppy disk") and an optical disk drive for reading and writing to a removable non-volatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 1403 via one or more data media interfaces. Memory 1401 may include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of the embodiments of this disclosure.

[0156] A program / utility 1408 having a set (at least one) of program modules 1407 may be stored, for example, in memory 1401. Such program modules 1407 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include an implementation of a network environment. Program modules 1407 typically perform the functions and / or methods described in the embodiments of this disclosure.

[0157] Electronic device 1400 can also communicate with one or more external devices 1409 (e.g., keyboard, pointing device, display 1411, etc.), and with one or more devices that enable a user to interact with the electronic device 1400, and / or with any device that enables the electronic device 1400 to communicate with one or more other computing devices (e.g., network card, modem, etc.). This communication can be performed via input / output (I / O) interface 1412. Furthermore, electronic device 1400 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via network adapter 1413. Figure 14 As shown, network adapter 1413 communicates with other modules of electronic device 1400 via bus 1403. It should be understood that, although not shown in the figure, other hardware and / or software modules can be used in conjunction with electronic device 1400, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0158] The processor 1402 performs various functional applications and data processing by running programs stored in the memory 1401.

[0159] It should be noted that the implementation process and technical principles of the electronic device in this embodiment are explained in the foregoing description of the message transmission method of the present disclosure embodiment, and will not be repeated here.

[0160] To implement the above embodiments, this disclosure also proposes a computer-readable storage medium.

[0161] When the instructions in the computer-readable storage medium are executed by the processor of the electronic device, the electronic device is able to perform the message transmission method as described above. Optionally, the computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, or optical data storage device, etc.

[0162] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the following claims.

[0163] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A message transmission method, characterized in that, Executed by the message sender, the method includes: Obtain the streaming message to be transmitted, split the streaming message to be transmitted, and obtain the metadata and multimodal streaming content of the streaming message to be transmitted; Generate a first streaming message based on the metadata of the streaming message to be transmitted; The first streaming message is sent to the messaging platform based on the Session Initiation Protocol (SIP). Based on the first streaming message and the Hypertext Transfer Protocol (HTTP), the multimodal streaming content is sent to the messaging platform, wherein the multimodal streaming content is sent to the message receiving end through the messaging platform.

2. The method according to claim 1, characterized in that, The metadata of the streaming message to be transmitted includes at least: The message identifier of the streaming message to be transmitted; The HTTP endpoint corresponding to the message sender; The message type of the streaming message to be transmitted; The encrypted metadata of the streaming message to be transmitted.

3. The method according to claim 2, characterized in that, The method includes: In response to the fact that the size of the multimodal streaming content being sent meets a preset condition, the encrypted metadata of the streaming message to be transmitted is updated synchronously.

4. The method according to claim 2, characterized in that, The step of sending the multimodal streaming content to the messaging platform based on the first streaming message and the Hypertext Transfer Protocol (HTTP) includes: In response to the message identifier indicating that the streaming message to be transmitted is a first-type streaming message, The multimodal streaming content is distributed to a content delivery network (CDN) server, and then sent to the messaging platform via the CDN server and the messaging platform's HTTP endpoint.

5. The method according to claim 2, characterized in that, The step of sending the multimodal streaming content to the messaging platform based on the first streaming message and the Hypertext Transfer Protocol (HTTP) includes: In response to the message identifier indicating that the streaming message to be transmitted is a second type of streaming message, a first HTTP request sent by the message platform is received based on the HTTP endpoint corresponding to the message sending end, wherein the first HTTP request is used to request the multimodal streaming content; Send the multimodal streaming content to the messaging platform.

6. A message transmission method, characterized in that, The method, executed by the messaging platform, includes: Receive a first streaming message sent by a message sender, wherein the first streaming message is related to the metadata of the streaming message to be transmitted by the message sender; Based on the HTTP endpoint corresponding to the messaging platform and the first streaming message, obtain the multimodal streaming content of the streaming message to be transmitted; Send the multimodal streaming content to the message receiving end.

7. The method according to claim 6, characterized in that, The step of obtaining the multimodal streaming content of the streaming message to be transmitted based on the HTTP endpoint corresponding to the messaging platform and the first streaming message includes: The first streaming message is updated based on the HTTP endpoint corresponding to the messaging platform to obtain the second streaming message; Send the second streaming message to the message receiving end; The multimodal streaming content is obtained based on the second streaming message.

8. The method according to claim 7, characterized in that, The step of obtaining the multimodal streaming content based on the second streaming message includes: Receive a second HTTP request sent by the message receiving end, wherein the second HTTP request is used to request the multimodal streaming content, and the second HTTP request is related to the HTTP endpoint corresponding to the message platform in the second streaming message; The multimodal streaming content is obtained based on the second HTTP request.

9. The method according to claim 8, characterized in that, The step of obtaining the multimodal streaming content according to the second HTTP request includes: In response to the message identifier indicating that the streaming message to be transmitted is a first type of streaming message, the second HTTP request is authenticated and authenticated using key negotiation (AKA). In response to the successful authentication of the second HTTP request, a third HTTP request is sent to the CDN server, wherein the third HTTP request is used to request the multimodal streaming content; Receive the multimodal streaming content sent by the CDN server.

10. The method according to claim 7, characterized in that, The step of obtaining the multimodal streaming content based on the second streaming message includes: In response to the message identifier indicating that the streaming message to be transmitted is a second type of streaming message; Based on the HTTP endpoint corresponding to the message sender, a first HTTP request is sent to the message sender, wherein the first HTTP request is used to request the multimodal streaming content; Receive multimodal streaming content sent by the message sender.

11. The method according to claim 10, characterized in that, Sending the multimodal streaming content to the message receiver includes: Perform AKA authentication on the second HTTP request; Upon successful authentication of the second HTTP request, the multimodal streaming content is sent to the message receiver.

12. The method according to claim 6, characterized in that, Sending the multimodal streaming content to the message receiver includes: According to the preset segmentation strategy, the multimodal streaming content is segmented to obtain the segmented streaming sub-content; Send the streaming sub-content to the message receiving end; In response to the detection that the target streaming sub-content of the multimodal streaming content has been interrupted, the target streaming sub-content is resumed from the point of interruption.

13. A message transmission method, characterized in that, The method, executed by the message receiver, includes: Receive a second streaming message sent by a messaging platform, wherein the second streaming message is related to a first streaming message, and the first streaming message is related to the metadata of the streaming message to be transmitted at the message sending end; According to the second streaming message, the multimodal streaming content of the streaming message to be transmitted sent by the messaging platform is received.

14. The method according to claim 13, characterized in that, The step of receiving the multimodal streaming content of the streaming message to be transmitted sent by the messaging platform according to the second streaming message includes: Based on the HTTP endpoint corresponding to the message platform in the second streaming message, a second HTTP request is sent to the message platform, wherein the second HTTP request is used to request the multimodal streaming content.

15. The method according to claim 13, characterized in that, After receiving the multimodal streaming content of the streaming message to be transmitted sent by the messaging platform, the method further includes: The multimodal streaming content is decrypted based on the encrypted metadata in the second streaming message; Perform streaming rendering on the decrypted multimodal streaming content.

16. A message transmission device, characterized in that, The device, applied to a message sending end, includes: The acquisition module is used to acquire the streaming message to be transmitted, split the streaming message to be transmitted, and acquire the metadata and multimodal streaming content of the streaming message to be transmitted. A generation module is used to generate a first streaming message based on the metadata of the streaming message to be transmitted; The first sending module is used to send the first streaming message to the messaging platform based on the Session Initiation Protocol (SIP). The second sending module is used to send the multimodal streaming content to the messaging platform based on the first streaming message and the Hypertext Transfer Protocol (HTTP), wherein the multimodal streaming content is sent to the message receiving end through the messaging platform.

17. A message transmission device, characterized in that, The device, applied to a messaging platform, includes: The first receiving module is used to receive a first streaming message sent by the message sending end, wherein the first streaming message is related to the metadata of the streaming message to be transmitted by the message sending end; The first acquisition module is used to acquire the multimodal streaming content of the streaming message to be transmitted based on the HTTP endpoint corresponding to the message platform and the first streaming message; The third sending module is used to send the multimodal streaming content to the message receiving end.

18. A message transmission device, characterized in that, The device, applied to a message receiving end, includes: The second receiving module is used to receive a second streaming message sent by the messaging platform, wherein the second streaming message is related to the first streaming message, and the first streaming message is related to the metadata of the streaming message to be transmitted at the message sending end; The third receiving module is used to receive the multimodal streaming content of the streaming message to be transmitted sent by the message platform according to the second streaming message.

19. An electronic device, characterized in that, include: processor; Memory for storing the executable instructions of the processor; The processor is configured to execute the instructions to implement the message transmission method as described in any one of claims 1-5, 6-12, or 13-15.

20. A computer-readable storage medium, characterized in that, When the instructions in the computer-readable storage medium are executed by the processor of the electronic device, the electronic device is enabled to perform the message transmission method as described in any one of claims 1-5, 6-12, or 13-15.

21. A computer program product, characterized in that, Includes a computer program that, when executed by a processor, implements the message transmission method according to any one of claims 1-5, 6-12, or 13-15.

Images