Satellite communication-based live interaction method and device, equipment and storage medium

Abstract

The application discloses a satellite communication-based live broadcast interaction method and device, equipment and a storage medium, relates to the field of video transmission, and is applied to a target server and comprises the following steps: acquiring a target live broadcast video stream sent by a first type of client corresponding to a target live broadcast room through a first type of port number, and acquiring a target multicast stream corresponding to the target live broadcast video stream based on a first target transmission protocol; the first target transmission protocol is a real-time transmission protocol based on a user datagram protocol; acquiring a target interaction message stream sent by a second type of client through a second type of port number, and processing the target interaction message stream to acquire a corresponding target message stream; the target message stream is a message stream transmitted based on a second target transmission protocol; and the target message stream is displayed on each target client corresponding to the target live broadcast room based on the message types of the interaction messages in the target message stream. The application improves the live broadcast watching experience of users.

Description

Technical Field

[0001] This invention relates to the field of video transmission, and in particular to live interactive methods, apparatus, devices and storage media based on satellite communication. Background Technology

[0002] With the development of mobile internet, various live streaming platforms provide users with an immersive viewing experience through real-time video transmission and interactive bullet comments. However, traditional internet live streaming relies entirely on terrestrial network infrastructure. In remote areas, on ships at sea, and on airplanes, where terrestrial network coverage is insufficient, satellite communication becomes the only network access method. Satellite networks have advantages such as wide coverage and no terrain limitations, but their bandwidth resources are limited and expensive, making it difficult to directly migrate traditional live streaming architectures.

[0003] In conclusion, how to utilize satellite communication to improve users' live streaming viewing experience is a problem that urgently needs to be solved. Summary of the Invention

[0004] In view of this, the purpose of this invention is to provide a live interactive method, apparatus, device, and storage medium based on satellite communication, which can improve the user's live viewing experience by utilizing satellite communication. The specific solution is as follows: Firstly, this application discloses a live interactive method based on satellite communication, applied to a target server, including: The system obtains the target live video stream sent by the first type of client corresponding to the target live room through the first type of port number, and obtains the target multicast stream corresponding to the target live video stream based on the first target transmission protocol. The system then sends the target multicast stream to the second type of client corresponding to the target live room via satellite multicast. The first target transmission protocol is a real-time transmission protocol based on the User Datagram Protocol. The target interactive message stream sent by the second type of client through the second type of port number is obtained, and the target interactive message stream is processed to obtain the corresponding target message stream; the target message stream is a message stream transmitted based on the second target transmission protocol; Based on the message type corresponding to each interactive message in the target message stream, the target message stream is displayed on each target client corresponding to the target live streaming room; the target client includes the first type of client and the second type of client.

[0005] Optionally, before obtaining the target live video stream sent by the first type of client corresponding to the target live room through the first type of port number, the method further includes: Assign a first-type port number and a second-type port number to each target live streaming room, and save the first-type port number and the second-type port number to the port database.

[0006] Optionally, the target server includes a streaming media server, an interactive server, and a port allocation server. The streaming media server is used to transcode, encapsulate, and output the received live video stream. The interactive server is used to process and distribute the received interactive message stream. The port allocation server is used to manage port resources.

[0007] Optionally, displaying the target message stream on each target client corresponding to the target live streaming room based on the message type corresponding to each interactive message in the target message stream includes: Based on the message type corresponding to each interactive message in the target message stream, determine whether the interactive message meets the preset unicast condition; If the interactive message meets the preset unicast conditions, the interactive message is transmitted to the target client corresponding to the interactive message via satellite unicast; If the interactive message does not meet the preset unicast conditions, the interactive message will be displayed on each of the target clients corresponding to the target live broadcast room via satellite multicast.

[0008] Optionally, the method further includes: If a target message that meets the reliable transmission conditions is obtained, the target message is sent to the target client based on a preset reliable transmission mechanism, and the transmission feedback result sent by the target client based on the target sliding window is obtained, so as to determine whether the target message has been successfully delivered based on the transmission feedback result; wherein, the target sliding window is a sliding window used by the target client to record the message sequence number corresponding to the processed target message locally.

[0009] Optionally, the method further includes: If the second type of client is detected to meet the keyframe preloading condition, the preloaded live room corresponding to the second type of client is determined based on the preset live room filtering strategy, and the target keyframe corresponding to the target multicast stream of each preloaded live room is determined, so as to send the target keyframe to the second type of client.

[0010] Optionally, the method further includes: The target multicast stream corresponding to the target live room that meets the target popularity condition is sent to the corresponding second type of client so that the target multicast stream can be loaded through the second type of client.

[0011] Secondly, this application discloses a live interactive device based on satellite communication, applied to a target server, comprising: The multicast stream delivery module is used to obtain the target live video stream sent by a first type of client corresponding to the target live room through a first type of port number, and obtain the target multicast stream corresponding to the target live video stream based on a first target transmission protocol, and deliver the target multicast stream to the second type of client corresponding to the target live room via satellite multicast; the first target transmission protocol is a real-time transmission protocol based on the User Datagram Protocol; An interactive message processing module is used to acquire the target interactive message stream sent by the second type of client through the second type of port number, and process the target interactive message stream to obtain the corresponding target message stream; the target message stream is a message stream transmitted based on the second target transmission protocol; The interactive message display module is used to display the target message stream on each target client corresponding to the target live streaming room based on the message type corresponding to each interactive message in the target message stream; the target client includes the first type of client and the second type of client.

[0012] Thirdly, this application discloses an electronic device, including: Memory, used to store computer programs; A processor is used to execute the computer program to implement the aforementioned satellite communication-based live interactive method.

[0013] Fourthly, this application discloses a computer-readable storage medium for storing a computer program, wherein the computer program, when executed by a processor, implements the aforementioned live interactive method based on satellite communication.

[0014] In this application, during live interactive broadcasts via satellite communication, the target server obtains the target live video stream sent by a first type of client to the target live room through a first type of port number, and obtains the target multicast stream corresponding to the target live video stream based on a first target transmission protocol. The target multicast stream is then distributed via satellite multicast to a second type of client to the target live room. The first target transmission protocol is a real-time transmission protocol based on the User Datagram Protocol (UDP). The server also obtains the target interactive message stream sent by the second type of client through a second type of port number, and processes the target interactive message stream to obtain a corresponding target message stream. The target message stream is a message stream transmitted based on a second target transmission protocol. Based on the message type corresponding to each interactive message in the target message stream, the target message stream is displayed to each target client to the target live room. The target clients include the first type of client and the second type of client. As can be seen, this application realizes a converged architecture of internet live streaming and satellite multicast. The video stream (multicast downlink) and interactive messages (unicast bidirectional) within the same live streaming room are transmitted using different port numbers, each employing an optimal transmission strategy to balance real-time performance and reliability. This combines the complete interactive experience of internet live streaming (bullet comments, likes, gifts, etc.) with the bandwidth efficiency of satellite multicast, thereby enabling live interactive functions on the satellite network. The user experience is essentially the same as that of terrestrial network live streaming. Furthermore, by adopting a multicast architecture, N users share one share of video traffic, reducing costs to 1 / N of traditional unicast solutions. Attached Figure Description

[0015] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on the provided drawings without creative effort.

[0016] Figure 1 This application discloses a flowchart of a live interactive method based on satellite communication. Figure 2 This is a schematic diagram of the structure of a live interactive device based on satellite communication disclosed in this application; Figure 3 This is a structural diagram of an electronic device disclosed in this application. Detailed Implementation

[0017] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0018] With the development of mobile internet, various live streaming platforms provide users with an immersive viewing experience through real-time video transmission and interactive bullet comments. However, traditional internet live streaming relies entirely on terrestrial network infrastructure. In remote areas, on ships at sea, and on airplanes, where terrestrial network coverage is insufficient, satellite communication becomes the only network access method. Satellite networks have advantages such as wide coverage and no terrain limitations, but their bandwidth resources are limited and expensive, making it difficult to directly migrate traditional live streaming architectures. To solve the above technical problems, this application discloses a live streaming interaction method based on satellite communication, which can improve the user's live streaming viewing experience by utilizing satellite communication.

[0019] See Figure 1 As shown, this embodiment of the invention discloses a live interactive method based on satellite communication, applied to a target server, including: Step S11: Obtain the target live video stream sent by the first type of client corresponding to the target live room through the first type of port number, and obtain the target multicast stream corresponding to the target live video stream based on the first target transmission protocol, and send the target multicast stream to the second type of client corresponding to the target live room through satellite multicast; the first target transmission protocol is a real-time transmission protocol based on the User Datagram Protocol.

[0020] In this embodiment, the target server includes a streaming media server, an interactive server, and a port allocation server. The streaming media server transcodes, encapsulates, and outputs the received live video stream. The interactive server processes and distributes the received interactive message stream. The port allocation server manages port resources. Before obtaining the target live video stream sent by the first type of client through the first type of port number corresponding to the target live room, the target server further includes: allocating a first type of port number and a second type of port number to each target live room, and saving the first type of port number and the second type of port number to a port database to avoid conflicts. The target server includes a streaming media server, an interactive server, and a port allocation server. The streaming media server transcodes, encapsulates, and outputs the received live video stream. The interactive server processes and distributes the received interactive message stream. The port allocation server manages port resources.

[0021] In one specific implementation, the first type of client corresponding to the target live streaming room is typically the streaming client. The broadcaster uses streaming devices such as OBS (Open Broadcaster Software) and mobile phones to push the live stream to the streaming media server via protocols such as RTMP / SRT (Real-Time Messaging Protocol / Secure Reliable Transport). The second type of client (user terminal) is a terminal device equipped with a customized user APP. This user APP supports RTP (Real-time Transport Protocol) playback and integrates SLP (Service Location Protocol) protocol stack, bullet screen rendering, live stream list, user system, gift system, and other functions. The satellite network can be implemented using GEO synchronous satellites, providing multicast downlink channels (video stream, interactive messages) and unicast bidirectional channels (user operations, HTTP (Hypertext Transfer Protocol) requests). Accordingly, in addition to the streaming terminal, streaming media server, interactive server, port allocation service, business API (Application Programming Interface) server, satellite network, and user terminal equipment, the live interactive system built based on this embodiment also needs to include satellite terminal equipment, which is used to receive satellite signals and provide them to user terminals through WiFi hotspots, while caching popular live streaming content.

[0022] In one specific implementation, when the target server receives the target live video stream sent by the first type of client through the first type of port number corresponding to the target live room, the streaming media server is responsible for receiving the target live video stream, then transcoding it (H.265 encoding, 1080P resolution, bitrate within 1024Kbps) and encapsulating it into a target multicast stream in TS format. Finally, the target multicast stream is output through the first target transport protocol, which is a Real-Time Transport Protocol (RTP) based on the User Datagram Protocol. Specific video encoding parameters can be found in the following encoding scheme: Encoding format: H.265 / HEVC Main Profile; Resolution: 1920×1080 (1080P); Frame rate: 30fps; Bitrate: 800-1024 Kbps (CBR (Constant Bit Rate)). GOP (Group of Pictures) length: 60 frames (2 seconds); Number of B-frames: 2 (IBBPBBP...); Reference frame count: 4; Understandably, based on this encoding scheme, when users switch live stream rooms, they only need to wait a maximum of 2 seconds to receive the I-frame and start playback. With the preloading mechanism, this can be further reduced to less than 1 second. Compared to a 1-second GOP, a 2-second GOP reduces the bitrate by approximately 20% (lower I-frame proportion), saving satellite bandwidth costs; compared to GOPs of 5 seconds or more, 2 seconds achieves a better balance between user experience and compression efficiency. The video stream is encapsulated using the RTP protocol and carried in TS (Transport Stream) format, transmitted via satellite multicast downlink. RTP is based on UDP (User Datagram Protocol), avoiding the handshake overhead and retransmission wait times of the TCP (Transmission Control Protocol) protocol on high-latency satellite links. For network packet loss, expired frames are discarded directly without retransmission, ensuring the real-time nature of the live stream.

[0023] In one specific implementation, the port allocation plan is as follows: (1) 20000-29999: Live video stream (RTP), of which 20000-24999 are regular live streams and 25000-29999 are popular / paid live streams; (2) 30000-34999: Interactive Message Flow (SLP); (3) 35000-35999: System broadcast channel; (4) 36000-39999: Reserved for future expansion; (5) Multicast address range: 239.255.0.0 / 16 (local management multicast address); The port allocation server manages the data through a cloud database, recording port allocation information for each live streaming room, including room ID, video stream port (i.e., the first type of port number), interactive stream port (i.e., the second type of port number), multicast address, allocation status, timestamp, etc. The allocation strategy prioritizes reusing ports previously used by the streamer, and then allocates the smallest available port in sequence.

[0024] In this embodiment, the target multicast stream is delivered to the second type of client corresponding to the target live streaming room via satellite multicast. Furthermore, if the second type of client is detected to meet the keyframe preloading conditions, a preloaded live streaming room corresponding to the second type of client is determined based on a preset live streaming room filtering strategy. The target keyframes corresponding to the target multicast streams of each preloaded live streaming room are then determined and delivered to the second type of client, forming a preloading mechanism. Simultaneously, the target multicast streams corresponding to the target live streaming rooms that meet the target popularity conditions can also be delivered to the corresponding second type of client, allowing each second type of client to load the target multicast stream, thereby ensuring the popular live streaming rooms remain active.

[0025] In one specific implementation, the preloading mechanism can be manifested as follows: when a user browses the live stream list, the IDR (Instantaneous Decoding Refresh) keyframes (approximately 50-100KB) of the live streams within the visible area are preloaded, and the keyframes of the 8 most recent live streams are cached, using an LRU (Least Recently Used) strategy for eviction. The trigger condition is that the list scrolling stops for 500ms and the WiFi connection is good. The effect is that when a user clicks to enter a live stream, the first frame is displayed immediately, reducing the black screen wait by approximately 1-2 seconds. At the user's APP level, video streams from the Top 3-5 popular live streams are continuously received, and the frame data of the most recent 10 seconds is saved in a circular buffer. The popular list is updated from the server every 5 minutes, so when a user enters a popular live stream, playback can be instantaneous without waiting for group entry and I-frames, thus enabling popular live streams to remain active. In addition, this embodiment can also construct a delayed departure mechanism, specifically: after a user switches live streams, the original live stream multicast subscription is maintained for a preset delay time before the user actually leaves. If a user returns within a preset delay time (e.g., 5 seconds), playback resumes directly without needing to rejoin the group. The maximum number of simultaneous subscriptions can be set to 5. When a user simultaneously subscribes to more live streams than the maximum, the subscription to the earliest-marked live stream is forcibly terminated. This mechanism reduces the overhead of frequent group joining / leaving during rapid swiping. The preloading mechanism, the persistent popular live stream mechanism, and the delayed leaving mechanism work together to achieve smooth switching between live streams.

[0026] Step S12: Obtain the target interactive message stream sent by the second type of client through the second type of port number, and process the target interactive message stream to obtain the corresponding target message stream; the target message stream is a message stream transmitted based on the second target transmission protocol.

[0027] In this embodiment, to adapt to the high-latency network characteristics of satellite networks, a lightweight custom UDP protocol SLP (SatLive Protocol) is proposed as the second target transmission protocol. It includes a complete frame structure definition, message type system, reliable transmission mechanism, and deduplication strategy, and is used to transmit interactive messages such as bullet comments, likes, and gift notifications, effectively addressing the high-latency and high-cost satellite network environment. The protocol frame structure of the second target transmission protocol (header is 20 bytes) is shown in Table 1 below: Table 1

[0028] In one specific implementation, the message type is defined as follows: 0x01 MSG_DANMU: Bullet screen message, including nickname and bullet screen content; 0x02 MSG_LIKE: Like message, including the number of likes and cumulative value; 0x03 MSG_GIFT: Gift notification, including nickname, gift ID, and quantity; 0x04 MSG_COMMENT: Comment message; 0x05 MSG_ONLINE: Online user count updated; 0x10 CTL_JOIN: Join the live stream; 0x11 CTL_LEAVE: Leaving the live stream; 0x12 CTL_HEARTBEAT: Heartbeat packets (30-second intervals); 0x20 ACK_CONFIRM: Confirmation of receipt; 0x21 ACK_RETRY: Request a retransmission; In this embodiment, after the target server obtains the target interactive message stream sent by the second type of client through the corresponding second type of port number, it can process the target interactive message stream based on the above-mentioned second target transmission protocol to obtain the corresponding target message stream.

[0029] Step S13: Based on the message type corresponding to each interactive message in the target message stream, display the target message stream on each target client corresponding to the target live streaming room; the target client includes the first type of client and the second type of client.

[0030] In this embodiment, based on the message type corresponding to each interactive message in the target message stream, the target message stream is displayed on each target client corresponding to the target live streaming room. Specifically, this may include: determining whether the interactive message meets preset unicast conditions based on the message type corresponding to each interactive message in the target message stream; if the interactive message meets the preset unicast conditions, the interactive message is transmitted to the target client corresponding to the interactive message via satellite unicast; if the interactive message does not meet the preset unicast conditions, the interactive message is displayed on each target client corresponding to the target live streaming room via satellite multicast. In a specific implementation, the message transmission strategy selection method of the target server is shown in Table 2 below: Table 2

[0031] As shown in Table 2, in this embodiment, when designing the message transmission strategy, operations involving money, security, and persistence use HTTPS (Hypertext Transfer Protocol Secure) to ensure reliability; data with high real-time requirements and tolerance for loss uses SLP / UDP to pursue low latency; downlink broadcast data uses multicast to save satellite bandwidth; and uplink interactive data uses unicast. Video streams (multicast downlink) and interactive data (unicast bidirectional) are transmitted through different channels, each employing its optimal transmission strategy. This dual-channel separate transmission mechanism balances real-time performance and reliability.

[0032] In one specific implementation, considering the characteristics of GEO (Geostationary Earth Orbit Satellite) geostationary satellites (one-way delay of approximately 270ms, round-trip delay of approximately 540-600ms), this embodiment can adopt the following adaptation strategy: (1) High latency adaptation: RTP / UDP is used instead of TCP to avoid handshake and retransmission waiting; HTTP requests use connection reuse (Keep-Alive); heartbeat interval is set to 30 seconds (traditional solutions are usually 5-10 seconds).

[0033] (2) High cost adaptation: multicast replaces unicast, N users share 1 share of traffic; likes are aggregated once per second and then broadcast, reducing the number of messages; H.265 encoding has higher compression efficiency than H.264 encoding, and the bit rate is controlled within 1Mbps while ensuring 1080P picture quality, which can further save satellite bandwidth.

[0034] (3) Packet loss handling: Expired frames in the video stream are directly discarded without retransmission; business data adopts a lightweight retransmission mechanism (maximum 3 times).

[0035] It is understandable that this embodiment can use LEO (Low Earth Orbit Satellite) satellites instead of GEO geostationary satellites. LEO satellites (such as Starlink) have lower latency (approximately 20-40ms) and can support more real-time interaction. However, LEO constellations are costly to build and have limited coverage areas, and their commercialization is currently not as advanced as GEO. The protocol and architecture design proposed in this embodiment are also applicable to LEO satellite scenarios, and better latency performance can be achieved after switching.

[0036] In one specific implementation, to ensure that all users see essentially the same video frame when viewing the bullet comments and to improve the interactive experience, a synchronization scheme based on PTS (Presentation Time Stamp) is designed to construct a bullet comment time synchronization mechanism: (1) When a user sends a bullet screen, the bullet screen content is sent to the interactive server via satellite uplink.

[0037] (2) The interactive server calculates the display timestamp: ShowPTS = current video PTS + 500ms (processing delay compensation).

[0038] (3) The interactive server will send the bullet comments (including ShowPTS) to all users via satellite multicast.

[0039] (4) After receiving the bullet comments, the user's App adds them to the display queue and determines the display timing based on the PTS of the currently playing video: if the current PTS < ShowPTS, it is cached and waited; if the current PTS ≥ ShowPTS, it is displayed immediately.

[0040] (5) Boundary handling: If the ShowPTS of the bullet screen is more than 3 seconds behind the current PTS, it will be displayed immediately (too much network latency); if it is more than 5 seconds ahead, it will be discarded (abnormal data).

[0041] In this embodiment, if a target message meeting the reliable transmission conditions is obtained, the target message is sent to the target client based on a preset reliable transmission mechanism, and the transmission feedback result sent by the target client based on the target sliding window is obtained. The success of the target message delivery is then determined based on the transmission feedback result. The target sliding window is a local sliding window on the target client used to record the message sequence number corresponding to the processed target messages. In a specific implementation, a lightweight reliable transmission mechanism is designed for SLP messages (such as system announcements) that require guaranteed delivery: Initial timeout (RTO): 2000ms (considering a round-trip delay of approximately 600ms for GEO satellites); Maximum number of retransmissions: 3; Withdrawal strategy: Exponential withdrawal, RTO×2n (2s → 4s → 8s); Maximum timeout: 8000ms; Send window size: 16 (maximum number of unacknowledged messages); Message deduplication window: 60 seconds (to prevent duplicate processing); The target client maintains a target sliding window record of processed message sequence numbers, with the key '{User ID}_{Room ID}_{Sequence Number}'. It employs an LRU caching strategy, has a capacity of 1000 messages, and a TTL of 60 seconds. Upon receiving a message, it checks if the key exists. If it does, the message is discarded (duplicate message) but an ACK is still sent. If it does not exist, the message is processed and added to the cache.

[0042] It is understood that the architecture of the satellite communication-based live interactive method proposed in this embodiment can also be deployed in a local area network environment, and is suitable for the following scenarios: (1) Internal live training: Employees watch the training live stream via the company WiFi and support bullet screen interaction; (2) Large screen broadcast in shopping malls / exhibitions: Promotional content is played simultaneously on multiple screens; (3) Live streaming of school classes: Teachers' lectures are transmitted to each classroom in real time; (4) Live broadcast of sports venues: Spectators in the venues can watch multi-angle images through the App; (5) In-ship / aircraft entertainment system: live entertainment services in enclosed spaces; It should be noted that in a LAN deployment, the streaming media server and interactive server are deployed locally, multicast streams are transmitted through the LAN switch, and users access the network via WiFi. Compared to satellite scenarios, this offers lower latency (milliseconds), supports richer interactive formats, and has broad application value.

[0043] As can be seen, this application realizes a converged architecture of internet live streaming and satellite multicast. The video stream (multicast downlink) and interactive messages (unicast bidirectional) within the same live streaming room are transmitted using different port numbers, each employing an optimal transmission strategy to balance real-time performance and reliability. This combines the complete interactive experience of internet live streaming (bullet comments, likes, gifts, etc.) with the bandwidth efficiency of satellite multicast, thereby enabling live interactive functions on the satellite network. The user experience is essentially the same as that of terrestrial network live streaming. Furthermore, by adopting a multicast architecture, N users share one share of video traffic, reducing costs to 1 / N of traditional unicast solutions.

[0044] As described in the previous embodiment, this application discloses a live streaming interaction method based on satellite communication, which can improve the user's live streaming viewing experience by utilizing satellite communication. Next, the complete process from the user opening the App to sending bullet comments will be explained.

[0045] With the streamer already broadcasting and the system having allocated video stream port 22345 and interactive stream port 32345, the user opens the app, retrieves the live stream list, and the app requests the business server via HTTPS to obtain the live room list (including multicast addresses and port information). The user clicks to enter a live room, and the app joins the video multicast group 239.255.1.0:22345 and the interactive multicast group 239.255.2.0:32345, waits for the arrival of I-frames (maximum 2 seconds, or instantaneous if pre-loaded), begins playing the video, and displays bullet comments. When a user sends bullet comment A, the app sends bullet comment A via SLP / UDP protocol uplink to the interactive server. The interactive server calculates the display time segment (PTS) (current video PTS + 500ms) and sends bullet comment A (including PTS) via satellite multicast. All user apps display bullet comments at the correct time based on the PTS. When a user likes a comment, the app sends the like to the interactive server via SLP / UDP. The interactive server accumulates all likes within one second and updates the total number of likes via multicast. If a user sends a gift to the streamer, the app sends a gift request to the business server via HTTPS to complete the billing and recording. The business server notifies the interactive server, which then broadcasts the gift notification via SLP multicast, displaying the gift effect on all user apps. When a user switches to another live stream, the app joins the new live stream's multicast group and marks the original live stream as a "pending departure group." If the user returns to the original live stream within 5 seconds, playback resumes immediately; otherwise, the user truly leaves the original multicast group.

[0046] As can be seen, this application realizes a converged architecture of internet live streaming and satellite multicast. The video stream (multicast downlink) and interactive messages (unicast bidirectional) within the same live streaming room are transmitted using different port numbers, each employing an optimal transmission strategy to balance real-time performance and reliability. This combines the complete interactive experience of internet live streaming (bullet comments, likes, gifts, etc.) with the bandwidth efficiency of satellite multicast, thereby enabling live interactive functions on the satellite network. The user experience is essentially the same as that of terrestrial network live streaming. Furthermore, by adopting a multicast architecture, N users share one share of video traffic, reducing costs to 1 / N of traditional unicast solutions.

[0047] See Figure 2 As shown, this application discloses a live interactive device based on satellite communication, applied to a target server, comprising: The multicast stream delivery module 11 is used to obtain the target live video stream sent by the first type of client corresponding to the target live room through the first type of port number, and obtain the target multicast stream corresponding to the target live video stream based on the first target transmission protocol, and deliver the target multicast stream to the second type of client corresponding to the target live room through satellite multicast; the first target transmission protocol is a real-time transmission protocol based on the User Datagram Protocol; The interactive message processing module 12 is used to obtain the target interactive message stream sent by the second type of client through the second type of port number, and process the target interactive message stream to obtain the corresponding target message stream; the target message stream is a message stream transmitted based on the second target transmission protocol; The interactive message display module 13 is used to display the target message stream on each target client corresponding to the target live room based on the message type corresponding to each interactive message in the target message stream; the target client includes the first type of client and the second type of client.

[0048] As can be seen, this application realizes a converged architecture of internet live streaming and satellite multicast. The video stream (multicast downlink) and interactive messages (unicast bidirectional) within the same live streaming room are transmitted using different port numbers, each employing an optimal transmission strategy to balance real-time performance and reliability. This combines the complete interactive experience of internet live streaming (bullet comments, likes, gifts, etc.) with the bandwidth efficiency of satellite multicast, thereby enabling live interactive functions on the satellite network. The user experience is essentially the same as that of terrestrial network live streaming. Furthermore, by adopting a multicast architecture, N users share one share of video traffic, reducing costs to 1 / N of traditional unicast solutions.

[0049] In one specific embodiment, the device may further include: The port number allocation module is used to allocate a first type of port number and a second type of port number to each target live streaming room, and save the first type of port number and the second type of port number to the port database.

[0050] In one specific embodiment, the interactive message display module 13 may include: The condition judgment unit is used to determine whether the interactive message meets the preset unicast condition based on the message type corresponding to each interactive message in the target message stream. The first message transmission unit is configured to transmit the interactive message to the target client corresponding to the interactive message via satellite unicast if the interactive message meets the preset unicast conditions. The second message transmission unit is used to display the interactive message on each of the target clients corresponding to the target live broadcast room via satellite multicast if the interactive message does not meet the preset unicast conditions.

[0051] In one specific embodiment, the device may further include: A trusted transmission module is used to send a target message to a target client based on a preset reliable transmission mechanism if a target message that meets the reliable transmission conditions is obtained, and to obtain the transmission feedback result sent by the target client based on the target sliding window, so as to determine whether the target message has been successfully delivered based on the transmission feedback result; wherein, the target sliding window is a sliding window locally used by the target client to record the message sequence number corresponding to the processed target message.

[0052] In one specific embodiment, the device may further include: The keyframe delivery module is used to determine the preloaded live room corresponding to the second type of client based on a preset live room filtering strategy if the second type of client is detected to meet the keyframe preloading conditions, and to determine the target keyframe corresponding to the target multicast stream of each preloaded live room, so as to deliver the target keyframe to the second type of client.

[0053] In one specific embodiment, the device may further include: The popularity push module is used to send the target multicast stream corresponding to the target live room that meets the target popularity condition to the corresponding second type of client, so that the target multicast stream can be loaded through the second type of client.

[0054] Furthermore, embodiments of this application also disclose an electronic device, Figure 3 This is a structural diagram of an electronic device 20 according to an exemplary embodiment. The content of the diagram should not be construed as limiting the scope of this application.

[0055] Figure 3 This is a schematic diagram of the structure of an electronic device 20 provided in an embodiment of this application. Specifically, the electronic device 20 may include: at least one processor 21, at least one memory 22, a power supply 23, a communication interface 24, an input / output interface 25, and a communication bus 26. The memory 22 stores a computer program, which is loaded and executed by the processor 21 to implement the relevant steps in the satellite communication-based live interactive method disclosed in any of the foregoing embodiments. Alternatively, the electronic device 20 in this embodiment may specifically be an electronic computer.

[0056] In this embodiment, the power supply 23 is used to provide operating voltage for each hardware device on the electronic device 20; the communication interface 24 can create a data transmission channel between the electronic device 20 and external devices, and the communication protocol it follows can be any communication protocol applicable to the technical solution of this application, and is not specifically limited here; the input / output interface 25 is used to acquire external input data or output data to the outside world, and its specific interface type can be selected according to specific application needs, and is not specifically limited here.

[0057] In addition, the memory 22, as a carrier for resource storage, can be a read-only memory, random access memory, disk, or optical disk, etc. The resources stored thereon can include an operating system 221, computer programs 222, etc., and the storage method can be temporary storage or permanent storage.

[0058] The operating system 221 is used to manage and control the various hardware devices on the electronic device 20 and the computer program 222, which may be Windows Server, Netware, Unix, Linux, etc. In addition to including a computer program capable of performing the satellite communication-based live interactive method executed by the electronic device 20 as disclosed in any of the foregoing embodiments, the computer program 222 may further include computer programs capable of performing other specific tasks.

[0059] Furthermore, this application also discloses a computer-readable storage medium for storing a computer program; wherein, when the computer program is executed by a processor, it implements the aforementioned satellite communication-based live interactive method. Specific steps of this method can be found in the corresponding content disclosed in the foregoing embodiments, and will not be repeated here.

[0060] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For the apparatus disclosed in the embodiments, since it corresponds to the method disclosed in the embodiments, the description is relatively simple; relevant parts can be referred to in the method section.

[0061] Those skilled in the art will further recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of the various examples have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0062] The steps of the methods or algorithms described in conjunction with the embodiments disclosed herein can be implemented directly by hardware, a software module executed by a processor, or a combination of both. The software module can be located in random access memory (RAM), main memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art.

[0063] Finally, it should be noted that in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0064] The technical solutions provided in this application have been described in detail above. Specific examples have been used to illustrate the principles and implementation methods of this application. The descriptions of the above embodiments are only for the purpose of helping to understand the methods and core ideas of this application. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. A live interactive method based on satellite communication, characterized in that, Applied to the target server, including: The system obtains the target live video stream sent by the first type of client corresponding to the target live room through the first type of port number, and obtains the target multicast stream corresponding to the target live video stream based on the first target transmission protocol. The system then sends the target multicast stream to the second type of client corresponding to the target live room via satellite multicast. The first target transmission protocol is a real-time transmission protocol based on the User Datagram Protocol. The system acquires the target interactive message stream sent by the second type of client through the second type of port number, and processes the target interactive message stream to obtain the corresponding target message stream. The target message stream is a message stream transmitted based on the second target transmission protocol. The second target transmission protocol is a custom UDP protocol, which includes a frame structure definition, a message type system, a reliable transmission mechanism, and a deduplication strategy. The length of the magic number field of the protocol frame structure of the second target transmission protocol is 2B, the length of the protocol version field is 1B, the length of the message type field is 1B, the length of the message sequence number field is 4B, the length of the message timestamp field is 4B, the length of the room ID field is 4B, and the length of the user ID field is 4B. Based on the message type corresponding to each interactive message in the target message stream, the target message stream is displayed on each target client corresponding to the target live stream room; the target client includes the first type of client and the second type of client; the message type includes bullet comments, likes, and gift notifications; The step of displaying the target message stream on each target client corresponding to the target live streaming room based on the message type corresponding to each interactive message in the target message stream includes: Based on the message type corresponding to each interactive message in the target message stream, determine whether the interactive message meets the preset unicast condition; If the interactive message meets the preset unicast conditions, the interactive message is transmitted to the target client corresponding to the interactive message via satellite unicast; If the interactive message does not meet the preset unicast conditions, the interactive message will be displayed on each of the target clients corresponding to the target live broadcast room via satellite multicast.

2. The live interactive method based on satellite communication according to claim 1, characterized in that, Before obtaining the target live video stream sent by the first type of client corresponding to the target live room through the first type of port number, the method further includes: Assign a first-type port number and a second-type port number to each target live streaming room, and save the first-type port number and the second-type port number to the port database.

3. The live interactive method based on satellite communication according to claim 1, characterized in that, The target server includes a streaming media server, an interactive server, and a port allocation server. The streaming media server is used to transcode, encapsulate, and output the received live video stream. The interactive server is used to process and distribute the received interactive message stream. The port allocation server is used to manage port resources.

4. The live interactive method based on satellite communication according to claim 1, characterized in that, Also includes: If a target message that meets the reliable transmission conditions is obtained, the target message is sent to the target client based on a preset reliable transmission mechanism, and the transmission feedback result sent by the target client based on the target sliding window is obtained, so as to determine whether the target message has been successfully delivered based on the transmission feedback result; wherein, the target sliding window is a sliding window used by the target client to record the message sequence number corresponding to the processed target message locally.

5. The live interactive method based on satellite communication according to claim 1, characterized in that, Also includes: If the second type of client is detected to meet the keyframe preloading condition, the preloaded live room corresponding to the second type of client is determined based on the preset live room filtering strategy, and the target keyframe corresponding to the target multicast stream of each preloaded live room is determined, so as to send the target keyframe to the second type of client.

6. The live interactive method based on satellite communication according to any one of claims 1 to 5, characterized in that, Also includes: The target multicast stream corresponding to the target live room that meets the target popularity condition is sent to the corresponding second type of client so that the target multicast stream can be loaded through the second type of client.

7. A live interactive device based on satellite communication, characterized in that, Applied to the target server, including: The multicast stream delivery module is used to obtain the target live video stream sent by a first type of client corresponding to the target live room through a first type of port number, and obtain the target multicast stream corresponding to the target live video stream based on a first target transmission protocol, and deliver the target multicast stream to the second type of client corresponding to the target live room via satellite multicast; the first target transmission protocol is a real-time transmission protocol based on the User Datagram Protocol; An interactive message processing module is used to acquire the target interactive message stream sent by the second type of client through the second type of port number, and process the target interactive message stream to obtain the corresponding target message stream; the target message stream is a message stream transmitted based on a second target transmission protocol; wherein, the second target transmission protocol is a custom UDP protocol, the second target transmission protocol includes frame structure definition, message type system, reliable transmission mechanism and deduplication strategy, and the length of the magic number field of the protocol frame structure of the second target transmission protocol is 2B, the length of the protocol version field is 1B, the length of the message type field is 1B, the length of the message sequence number field is 4B, the length of the message timestamp field is 4B, the length of the room ID field is 4B, and the length of the user ID field is 4B; An interactive message display module is used to display the target message stream on each target client corresponding to the target live stream based on the message type corresponding to each interactive message in the target message stream; the target clients include the first type of client and the second type of client; the message types include bullet comments, likes, and gift notifications; The interactive message display module specifically includes: The condition judgment unit is used to determine whether the interactive message meets the preset unicast condition based on the message type corresponding to each interactive message in the target message stream. The first message transmission unit is configured to transmit the interactive message to the target client corresponding to the interactive message via satellite unicast if the interactive message meets the preset unicast conditions. The second message transmission unit is used to display the interactive message on each of the target clients corresponding to the target live broadcast room via satellite multicast if the interactive message does not meet the preset unicast conditions.

8. An electronic device, characterized in that, include: Memory, used to store computer programs; A processor for executing the computer program to implement the satellite communication-based live interactive method as described in any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that, Used to store a computer program, wherein the computer program, when executed by a processor, implements the satellite communication-based live interactive method as described in any one of claims 1 to 6.

Images